Senior Data Engineer
This Senior Data Engineer will play a key role in the evolution of our data platform, driving innovation and delivering high-quality data solutions. This role will focus on both migration from our current Data Warehouse to an AWS ecosystem, and developing cutting edge real-time data solutions including automation, business intelligence, and enabling analytics.
- Design, develop, and maintain data pipelines and ETL processes using AWS services such as AWS Glue, AWS Lambda and AWS S3.
- Support the migration of the existing Data Warehouse from SQL Server to AWS through S3 and Redshift.
- Develop and implement data quality checks and validation procedures.
- Design and implement best practice data lakehouse architectures and data warehousing solutions.
- Collaborate with data scientists and analysts to support the deployment of machine learning and advanced analytical solutions.
- Develop and maintain data documentation and operational procedures.
- Investigate and resolve data quality issues and performance bottlenecks.
- Stay abreast of the latest data technologies and industry best practices.
- Mentor junior data engineers and provide technical guidance to other team members where applicable.
- Contribute to the development and improvement of data platform best practices.
- Good understanding of AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. (required)
- Proficiency in Python, SQL, Pipeline Orchestration, and data warehousing concepts. (required)
- Ability to diagnose and resolve complex data issues. (required)
- Ability to effectively communicate with both technical and non-technical stakeholders. (required)
- Experience with data lakehouse architectures and data warehousing solutions. (required)
- Experience in migrating data from on-premises systems to cloud environments would be desirable. (preferred)
- Experience with Agile development methodologies. (preferred)
- Experience with data security and privacy best practices. (preferred)
- A competitive rate of pay and pension contribution (£55,000 - £80,000)
- Generous discretionary bonus schemes, incentives and competitions
- An annual leave entitlement that increases with length of service
- Access to an online GP 24/7, 365 days a year for you and your immediate family.
- Employee wellbeing support through our Employee Assistance Programme
- Enhanced Maternity & Paternity Pay
- Long Service Recognition
- Access to a pay day savings scheme, financial coach and up to 40% of your earned wage ahead of payday, through Wagestream.
Betfred is a leading betting and gaming company that has been at the forefront of the industry for over 50 years. With over 1300 shops and 9500 employees, we are constantly pushing ourselves to innovate and improve, and we are always on the lookout for the best talent to join our team. In 2019, we entered the US sports betting market as Betfred Sportsbook, and we now operate in 10 states. We have also recently established a new presence in South Africa, with over 50 betting halls, and we own a majority stake in Lottostar, South Africa's largest online betting company. At Betfred, our mission is to provide our customers with the best possible service, products and experience while ensuring responsible gambling. We believe our employees are our greatest asset and we are committed to providing them with the training and development they need to succeed. We offer a range of career opportunities, from retail positions in our shops to roles in our head office. We are also dedicated to giving back to the communities in which we operate. Through our Betfred Supports initiative, we support a range of charities and community initiatives.