> Markdown version of [/jobs/ext/324036-data-engineer](https://www.wearedevelopers.com/jobs/ext/324036-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Betfred - **Location:** Manchester, UK - **Salary:** £45,000.0 - £60,000.0 - **Contract:** Permanent contract - **Skills:** Agile Methodology, Amazon Web Services, Amazon S3, Data Architecture, Information Engineering, Data Infrastructure, Extract Transform Load (ETL), Data Warehousing, Python (Programming Language), Machine Learning, Microsoft SQL Server, SQL Databases, AWS Lambda, Build Management, Pyspark, AWS Glue, Real Time Data, Data Lakehouse, Cloud Migration, Data Pipelines, Amazon Elastic Mapreduce (EMR), Amazon Redshift - **Published:** June 1, 2026 - **Apply:** https://uk.indeed.com/viewjob?jk=429c5ec0788b439e ## About the Role Do you have experience in Technical support?, * Strong AWS Proficiency: Solid understanding and practical experience with AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS Redshift, and Amazon EMR. * Core Technical Skills: Proven proficiency in Python, SQL, Pipeline Orchestration, PySpark and a deep understanding of data warehousing concepts. * Problem-Solving: Demonstrated ability to independently diagnose and resolve complex data issues and performance bottlenecks. * Communication: Ability to effectively communicate technical concepts and project updates to both technical and non-technical stakeholders. * Experience with Data Architectures: Hands-on experience with data lakehouse architectures and data warehousing solutions. * Agile Experience: Experience with Agile development methodologies. * Security and Best Practices: A solid understanding of data security and privacy best practices. ## Description We are on the lookout for a skilled Data Engineer to become an integral part of our Data Engineering Team. You will not only maintain and optimize our data infrastructure but also spearhead its evolution. Built predominantly on AWS, and utilizing technologies like Pyspark and Iceberg, our infrastructure is designed for scalability, robustness, and efficiency. You will be part of developing sophisticated data integrations with various platforms, developing real-time data solutions, improving automation, and enabling crucial business intelligence., * Design and Build Data Pipelines: Take ownership of designing, developing, and maintaining robust data pipelines and ETL processes using AWS services such as AWS Glue, AWS Lambda, and AWS S3. * Contribute to Cloud Migration: Actively participate in and support the migration of our existing Data Warehouse from SQL Server to AWS, with a focus on implementing best practices using S3 and Redshift. * Ensure Data Quality and Integrity: Develop, implement, and maintain data quality checks and validation procedures to ensure the accuracy and reliability of our data. * Implement Architectural Solutions: Contribute to the design and implementation of data lakehouse architectures and data warehousing solutions. * Collaborate and Deliver: Work closely with data scientists and analysts to support the deployment and operationalization of machine learning and advanced analytical solutions. * Maintain and Optimize: Develop and maintain data documentation and operational procedures, and proactively investigate and resolve data quality issues and performance bottlenecks. * Stay Current and Innovate: Stay up-to-date with the latest data technologies and industry best practices and apply this knowledge to improve our platform. * Provide Technical Support: Offer technical guidance and support to junior data engineers and other team members when needed. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [How we built an AI-powered code reviewer in 80 hours](https://www.wearedevelopers.com/videos/1511-how-we-built-an-ai-powered-code-reviewer-in-80-hours) - [WeAreDevelopers LIVE - CSS is DOOMed](https://www.wearedevelopers.com/videos/1838-wearedevelopers-live-css-is-doomed) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Software Engineer Salary in The UK](https://www.wearedevelopers.com/magazine/231-software-engineer-salary-in-the-uk) - [Fullstack Developer Salary UK](https://www.wearedevelopers.com/magazine/251-fullstack-developer-salary-uk)