> Markdown version of [/jobs/ext/2466200-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/2466200-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** AOB Recruitment - **Location:** UK - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Agile Methodology, Artificial Intelligence, Airflow, Amazon Web Services, Amazon S3, Data Analysis, Apache HTTP Server, Automation of Tests, Big Data, Cloud Engineering, Configuration Management, Information Systems, Databases, Continuous Delivery, Information Engineering, Data Governance, Data Transformation, Data Normalization, Data Systems, Data Warehousing, Database Queries, Database Storage Structures, Dimensional Modeling, Distributed Data Store, Python (Programming Language), Machine Learning, Meta-Data Management, Online Analytical Processing, Online Transaction Processing, Performance Tuning, Scrum Methodology, Cloud Services, Software Engineering, Enterprise Data Management, Sql Optimization, Snowflake, Data Lakes, Core Data, Information Technology, Data Management, Physical Data Models, Amazon Simple Queue Service (SQS), Software Version Control, Data Pipelines, Programming Languages - **Published:** August 7, 2026 - **Apply:** https://uk.indeed.com/viewjob?jk=3e456eef5d9f6d3f ## About the Role * 5+ years of experience designing and developing enterprise data pipelines. * Strong understanding of data modeling principles, including dimensional modeling and data normalization. * Proficiency in at least one modern programming language, such as Python. * Advanced SQL skills with the ability to analyze and optimize complex datasets. * Hands-on production experience with workflow orchestration platforms such as Apache Airflow. * Experience working with Snowflake or similar cloud data warehouse technologies. * Experience with cloud platforms, preferably AWS, including services such as S3, Lambda, SNS, and SQS. * Experience working with modern data lake technologies such as Apache Iceberg or equivalent open table formats. * Strong understanding of data transformation frameworks such as dbt. * Experience implementing data governance best practices, including data contracts and metadata management. * Strong analytical, algorithmic, and problem-solving skills. * Excellent written, verbal, and interpersonal communication skills. * Understanding of OLTP and OLAP database architectures and their appropriate use cases. * Ability to thrive in a fast-paced, collaborative, and Agile development environment. * Self-motivated with a strong attention to detail and a commitment to delivering high-quality solutions. * Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent professional experience., * Experience building enterprise-scale cloud data platforms supporting analytics, AI, and machine learning workloads. * Experience implementing CI/CD pipelines and DevOps best practices for data engineering. * Knowledge of data governance, lineage, observability, and data quality frameworks. * Experience working with large-scale distributed data environments and cloud-native architectures. * Familiarity with modern software engineering practices, version control systems, and automated testing. * Experience collaborating with cross-functional teams across engineering, analytics, product, and business organizations. Must Haves * Total years of exp - 9-13 years * 5+ years of Strong experience with Core Data Platform/Data Engineering * Data Modeling (Dimensional Modeling, Normalization, OLTP vs. OLAP) * Python for data engineering and automation * Advanced SQL (complex queries, optimization, performance tuning) * Snowflake (hands-on implementation and optimization) * Understanding of OLTP vs. OLAP architectures and data warehouse design * Job stability is mandatory ## Description We are seeking an experienced Senior Data Engineer to help design, build, and optimize modern cloud-based data platforms that transform data into actionable insights. In this role, you will collaborate with data engineers, data scientists, architects, product managers, and business stakeholders to develop scalable, reliable, and high-performance data solutions that support analytics, artificial intelligence, machine learning, and business intelligence initiatives. The ideal candidate has strong experience building enterprise data platforms, designing scalable data models, and developing cloud-native data pipelines using modern data engineering technologies., * Design, develop, and maintain scalable, reliable, and efficient data pipelines. * Create conceptual, logical, and physical data models that support enterprise analytics and reporting. * Design and optimize database structures using dbt and implement data transformation pipelines that support high-performance analytics. * Collaborate with data engineers, data scientists, architects, and cross-functional teams to deliver scalable data solutions. * Develop and maintain cloud-native data pipelines using technologies such as AWS (S3, Lambda, SNS, SQS), Apache Iceberg, Snowflake, dbt, and Airflow. * Participate actively in Agile/Scrum ceremonies and contribute to continuous improvement initiatives. * Partner with product managers, architects, and engineering teams to deliver enhancements to enterprise data platforms. * Establish and maintain standards and best practices for data pipeline development, naming conventions, configuration management, and documentation. * Ensure data platforms meet service level agreements (SLAs) for reliability, scalability, performance, and data quality. * Support data governance initiatives, including data contracts, metadata management, and documentation. * Engage with business stakeholders to understand evolving data requirements and prioritize enhancements that improve business value. * Maintain comprehensive technical documentation to support operational excellence, governance, and long-term maintainability. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [Kubernetes and Microservices with Multi-Model Databases](https://www.wearedevelopers.com/videos/382-kubernetes-and-microservices-with-multi-model-databases) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)