Senior Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+52 more
Job description
As a Senior Data Engineer, you will work closely with data scientists, analytics teams, software engineers, and business stakeholders to build scalable data pipelines, develop cloud-based data solutions, and ensure the reliability, security, and integrity of enterprise data assets. You will play a critical role in implementing modern data architecture, supporting business intelligence initiatives, and driving continuous improvements across the organization’s data ecosystem., * Design, develop, and maintain scalable data pipelines that support enterprise reporting, analytics, and machine learning initiatives.
- Build and optimize ETL and ELT processes for ingesting, transforming, and loading data from multiple structured and unstructured sources.
- Design and manage modern data warehouses, data lakes, and lakehouse architectures.
- Develop cloud-native data solutions using Microsoft Azure, Amazon Web Services (AWS), or Google Cloud Platform (GCP).
- Collaborate with business stakeholders to understand data requirements and deliver high-quality data solutions.
- Optimize database performance, SQL queries, and large-scale data processing workflows.
- Implement robust data quality, validation, governance, and monitoring processes to ensure data accuracy and consistency.
- Develop scalable data models that support business intelligence, reporting, and advanced analytics.
- Build automated workflows using orchestration tools such as Apache Airflow, Azure Data Factory, or AWS Glue.
- Work closely with software engineering teams to integrate enterprise applications, APIs, and cloud platforms with data infrastructure.
- Implement security controls, access management, backup strategies, and disaster recovery processes for enterprise data platforms.
- Troubleshoot complex data engineering issues, perform root cause analysis, and implement long-term solutions.
- Mentor junior data engineers and promote engineering best practices across the data team.
- Evaluate emerging technologies and recommend innovative solutions that improve scalability, reliability, performance, and operational efficiency.
Requirements
The successful candidate will possess strong technical expertise in cloud technologies, data engineering frameworks, and database management while demonstrating excellent analytical and problem-solving skills., * Bachelor’s degree in Computer Science, Data Engineering, Information Technology, Mathematics, Engineering, or a related discipline, or equivalent professional experience.
- Significant experience in data engineering, data platform development, or enterprise data architecture.
- Strong proficiency in SQL and programming languages such as Python, Scala, Java, or Spark.
- Hands-on experience building ETL and ELT pipelines using Azure Data Factory, AWS Glue, Apache Airflow, Informatica, Talend, or similar tools.
- Experience with cloud platforms including Microsoft Azure, Amazon Web Services (AWS), or Google Cloud Platform (GCP).
- Strong knowledge of relational and NoSQL databases such as SQL Server, PostgreSQL, MySQL, Oracle, MongoDB, Cassandra, Snowflake, or BigQuery.
- Experience working with big data technologies including Apache Spark, Hadoop, Kafka, Databricks, or Delta Lake.
- Strong understanding of dimensional modelling, data warehousing concepts, Star Schema, Snowflake Schema, and data lake architectures.
- Experience using Git, Azure DevOps, GitHub, GitLab, CI/CD pipelines, and Infrastructure as Code practices.
- Knowledge of data governance, GDPR, data security, metadata management, and enterprise data quality frameworks.
- Experience supporting business intelligence platforms such as Power BI, Tableau, Looker, or Qlik Sense.
- Excellent analytical, communication, stakeholder management, and problem-solving skills.
- Professional certifications such as Microsoft Certified: Azure Data Engineer Associate, AWS Certified Data Engineer - Associate, Google Professional Data Engineer, Databricks Data Engineer Associate, or equivalent are highly desirable.
- Eligibility to work in the United Kingdom.
Benefits & conditions
Pulled from the full job description
- Financial planning services
- Gym membership
- Life insurance
- Free parking
- On-site gym
- Casual dress
- Health & wellbeing programme
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on uk.indeed.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Data Analyst Salary in the UK
Software Engineer Salary London
Fullstack Developer Salary UK
Software Engineer Salary in The UK