Senior Data Engineer

Artefact
London, UK
1 day ago
Apply on www.adzuna.co.uk
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Compensation
£66,679.0
Working hours
Regular working hours

Tech stack

Artificial Intelligence Airflow Amazon Web Services Microsoft Azure Big Data Continuous Integration Data Architecture Information Engineering Data Governance Data Retrieval Data Systems Data Warehousing
+17 more
DevOps Distributed Computing Environment Python (Programming Language) SQL Databases Workflow Management Systems Data Processing Azure Data Factory Snowflake Data Lakes Pyspark Information Technology AWS Glue Data Lakehouse Terraform Data Pipelines Devsecops Databricks

Job description

We are looking for a Senior Data Engineer to join our dynamic team. This role is ideal for someone with a deep understanding of data engineering and a proven track record of leading data projects in a fast-paced environment., * Design, build, and maintain scalable and robust data pipelines using SQL and Python, and leveraging any of the following: Databricks, Snowflake, Azure Data Factory, AWS Glue, Apache Airflow and Pyspark.

  • Lead the integration of complex data systems and ensure consistency and accuracy of data across multiple platforms.
  • Implement continuous integration and continuous deployment (CI/CD) practices for data pipelines to improve efficiency and quality of data processing.
  • Work closely with data architects, analysts, and other stakeholders to understand business requirements and translate them into technical implementations.
  • Oversee and manage a team of data engineers, providing guidance and mentorship to ensure high-quality project deliverables.
  • Develop and enforce best practices in data governance, security, and compliance within the organisation.
  • Optimise data retrieval and develop dashboards and reports for business teams.
  • Continuously evaluate new technologies and tools to enhance the capabilities of the data engineering function.

Requirements

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
  • 3+ years of industry experience in data engineering with a strong technical proficiency in SQL, Python, and big data technologies.
  • Expertise in building scalable data workflows using cloud-native orchestration tools and distributed data processing frameworks.
  • Demonstrated experience with Infrastructure as Code tooling such as Terraform
  • Solid understanding of CI/CD principles and DevOps/DevSecOps practices.
  • Proven leadership skills and experience managing data engineering teams.
  • Excellent problem-solving skills and the ability to work with ambiguity.
  • Proficient in leveraging AI-assisted workflows to optimise task efficiency.
  • Strong communication and interpersonal skills.
  • Excellent understanding of data architecture involving data mesh, data lake, data warehouse and data lakehouse., * Certifications in Azure, AWS, or GCP.
  • Certifications in Databricks, Snowflake or similar technologies.
  • Experience in the leading large scale data engineering projects.

Benefits & conditions

  • Hybrid work arrangement: two-three days per week working from the office

About the company

Artefact is a new generation of data service provider, specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we’re enjoying skyrocketing growth.

Our broad range of data-driven solutions in data consulting and digital marketing are designed to meet our clients’ specific needs, always conceived with a business-centric approach and delivered with tangible results. Our data-driven services are built upon the deep AI expertise we’ve acquired with our 1000+ client base around the globe.

We have over 2000 employees across 26 offices who are focused on accelerating digital transformation. Thanks to a unique mix of company assets: State of the art data technologies, lean AI agile methodologies for fast delivery, and cohesive teams of the finest business consultants, data analysts, data scientists, data engineers, and digital experts, all dedicated to bringing extra value to every client.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.adzuna.co.uk
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · World Congress 2026 Europe

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · World Congress 2024

Videos

See all

Related articles

See all