Senior Data Engineer

Indicium Ai
London, UK
11 days ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Airflow Amazon Web Services Computing Platforms Automation of Tests Microsoft Azure Cloud Computing Continuous Integration Data Governance Data Infrastructure Data Transformation DevOps
+26 more
Distributed Systems Python (Programming Language) Machine Learning Performance Tuning Release Management DataOps Software Engineering Data Streaming Pulumi Google Cloud Snowflake Apache Spark Cloudformation Event Driven Architecture Infrastructure Automation Frameworks Apache Flink Bicep Apache Kafka Data Management Data Lakehouse Terraform Stream Processing Software Version Control Data Pipelines Databricks Programming Languages

Job description

We’re seeking an experienced Senior Data Engineer to design, build, and scale modern cloud-native data platforms that enable advanced analytics, AI, and business-critical decision making.

This role is ideal for someone who enjoys solving complex data challenges end-to-end, from architecting platforms and pipelines through to enabling AI-ready data products. You’ll work closely with clients to modernise their data estates, implement best-in-class engineering practices, and deliver scalable data solutions across a variety of cloud environments and technologies.

As a consultant, you’ll combine deep technical expertise with a pragmatic, outcome-focused mindset, helping enterprise organisations turn their data strategies into reality while influencing engineering best practices across delivery teams.

Responsibilities

  • Design and implement modern data platforms, data products, and scalable data pipelines across cloud environments.
  • Build, optimise, and maintain batch and real-time data processing solutions to support analytics, reporting, machine learning, and AI use cases.
  • Work with clients to understand business requirements and translate them into robust technical solutions.
  • Contribute to solution architecture, platform design, and technology selection decisions.
  • Implement software engineering and DataOps best practices including testing, observability, CI/CD, version control, and infrastructure automation.
  • Develop and optimise data models, transformations, and storage layers to ensure performance, reliability, and scalability.
  • Collaborate with cross-functional teams including Data Scientists, AI Engineers, Platform Engineers, Architects, and business stakeholders.
  • Support clients through discovery, design, delivery, and adoption phases of data transformation programmes.
  • Mentor engineers and contribute to the growth of engineering capability across project teams.
  • Contribute to internal initiatives including accelerators, technical communities, blogs, thought leadership, and capability development.

Requirements

  • Strong hands-on experience building modern data platforms and data products in enterprise environments.
  • Proven experience with one or more major cloud platforms including AWS, Azure, or Google Cloud Platform.
  • Proven commercial experience with Databricks and/or Snowflake, including the design, implementation, and optimization of data platforms at scale
  • Strong SQL expertise and software engineering experience using Python and/or other modern programming languages.
  • Experience developing and orchestrating data pipelines using technologies such as DBT, Apache Spark, Airflow, Dagster, Kafka, Flink, or equivalent tooling.
  • Solid understanding of data lakehouse, warehouse, and medallion architecture patterns.
  • Experience applying DevOps and DataOps best practices including CI/CD, automated testing, monitoring, observability, and release management.
  • Experience with Infrastructure as Code technologies such as Terraform, Pulumi, CloudFormation, or Bicep.
  • Strong understanding of distributed systems, data modelling, data governance, security, and performance optimisation.
  • Ability to engage with technical and non-technical stakeholders, communicating complex concepts in a clear and pragmatic way.
  • Experience working within consulting, professional services, or client-facing delivery environments.

Nice to Have

  • Experience building AI-ready data platforms and supporting GenAI, ML, or advanced analytics workloads.
  • Experience with real-time streaming architectures and event-driven systems.
  • Experience with data mesh, data product operating models, or modern data governance frameworks.
  • Exposure to Data Quality and Observability platforms such as Great Expectations, Monte Carlo, or Soda.
  • Industry experience within Financial Services, Energy & Utilities, Healthcare, Manufacturing, or Retail.
  • Cloud provider and/or platform certifications across AWS, Azure, GCP, Databricks, or Snowflake.

Benefits & conditions

  • Fast-growing global AI and Data consultancy with significant opportunities for career progression.
  • Work on high-impact transformation programmes with some of the world’s leading enterprises.
  • Competitive salary and performance-based bonus structure.
  • Access to leading technologies and strategic partnerships across the AI and Data ecosystem.
  • Collaborative, low-ego culture where expertise, curiosity, and innovation are valued.
  • Choose your own equipment, including MacBook, PC, and accessories.
  • Dedicated learning and development budget to support certifications and continuous growth.
  • Opportunity to shape the future of a rapidly growing AI-native consultancy.

About the company

Indicium AI is trusted by the world’s leading enterprises to deliver AI and data into production at scale. We are a global AI-native consultancy with proven experience across Financial Services, Energy & Utilities, Healthcare & Life Sciences, Retail & CPG, and Manufacturing. From strategy, to build, to business outcomes, we unlock value from data and AI with unmatched clarity, speed, and capability.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

1:22 min

Analyzing differences between mobile and traditional backend DevOps

Mete Baydar Mete Baydar · World Congress 2025

2:56 min

Provisioning a secure container infrastructure with Bicep

Matthias Falkenberg +1 · World Congress 2022

1:55 min

Contrasting Terraform with Pulumi and cloud-specific tools

Devlin Duldulao · LIVE

3:27 min

Defining DevOps through its historical origins and foundational texts

Sonal Patil · LIVE

4:09 min

Selecting infrastructure tools and determining proper abstraction layers

Alayshia Knighten Alayshia Knighten · World Congress 2024

Videos

See all

Related articles

See all