Senior Data Engineer

Transform
Greater London, UK
2 days ago
Apply on www.collegerecruiter.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours

Tech stack

Artificial Intelligence Amazon Web Services Application Frameworks Microsoft Azure Encodings Continuous Integration Data Architecture Information Engineering Data Infrastructure Data Systems Graph Database Python (Programming Language)
+7 more
Standard Sql Cloud Platform System Azure Data Factory Snowflake Semi-structured Data Data Pipelines Databricks

Job description

The Senior Data Engineer will play a key role within an Agile delivery team to design, build, and maintain robust, scalable data solutions. You will contribute to the delivery of a range of data products that support business intelligence, reporting, analytics, and AI-driven use cases, ensuring data is accessible, reliable, secure, and fit for purpose.

Working collaboratively across multidisciplinary teams, you will engage closely with other engineers, product owners, business analysts, data architects, data analysts, project managers, and data scientists to understand business requirements and translate them into effective technical solutions. You will be responsible for developing and optimising data pipelines and integrating diverse data sources within cloud-based data platforms.

As a senior member of the team, you will provide technical guidance, promote engineering best practices, and contribute to the continuous improvement of delivery processes, tooling, and standards. You will champion data quality, ensuring that solutions are scalable, maintainable, and aligned with organisational and regulatory requirements.

We are looking for individuals who bring a growth mindset and a passion for continuous learning. You will be curious about emerging technologies, particularly within the AI and data landscape, and proactive in identifying opportunities to innovate and improve delivery., * Working with clients to understand their needs, and implement the best technological solution

  • Building and configuring complex end-to-end data pipelines
  • Delivering in fact-paced environments where requirements may evolve over time
  • Collaborate effectively within agile, cross-functional teams to deliver high-quality data solutions

Requirements

  • Solid foundations in data engineering principles and best practices
  • Proven experience of designing, building and delivering production-ready data pipelines
  • Strong communication skills, with the ability to engage and influence stakeholders at all levels
  • Strong SQL and Python expertise, with experience in the development of reusable frameworks and components
  • Strong understanding of data quality and experience embedding appropriate controls throughout the data platform and delivery lifecycle
  • Significant experience designing and delivering data solutions on cloud platforms such as Azure or AWS
  • Hands-on experience with modern data engineering platforms and services, such as Azure Data Factory, Databricks, Fabric, Snowflake or equivalent technologies
  • Experience working with a diverse range data sources, including structured and semi-structured data
  • Understanding of CI/CD tooling and processes used to support reliable and efficient deployments
  • Experience of mentoring junior to mid-level Data Engineers would be beneficial
  • Experience of vector databases or knowledge graphs
  • Experience of using AI to assist development

Benefits & conditions

  • Holiday entitlement, 28 days with the option to buy/sell up to 5 days (note that 3 days are held for Christmas holidays)
  • Day off (on or in the week of) your birthday
  • Pension eligibility, up to 5% matched contributions
  • Life assurance
  • Enhanced maternity and enhanced paternity and shared parental leave
  • Cycle to work schemes
  • A range of other benefits from our flexible benefits package

At Transform, you can expect meaningful work, with real impact and the space to grow as people as well as a professional.

You’ll work alongside curious, authentic experts who care deeply about doing the right thing, for our clients and for each other with no egos, no blame, and no standing on the sidelines.

We’re all in on creating an environment where people feel supported, included and trusted to do their best work. In return, we ask for curiosity, honesty and a willingness to lean into learning, quality, teamwork, and to making change that truly lasts.

About the company

We’re Transform.

Transform is a fresh alternative to Big Consulting. As an end-to-end transformation partner, we define, design, build and operate systems that solve our clients’ toughest challenges and seize their biggest opportunities. That often means combining strategy, data, AI, technology, and change management. Sometimes we manage and operate the systems we create; other times, we hand it over for the client to run - standing by to make improvements when things change. It all comes down to making an impact: improving lives, supporting citizens, streamlining workflows, and making the world a better place. We specialise in public sector and public-facing organisations - from government agencies and local authorities to energy, utilities, transportation and healthcare. We also work for some of the world’s most dynamic brands across automotive, retail, financial services, and consumer goods. We work closely (often on site) with our clients; to deliver impact you are keen to help us build the workforce of the future, we should talk.

We’re all in! That’s what gets us out of bed every day. We hope you feel the same.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.collegerecruiter.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

3:17 min

Optimizing character encoding with Kim variable byte encoding

Douglas Crockford Douglas Crockford · World Congress 2024

1:33 min

Integrating internal APIs and maintaining data sovereignty

Mahran Meißner Mahran Meißner · World Congress 2026 Europe

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

2:50 min

Executing LoRA fine-tuning using serverless Databricks AI runtimes

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

Videos

See all

Related articles

See all