AI Data Engineer (azure)

Stott and May
London, UK
3 days ago
Apply on www.totaljobs.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Compensation
£169,000.0
Working hours
Regular working hours

Tech stack

Artificial Intelligence Microsoft Azure Profiling Continuous Integration Data Architecture Data Discovery Information Engineering DevOps Python (Programming Language) NoSQL Standard Sql SQL Databases
+8 more
Unstructured Data Azure Data Factory Retrieval-Augmented Generation Generative AI Cosmos DB Azure Synapse Analytics Data Pipelines Databricks

Job description

We’re looking for a strong Azure Data Engineer with hands-on experience building and maintaining high-volume, production-ready data pipelines, combined with practical GenAI experience., Design and maintain end-to-end Azure data pipelines, from ingestion through to production use.

  • Work with structured, semi-structured and unstructured data at scale.
  • Build solutions using Azure Cosmos DB, Synapse and Databricks.
  • Apply SQL and NoSQL data modelling and optimisation techniques.
  • Support GenAI use cases including RAG, embeddings, search and retrieval.
  • Prepare and transform data for production AI systems.
  • Perform data discovery, profiling, transformation and quality analysis.
  • Work with data scientists, AI engineers, architects and business stakeholders to deliver scalable solutions.

Requirements

Strong, hands-on Azure Data Engineering experience.

  • Proven experience building and maintaining production-grade data pipelines.
  • Strong experience with Azure Cosmos DB and NoSQL concepts.
  • Experience with Azure Synapse.
  • Strong conceptual understanding of Azure Databricks.
  • Strong SQL and Python skills.
  • Experience with high-volume, structured/unstructured data.
  • Practical experience contributing to a live/real-world GenAI use case - not purely theoretical.
  • Understanding of how data is prepared and integrated into production AI/GenAI systems.
  • Familiarity with CI/CD, DevOps and modern data architectures.

The Ideal Candidate You’ll combine strong data engineering fundamentals, deep Azure knowledge and practical GenAI experience. You should be able to explain not only how to build a data pipeline, but how the underlying data, SQL/NoSQL platforms and architecture support AI in production.

Azure experience is essential - candidates with strong general data engineering skills but limited Azure data-service exposure are unlikely to be suitable.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.totaljobs.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:37 min

Comparing traditional SQL tables versus NoSQL non-tabular databases

Stanimira Vlaeva · JS Congress

1:22 min

Analyzing differences between mobile and traditional backend DevOps

Mete Baydar Mete Baydar · World Congress 2025

6:35 min

Evaluating blob storage against cosmos db for unstructured data

Menaka Baskerpillai · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

53 sec

Assessing databases with the Cosmos DB migration tool

Radu Vunvulea Radu Vunvulea · World Congress 2022

3:27 min

Defining DevOps through its historical origins and foundational texts

Sonal Patil · LIVE

Videos

See all

Related articles

See all