> Markdown version of [/jobs/ext/3019224-senior-data-engineer-databricks-azure-data-platform](https://www.wearedevelopers.com/jobs/ext/3019224-senior-data-engineer-databricks-azure-data-platform). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer Databricks & Azure Data Platform

- **Company:** Acuity INC
- **Location:** UK
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** A/B Testing, Application Programming Interfaces (APIs), Artificial Intelligence, Data Analysis, Microsoft Azure, Continuous Integration, Data Systems, Python (Programming Language), Search Technologies, SQL Databases, Unstructured Data, Cloud Platform System, Azure Data Factory, Large Language Models, Generative AI, Pyspark, Api Design, Terraform, Data Pipelines, Databricks
- **Published:** September 21, 2026
- **Apply:** https://www.apply4u.co.uk/jobs/senior-data-engineer-databricks-azure-data-platform/46855611

## About the Role

databases, or semantic search. Strong communication skills and confidence working with technical, product and commercial stakeholders. A product mindset - you think about how data creates value, not just how it moves from A to B. Nice to Have Airbyte Terraform A/B testing or experimentation AI governance Life sciences or pharmaceutical experience Why Join Us? You'll have the opportunity to build products, not just infrastructure, shape how AI is used within real-world data solutions and have genuine influence over technical and product direction. You'll work with a modern Data & AI stack, have space to explore new technologies and help build solutions that deliver measurable customer impact. Learn more about life at Acuity Analytics on our Working Here page. #J-18808-Ljbffr

## Description

commercially valuable datasets. Build and integrate APIs to expose data and power products. Apply LLMs, RAG and Generative AI to classification, enrichment, search and insight generation. Work with structured and unstructured data, embeddings and semantic search. Help evolve our Databricks and Azure data platform. Improve data quality, testing, observability and CI/CD. Partner with product and commercial teams to turn business opportunities into technical solutions. Mentor engineers and help shape our growing Data & AI capability. What We're Looking For Hands-on experience with Databricks. Advanced Python, PySpark and SQL. Strong experience building scalable data pipelines and data models. Experience with Azure or another major cloud platform. Experience building APIs and exposing data to applications or customers. Experience with data products or customer-facing data solutions. Exposure to Generative AI / LLMs and real-world AI use cases. Familiarity with RAG, embeddings, vector


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [Infrastructure as Code: The Developer's Secret Weapon](https://www.wearedevelopers.com/videos/1221-infrastructure-as-code-the-developer-s-secret-weapon)
- [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source)
- [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)

## Related Articles

- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)