> Markdown version of [/jobs/ext/4532164-ai-data-engineer-genai-llm-evaluation](https://www.wearedevelopers.com/jobs/ext/4532164-ai-data-engineer-genai-llm-evaluation). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# AI & Data Engineer (GenAI & LLM Evaluation)

- **Company:** Acuity INC
- **Location:** United Kingdom (Remote available)
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Agile Methodology, Artificial Intelligence, Data Analysis, Application Integration Architecture, Information Engineering, Python (Programming Language), Machine Learning, Standard Sql, Large Language Models, Data Pipelines
- **Published:** November 3, 2026
- **Apply:** https://startup.jobs/senior-applied-ai-engineer-genai-llm-evaluation-acuity-analytics-10650902

## About the Role

If you enjoy solving real-world problems and building practical AI solutions that make an impact, we'd love to hear from you.

Skills and experience required

Core skills

 * 5+ years' experience in Data Engineering, Machine Learning, AI Engineering, or Data Science.

 * Strong Python and SQL skills.

 * Hands-on experience with Generative AI and Large Language Models (LLMs).

 * Experience evaluating LLMs using golden datasets, model benchmarking, or LLM-as-a-Judge techniques.

 * Experience building and deploying production-ready ML solutions.

 * Strong understanding of data pipelines, validation, and quality frameworks.

 * Experience integrating APIs and cloud-based AI services.

Soft skills

 * Strong problem-solving and analytical skills.

 * Comfortable owning solutions end-to-end.

 * Excellent communication and stakeholder management.

 * Experience working in Agile, cross-functional teams.

 * Consulting or customer-facing experience is a plus.

## Description

* Build and maintain scalable data pipelines and workflows.

 * Develop evaluation frameworks for GenAI and LLM applications.

 * Create and maintain golden datasets for model testing.

 * Evaluate and benchmark LLM performance.

 * Build ML-assisted tools to improve delivery and automation.

 * Deploy production-ready AI solutions.

 * Work closely with delivery teams to solve technical challenges.

 * Continuously improve data quality, automation, and operational efficiency.