AI & Data Engineer (GenAI & LLM Evaluation)

Acuity INC
United Kingdom
11 days ago
Apply on startup.jobs
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source

Tech stack

Agile Methodology Artificial Intelligence Data Analysis Application Integration Architecture Information Engineering Python (Programming Language) Machine Learning Standard Sql Large Language Models Data Pipelines

Job description

  • Build and maintain scalable data pipelines and workflows.

  • Develop evaluation frameworks for GenAI and LLM applications.

  • Create and maintain golden datasets for model testing.

  • Evaluate and benchmark LLM performance.

  • Build ML-assisted tools to improve delivery and automation.

  • Deploy production-ready AI solutions.

  • Work closely with delivery teams to solve technical challenges.

  • Continuously improve data quality, automation, and operational efficiency.

Requirements

If you enjoy solving real-world problems and building practical AI solutions that make an impact, we’d love to hear from you.

Skills and experience required

Core skills

  • 5+ years’ experience in Data Engineering, Machine Learning, AI Engineering, or Data Science.

  • Strong Python and SQL skills.

  • Hands-on experience with Generative AI and Large Language Models (LLMs).

  • Experience evaluating LLMs using golden datasets, model benchmarking, or LLM-as-a-Judge techniques.

  • Experience building and deploying production-ready ML solutions.

  • Strong understanding of data pipelines, validation, and quality frameworks.

  • Experience integrating APIs and cloud-based AI services.

Soft skills

  • Strong problem-solving and analytical skills.

  • Comfortable owning solutions end-to-end.

  • Excellent communication and stakeholder management.

  • Experience working in Agile, cross-functional teams.

  • Consulting or customer-facing experience is a plus.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on startup.jobs
Prepare application

Good distractions

Loading talks and stories from around this role…