AI Engineering Architect -Agentic AI & Data Platforms(Data Architect II)

UST Global
Nottingham, UK
2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Airflow Static Program Analysis Code Generation Data Architecture Information Engineering Python (Programming Language) Large Language Models Prompt Engineering Pyspark Kubernetes Integration Frameworks
+4 more
Data Management Virtual Agents GPT Data Pipelines

Job description

This role acts as the “brain” of a transformation accelerator, driving intelligent automation across complex data pipelines using advanced LLM frameworks and AI-driven engineering practices, * Architect and implement Agentic AI workflows to automate:

  • Legacy pipeline parsing
  • PySpark code generation
  • DAG (workflow) generation

Design and standardize:

  • Prompt engineering frameworks
  • Context management strategies for LLMs

Build and enhance:

  • AI validation pipelines (including hallucination detection and control)
  • Static analysis mechanisms for generated code

Enable enterprise-scale AI adoption by:

  • Driving AI-generated documentation and metadata
  • Scaling intelligent automation across thousands of pipelines

Requirements

Do you have experience in Python?, Do you have a Master’s degree?, * Strong expertise in:

  • Agentic AI / LLM architectures / prompt engineering
  • Python development
  • Data engineering concepts (for validation and automation workflows)

Proven experience designing AI-driven automation solutions

Ability to develop scalable frameworks for AI code generation and validation

Nice to Have

  • Experience with orchestration frameworks (e.g., Airflow or similar)
  • Exposure to data processing frameworks such as PySpark, pyspark,agentic ai,python,data engineering

About the company

UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world’s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients’ organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact-touching billions of lives in the process.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:08 min

Essential engineering roles in the generative AI space

Mary Grygleski Mary Grygleski · LIVE

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · WWC Europe 2026

40 sec

Generative pre-trained transformer models powering code completions

lgonta lgonta +1 · WWC 2024

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · WWC 2024

Videos

See all

Related articles

See all