AI Agent Developer

Lorien
London, UK
2 days ago
Apply on www.careerboard.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

.NET Framework Application Programming Interfaces (APIs) Artificial Intelligence Audit Trail Microsoft Azure C Sharp (Programming Language) Code Coverage Continuous Integration Data Validation Information Leak Prevention Fault Tolerance Github
+16 more
Python (Programming Language) Azure Data Lake Search Technologies Microsoft SharePoint Software Engineering Retrieval-Augmented Generation Large Language Models Multi-Agent Systems Prompt Engineering Git Kubernetes Production Code Cosmos DB Virtual Agents Restful APIs Software Version Control

Job description

We are currently recruiting for an AI Agent Developer with Azure experience to join one of our Insurance clients on a 6-month contract., * Design and implement agents and multi-agent workflows using the Microsoft Agent Framework and Azure AI Foundry, including single-agent, supervisor/worker, sequential and handoff orchestration patterns.

  • Build the agent orchestration layer: intent routing, planning, tool selection, conversation and thread state, human-in-the-loop checkpoints, retries, timeouts and graceful degradation.
  • Define and implement tool/function calling contracts against the Agent Data API and Member Data API, including strict schemas, input validation, authorisation checks and safe handling of partial or missing data.
  • Design and tune the retrieval-augmented generation pipeline over Azure AI Search - chunking, embeddings, hybrid and semantic search, filters, reranking, query rewriting and citation of sources - across the SharePoint, Azure Data Lake and GitHub knowledge base.
  • Engineer, version and test system prompts, instructions and grounding strategies; select and configure the appropriate Azure AI models for each task with an eye on quality, latency and cost.
  • Implement persistent agent state, memory and audit trails in Azure Cosmos DB via the Agent Data API.
  • Build the evaluation harness: golden datasets, groundedness, relevance, task-completion and safety metrics, offline and online evaluation, and regression gating of prompt and model changes in CI.
  • Integrate guardrails end to end - Azure AI Content Safety, prompt-shield/jailbreak defences, PII handling, refusal and escalation behaviour, and grounding constraints to prevent hallucinated advice.

Requirements

  • Strong software engineering skills in Python and/or C#/.NET, with production code in source control and test coverage.
  • Hands-on experience building LLM applications - agents, tool/function calling, RAG or orchestration frameworks (Microsoft Agent Framework, Semantic Kernel, AutoGen, LangChain, LangGraph or equivalent).
  • Practical prompt engineering skill, and the judgement to know when a prompt change is the wrong fix.
  • Experience with Azure OpenAI/Azure AI Foundry or a comparable managed LLM platform, including model selection and parameter tuning.
  • Retrieval and vector search experience: embeddings, chunking strategies, hybrid search, relevance tuning (Azure AI Search preferred).
  • Experience consuming and designing against REST APIs, with secure token-based authentication.
  • A rigorous approach to evaluating non-deterministic systems - you measure quality rather than asserting it.
  • Awareness of LLM risk: hallucination, prompt injection, data leakage, over-permissioned tools, and how to mitigate each.
  • Git-based collaborative development and CI/CD familiarity.
  • Production experience with the Microsoft Agent Framework or Azure AI Foundry Agent Service specifically.
  • Experience with Azure AI Content Safety, prompt shields or another guardrail stack.
  • Azure Cosmos DB data modelling.
  • Certifications such as AI-102 or equivalent.

About the company

Guidant, Carbon60, Lorien & SRG - The Impellam Group Portfolio are acting as an Employment Business in relation to this vacancy.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerboard.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters · World Congress 2023

6:35 min

Evaluating blob storage against cosmos db for unstructured data

Menaka Baskerpillai · LIVE

1:24 min

Building client-facing AI agents for engineering teams

Alfonso Graziano Alfonso Graziano · Coffee With Developers

53 sec

Assessing databases with the Cosmos DB migration tool

Radu Vunvulea Radu Vunvulea · World Congress 2022

2:40 min

Using GitHub primitives for internal documentation and corporate operations

Kyle Daigle · Coffee With Developers

Videos

See all

Related articles

See all