> Markdown version of [/jobs/ext/4003963-senior-machine-learning-engineer-orchestration-applied-ai-llms](https://www.wearedevelopers.com/jobs/ext/4003963-senior-machine-learning-engineer-orchestration-applied-ai-llms). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Machine Learning Engineer - Orchestration - Applied AI & LLMs

- **Company:** DOCTOLIB SAS
- **Location:** Paris, France
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Artificial Intelligence, Computer Vision, Mobile Application Software, Python (Programming Language), Machine Learning, TypeScript, Evaluation Pipelines, Large Language Models, Multi-Agent Systems, Swift (Programming Language), Agentic-AI, Kotlin, Information Technology, React Native, Claude, Evaluation of Large Language Models, GPT
- **Published:** October 29, 2026
- **Apply:** https://www.welcometothejungle.com/en/companies/doctolib/jobs/data-fr-senior-machine-learning-engineer-orchestration_paris

## About the Role

* Hold an MSc or PhD in Computer Science, Machine Learning, Data Science, or a related field
 * Have 7+ years of hands-on experience working with large language models (e.g., GPT, Claude, Llama, or BERT-like architectures)
 * Have proven experience evaluating agentic or reasoning systems (e.g., autonomous agents, tool-using LLMs, dialogue systems, or task-oriented assistants)
 * Have a strong track record in experiment design, metric definition, and evaluation automation
 * Are able to bridge research and production, influencing both modeling and product decisions
 * Have excellent communication skills, a collaborative mindset, and are fluent in English

It would be fantastic if you:

 * Have experience in the clinical or medical domain and sensitivity to ethical or regulatory challenges in healthcare AI

## Description

We are looking for a Senior Machine Learning Engineer to join the Orchestration team in AI Health Assistant . Your mission will be to ensure our AI Health Companion behaves safely, reliably, and helpfully - for millions of patients and practitioners. You will work in a cross-functional team building robust evaluation pipelines for agentic AI systems, contributing directly to improving the quality and safety of AI-powered healthcare. Working in the tech team at Doctolib means building innovative products and features to improve the daily lives of care teams and patients., * Define and own the evaluation strategy for our AI agentic system - metrics, protocols, datasets, and tooling

 * Implement and maintain automated evaluation pipelines to monitor model quality, safety, and alignment across iterations
 * Run systematic experiments to assess reasoning, factuality, robustness, and user experience
 * Collaborate closely with model developers and research scientists to provide insights and drive iterative improvement
 * Contribute to research and internal knowledge sharing on LLM evaluation methodologies and best practices

Life at Doctolib Tech

 * Our solutions are built on a single fully cloud-native platform that supports web and mobile app interfaces, multiple languages, and is adapted to country and healthcare specialty requirements.
 * Our stack is composed of Rails, TypeScript, Java, Python, Kotlin, Swift, and React Native.
 * We leverage AI ethically across our products to empower patients and health professionals. Discover our AI vision here .