> Markdown version of [/jobs/ext/3519869-senior-hybrid-evaluation-test-environment-lead-cxr-vlm-llm](https://www.wearedevelopers.com/jobs/ext/3519869-senior-hybrid-evaluation-test-environment-lead-cxr-vlm-llm). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior hybrid evaluation / test environment lead (cxr vlm/llm)

- **Company:** FalconSmartIT
- **Location:** Eindhoven, Netherlands
- **Experience:** Expert
- **Contract:** Temporary contract
- **Skills:** Artificial Intelligence, Amazon Web Services, Large Language Models, Model Validation, Machine Learning Operations
- **Published:** October 1, 2026
- **Apply:** https://nl.talent.com/redirect?id=607046751628693976&source=vacant&utm_medium=xml&utm_campaign=marketing&utm_product=vacantnew_bulk&oapply=org_v2026-09&puid=edaaaddgdda9addgbddc9ddaedd9addbadafbdda9dde9dd8bddaadd7bdadadd7cdd99ddabea3addffddgaed2dddgaddgfddgaddgaddg9ddg6ed3gc9bbb9b3bee3ee33def3de93de73deggdd9gdd8fddf3dea3deggddd3ee33de93deg3ee33ee33deg3ee33ee33ee33ee33ee33ee3&pos=1&xml_batch_generation_id=8cf4cdf1-4921-4331-8942-dd835bfc4582&falcon=1&pid=e8469f0ccbec&bpid=9a3f8503c4ef18e17d9dd4d6bbc472f6

## About the Role

* At least 10 years of experience in relevant or adjacent domains
 * Excellent communication skills
 * Working autonomously/independently
 * Thought leadership, * Experience setting up model evaluation sandboxes or test harnesses for AI/ML systems, ideally in medical imaging.
 * Ability to test and compare multiple CXR VLM/LLM variants across findings (e.g. pneumothorax, cardiomegaly, fractures) using consistent protocols.
 * AWS experience and familiarity with cloud based dev environment.
 * Familiarity with report-level evaluation, discrepancy analysis, and structured comparison between AI-generated outputs and clinician-validated references.
 * Comfortable working at the intersection of engineering, clinical logic, and governance, feeding findings into monitoring, change management, and validation processes.
 * Senior judgement to distinguish exploratory testing from evidence that is eligible for regulated use.

## Description

This role focuses on independent evaluation and controlled experimentation, separate from core model development, to support evidence generation and safe iteration., Design, build, and operate a hybrid evaluation and test environment for CXR VLM/LLM models, enabling systematic testing of model functionality, edge cases, and performance across findings without interfering with the main development pipeline.