Senior hybrid evaluation / test environment lead (cxr vlm/llm)

This role focuses on independent evaluation and controlled experimentation, separate from core model development, to support evidence generation and safe iteration., Design, build, and operate a hybrid evaluation and test environment for CXR VLM/LLM models, enabling systematic testing of model functionality, edge cases, and performance across findings without interfering with the main development pipeline.

• At least 10 years of experience in relevant or adjacent domains
• Excellent communication skills
• Working autonomously/independently
• Thought leadership, * Experience setting up model evaluation sandboxes or test harnesses for AI/ML systems, ideally in medical imaging.
• Ability to test and compare multiple CXR VLM/LLM variants across findings (e.g. pneumothorax, cardiomegaly, fractures) using consistent protocols.
• AWS experience and familiarity with cloud based dev environment.
• Familiarity with report-level evaluation, discrepancy analysis, and structured comparison between AI-generated outputs and clinician-validated references.
• Comfortable working at the intersection of engineering, clinical logic, and governance, feeding findings into monitoring, change management, and validation processes.
• Senior judgement to distinguish exploratory testing from evidence that is eligible for regulated use.