> Markdown version of [/jobs/ext/3997717-data-scientist-applied-ai](https://www.wearedevelopers.com/jobs/ext/3997717-data-scientist-applied-ai). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Scientist, Applied AI

- **Company:** Definitive Healthcare, LLC
- **Location:** Boston, MA, United States (Remote available)
- **Experience:** Experienced
- **Salary:** $111,000.0 - $167,000.0
- **Contract:** Permanent contract
- **Skills:** LangGraph Framework, Artificial Intelligence, Data Analysis, Cloud Database, Collaborative Software, Distributed Computing Environment, Python (Programming Language), Machine Learning, Azure Machine Learning, Search Technologies, Software Deployment, Retrieval-Augmented Generation, Large Language Models, Grafana, Software Application Programming, Agentic-AI, Git, PydanticAI Framework, Automation Anywhere, Databricks
- **Published:** October 28, 2026
- **Apply:** https://www.thejobnetwork.com/job/aa930c49-ce68-4745-9da2-546ac82b9299/data-scientist-applied-ai

## About the Role

* Bachelor's degree in a quantitative or technical field.
 * 3+ years of experience in data science, machine learning, applied AI, or a related field.
 * Hands-on experience developing applications with LLMs and evaluating their outputs.

Technical and professional skills

 * Strong Python, data analysis, and problem-solving skills.
 * Understanding of embeddings, semantic search, retrieval, RAG and evaluation metrics.
 * Experience with an agent framework such as PydanticAI, LangGraph, or a similar tool.
 * Ability to design useful test cases, interpret evaluation results, and identify limitations.
 * Familiarity with cloud data or ML platforms, Git, testing, and collaborative software development.
 * Clear communication with technical and nontechnical colleagues.
 * Experience with Databricks, evaluation platforms, production deployment, fine-tuning, distributed processing, or healthcare data is beneficial but not required.

Autonomy, decisions, and scope

 * This is an individual contributor role with no people-management responsibilities.
 * Works independently on defined analyses and implementation tasks, with guidance on project priorities and broader technical direction.

## Description

This role supports the team's work on practical generative AI applications. The Data Scientist implements and tests LLM, RAG, and agent-based workflows for assigned use cases under the direction of senior team members, producing evidence that informs team decisions about which approaches to use., * Develop AI workflows: Build and test LLM, RAG, and tool-using agent workflows for assigned use cases.

 * Evaluate approaches: Compare LLMs, embedding models, and retrieval methods against quality, reliability, latency, and cost, using evaluation criteria and methods set by senior team members.
 * Maintain evaluation assets: Create and update representative test cases, benchmark datasets, and regression checks; report results and limitations.
 * Improve retrieval quality: Develop and tune RAG pipelines, including embeddings, retrieval, reranking, and grounding, based on evaluation results.
 * Investigate failures: Review incorrect answers, retrieval misses, and workflow failures; implement and measure improvements.
 * Support production workflows: Use experimentation, tracing, and observability tools to help monitor systems and investigate performance changes.
 * Collaborate on delivery: Work with engineering, product, and domain partners to clarify requirements, communicate findings, and deliver practical AI solutions., * Makes day-to-day decisions about experiments, test cases, and implementation details within agreed project goals.
 * Recommends model and retrieval improvements based on results; escalates major architecture changes, sensitive-data concerns, significant cost implications, and production release decisions to senior team members or the appropriate owners.
 * Influences assigned projects through implementation and evidence, rather than owning the evaluation strategy or technical direction across multiple projects.