> Markdown version of [/jobs/ext/2716216-fiddler-ai](https://www.wearedevelopers.com/jobs/ext/2716216-fiddler-ai). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Fiddler AI - **Company:** FIDLER AND FIDLER P.C. - **Location:** Seattle, WA, United States - **Experience:** Expert - **Salary:** $220,000.0 - $260,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Code Review, Customer Data Management, Data Validation, Fiddler (Software), Python (Programming Language), Machine Learning, Performance Tuning, Software Safety, Reinforcement Learning, Pytorch, Large Language Models, Backend, Information Technology, HuggingFace, Data Generation - **Published:** September 4, 2026 - **Apply:** https://startup.jobs/staff-ai-scientist-fiddler-ai-company-8117799 ## About the Role * 7+ years of applied AI experience, with a strong track record of taking models from research to production * Experience in LLM or Agentic Evals, Guardrailing * Deep expertise training and fine-tuning classifier models, including modern encoder architectures (BERT-family, ModernBERT, etc.) and LLM-as-classifier approaches; clear understanding of the tradeoffs between them * Hands-on experience with dataset development as a first-class engineering discipline: sourcing, labeling, synthetic generation, adversarial augmentation, and quality control * Strong applied experience with LLMs and agentic systems - prompting, fine-tuning, and evaluation * Proficiency in Python and the modern ML stack (PyTorch, Hugging Face, common training/serving frameworks) * Comfortable working in production environments and partnering with backend and platform engineers on real-time inference, monitoring, and rollout * Excited by the prospect of using AI coding tools in your own workflow to push the limits of what one engineer can ship - responsibly, with a clear eye on quality, security, and the failure modes these tools introduce * Excellent written and verbal communication; able to explain research tradeoffs to engineers, PMs, and customers * Ability to work in our Palo Alto office 2-3 days a week Even Better * M.S. or Ph.D. in Computer Science, Machine Learning, Statistics, Physics, or a related quantitative field * Published research at top ML or NLP venues (NeurIPS, ICML, ICLR, ACL, EMNLP, etc.) * Experience with reinforcement learning, RLHF, RLAIF, or preference-based fine-tuning * Experience with synthetic data generation pipelines at scale * Background in AI safety, red-teaming, or adversarial ML * Experience working with enterprise customers in regulated industries (finance, healthcare, government) ## Description * Partner closely with other engineering teams, Product, and Customer Success. You'll build strong relationships with customer data science and ML engineering teams, supporting their AI observability journey and ensuring they realize measurable value from Fiddler. * Design, train, and ship production classifiers for safety, security, and quality detection (e.g., prompt injection, jailbreaks, PII, hallucination, faithfulness) under strict latency and cost constraints. * Lead the development of synthetic and adversarial dataset pipelines, including novel methods for generating, filtering, and validating data that exposes failure modes our models need to learn. * Drive the technical direction of generative insights - the LLM- and agent-powered analysis layer that helps customers diagnose what's going wrong in their AI applications and why. * Contribute to the evaluation and experimentation infrastructure that lets the AI Science team and our customers reliably measure model quality, regression, and drift across rapidly evolving model populations. * Explore reinforcement learning and preference-based methods where they offer real leverage over supervised baselines. * Collaborate with Backend and Platform engineers to take research prototypes from notebook to a hardened, scaled, observable service. * Partner with Product, Solutions Engineering, and Customer Success to translate enterprise customer needs into research problems and translate research results back into product. * Mentor AI Scientists on the team, raise the technical bar through code review and design review, and represent Fiddler externally through publications, talks, or open-source contributions when appropriate. ## Related Videos - [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding) - [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock) - [Are Code Reviews Worth It? Insights from 16 Years of Review Data](https://www.wearedevelopers.com/videos/1135-are-code-reviews-worth-it-insights-from-16-years-of-review-data) - [You are not an AI developer](https://www.wearedevelopers.com/videos/1148-you-are-not-an-ai-developer) - [Serverless deployment of (large) NLP models ](https://www.wearedevelopers.com/videos/158-serverless-deployment-of-large-nlp-models) - [How AI Models Get Smarter](https://www.wearedevelopers.com/videos/1374-how-ai-models-get-smarter) ## Related Articles - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Dev Digest 137 - AI'm not sure about this](https://www.wearedevelopers.com/magazine/485-dev-digest-137-ai-m-not-sure-about-this) - [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix) - [How machine learning can help us tell fact from fiction](https://www.wearedevelopers.com/magazine/509-how-machine-learning-can-help-us-tell-fact-from-fiction)