> Markdown version of [/jobs/ext/2456755-founding-machine-learning-eval-layer](https://www.wearedevelopers.com/jobs/ext/2456755-founding-machine-learning-eval-layer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Founding Machine Learning - Eval Layer - **Company:** One Inc - **Location:** San Francisco, CA, United States - **Salary:** $150,000.0 - $275,000.0 - **Contract:** Permanent contract - **Skills:** Information Engineering, Python (Programming Language), Machine Learning, Pytorch, Large Language Models - **Published:** August 4, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=470111adc9515ca8 ## About the Role * Very strong coding in Python and PyTorch. * VLM/LLM training: Track record in training VLMs or LLMs. * Evals experience: Developed and shipped evals for VLMs or LLMs. ## Description * Train evaluation models: Develop VLMs that classify and verify policy behavior. * Build confidence layers: Convert model outputs into trustworthy signals the customer can act on. * Improve model grounding: Make the eval models reason accurately about physical and spatial scenes. * Build a self-improving eval layer: Develop data engine that makes the eval models sharper with each customer's deployments and corrections. ## Related Videos - [Introduction to Azure Machine Learning](https://www.wearedevelopers.com/videos/368-introduction-to-azure-machine-learning) - [Creating Industry ready solutions with LLM Models](https://www.wearedevelopers.com/videos/899-creating-industry-ready-solutions-with-llm-models) - [Evals vs. Evil - AI and Package Security - Laurie Voss](https://www.wearedevelopers.com/videos/2131-evals-vs-evil-ai-and-package-security-laurie-voss) - [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding) - [Getting Started with Machine Learning](https://www.wearedevelopers.com/videos/260-getting-started-with-machine-learning) - [Lies, Damned Lies and Large Language Models](https://www.wearedevelopers.com/videos/1231-lies-damned-lies-and-large-language-models) ## Related Articles - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production](https://www.wearedevelopers.com/magazine/115-mlops-deploying-maintaining-and-evolving-machine-learning-models-in-production) - [The Best Large Language Models on The Market](https://www.wearedevelopers.com/magazine/319-the-best-large-language-models-on-the-market) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it) - [How machine learning can help us tell fact from fiction](https://www.wearedevelopers.com/magazine/509-how-machine-learning-can-help-us-tell-fact-from-fiction)