> Markdown version of [/jobs/ext/1338081-ml-applied-scientist](https://www.wearedevelopers.com/jobs/ext/1338081-ml-applied-scientist). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # ML Applied Scientist - **Company:** Ririo.Com, Inc. - **Location:** United States (Remote available) - **Experience:** Experienced - **Contract:** Permanent contract - **Skills:** Data Analysis, Cloud Computing, Continuous Integration, Distributed Systems, Python (Programming Language), Machine Learning, Language Modeling, Natural Language Processing, Tensorflow, Azure Machine Learning, Software Safety, Service-Oriented Architecture, Automated Data Processing (ADP), Pytorch, Transfer Learning, Prompt Engineering, Apache Spark, Information Technology, HuggingFace, Machine Learning Operations, Data Generation - **Published:** July 18, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=c8a985811d281506 ## About the Role We are seeking an experienced ML Engineer to join our team to build and scale automated evaluation and synthetic data generation (SDG) capabilities that support safety assessments across languages and markets. You will play a crucial role in training automated judges, developing validation techniques, building automated performance checks, and creating scalable approaches to analysis and reporting. An ideal candidate possesses strong machine learning engineering skills, experience building evaluation and data generation pipelines, and the ability to iteratively and collaboratively with subject matter experts. You will be part of a team who works closely with language experts and multi-lingual annotators to validate automated approaches to safety evaluations, across diverse linguistic contexts., 3+ years of experience in an ML engineering or applied ML research role, with hands-on experience building and deploying ML models and pipelines. * Strong proficiency in Python and ML frameworks (e.g., PyTorch, TensorFlow, Hugging Face Transformers). * Experience training, fine-tuning, and evaluating language models and/or classifiers, including prompt engineering and model calibration. * Experience building automated data processing, evaluation, or monitoring pipelines. * Comfortable with experiment design and statistical validation of model performance across segmented samples. * Able to work independently as well as collaboratively with minimal direction. * Organized, highly attentive to detail, and manages time well. * Experience with synthetic data generation techniques, including data augmentation, paraphrasing, and controlled generation methods. * Experience with multilingual NLP, cross-lingual transfer learning, or low-resource language modeling. * Familiarity with evaluation-as-a-service architectures or automated red teaming frameworks. * Experience with large-scale distributed computing (e.g., Spark, Ray, or cloud-based ML platforms). * Prior experience in AI safety, responsible AI, content moderation, or trust and safety domains * Experience with CI/CD integration for ML model validation and deployment. * Advanced degree (MS/PhD) in Computer Science, Machine Learning, Natural Language Processing, or a related field. ## Description Automated Judge Development: Train, fine-tune, and validate automated judge models that can reliably score AI system outputs for safety and policy compliance. Develop calibration and agreement metrics to ensure judges meet human-parity benchmarks. * Validation Techniques: Design and implement validation frameworks to assess the accuracy, reliability, and cross-linguistic consistency of automated evaluation systems. Develop methods to detect drift, bias, and failure modes in automated judges across markets. * Synthetic Data Generation: Develop and maintain synthetic data generation pipelines to augment evaluation coverage, stress-test safety boundaries, and support evaluation in low-resource languages. Ensure synthetic data is diverse, representative, and validated against human-generated benchmarks. * Scalable Analysis & Reporting Automation: Create automated pipelines for analysis and reporting that reduce manual effort, increase reproducibility, and enable rapid cross-market safety assessments. Build tooling that integrates with existing dashboards and reporting workflows. ## Related Videos - [How AI Models Get Smarter](https://www.wearedevelopers.com/videos/1374-how-ai-models-get-smarter) - [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding) - [Machine learning in the browser with TensorFlowjs](https://www.wearedevelopers.com/videos/155-machine-learning-in-the-browser-with-tensorflowjs) - [How E.On productionizes its AI model & Implementation of Secure Generative AI.](https://www.wearedevelopers.com/videos/623-how-e-on-productionizes-its-ai-model-implementation-of-secure-generative-ai) - [Serverless deployment of (large) NLP models ](https://www.wearedevelopers.com/videos/158-serverless-deployment-of-large-nlp-models) - [Overview of Machine Learning in Python](https://www.wearedevelopers.com/videos/840-overview-of-machine-learning-in-python) ## Related Articles - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production](https://www.wearedevelopers.com/magazine/115-mlops-deploying-maintaining-and-evolving-machine-learning-models-in-production)