> Markdown version of [/jobs/ext/629614-senior-ml-ai-engineer](https://www.wearedevelopers.com/jobs/ext/629614-senior-ml-ai-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior ML / AI Engineer - **Company:** Toloka LLC - **Location:** United States (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Artificial Intelligence, C++ (Programming Language), Python (Programming Language), Machine Learning, Open Source Technology, Software Engineering, Large Language Models, Model Validation, Reliability of Systems, Backend, Virtual Agents, Workday - **Published:** June 24, 2026 - **Apply:** https://arc.dev/remote-jobs/j/toloka-senior-ml-ai-engineer-ozcfa5wosm ## About the Role * Extensive background (5+ years) in software engineering, featuring advanced proficiency in Python programming; * Proven track record of at least 2 years building and launching autonomous AI agents; * Deep enthusiasm for artificial intelligence and a drive to apply disciplined engineering standards to machine learning; * Competency in architecting high-scale backend systems and refining software delivery workflows; * Fluency in English at a B2 level or above. Nice to have * Hands-on experience utilizing Java or C++; * Strong foundation in machine learning acquired through rigorous academic research or substantial industry practice; * Demonstrated success in deploying sophisticated LLM-based applications within production environments; * Practical knowledge of orchestration technologies and diverse agentic development frameworks. ## Description * LLM QA - the core technology behind Toloka's automated quality-check mechanism. Every annotation flowing through Self-Service is reviewed by an LLM agent we design, train, and operate. * Model distillation and fine-tuning - adapting frontier and open-source models to Toloka's tasks to hit the right quality at the right cost. * Evaluation, benchmarking, cost modeling, and model selection across providers. We own the full chain. The same team designs the ML solution, ships it to production, keeps it running 24/7, analyzes the results coming back from real projects, and feeds that signal into the next iteration. No hand-off between research, engineering, and operations - it's all us. About the Position As a Senior Software Engineer, you will develop core product functionality, improving AI agent capabilities, and bringing new AI features to production. You will work closely with the ML team to extend agent infrastructure, evolve hybrid human-expert workflows, and design robust observability metrics to ensure top-tier system reliability. What you'll do - Extend the agent's capabilities and add new product features to improve user experience - from clarifying task requirements to working with final results. - Improve collaboration between the agent and human experts, evolving hybrid workflows and balancing quality and speed. - Contribute to our agent infrastructure: tools, environments, internal knowledge, and third-party integrations. - Design and implement observability metrics for agent quality and overall system reliability. - Develop and maintain production services in Python, * Personal and career development: we support employee's ambition for professional development and encourage them to implement their ideas in their projects * Flexibility: we offer a remote or hybrid employment. You will also design with your manager a workday that works best for you * Paid parental leave and sick leave * Medical insurance fully covered for the employee + 80% of coverage for family members * Meal allowance, transportation expenses reimbursement * 25 vacation days per year * Tax and migration support if necessary ## Related Videos - [Agentic AI Systems for Critical Workloads](https://www.wearedevelopers.com/videos/1592-agentic-ai-systems-for-critical-workloads) - [Guiding Agentic AI with Vue](https://www.wearedevelopers.com/videos/2033-guiding-agentic-ai-with-vue) - [Destigmatizing the Workplace: Building Real Inclusion](https://www.wearedevelopers.com/videos/1492-destigmatizing-the-workplace-building-real-inclusion) - [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock) - [How to Stop Your Agents From Going Rogue - Arnav Gupta](https://www.wearedevelopers.com/videos/2152-how-to-stop-your-agents-from-going-rogue-arnav-gupta) - [WeAreDevelopers LIVE - How DevRel Makes Tech More Human](https://www.wearedevelopers.com/videos/2149-wearedevelopers-live-how-devrel-makes-tech-more-human) ## Related Articles - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [6 Reasons to Use Java For Your Next AI Project](https://www.wearedevelopers.com/magazine/111-6-reasons-to-use-java-for-your-next-ai-project)