> Markdown version of [/jobs/ext/2217878-ai-ml-engineer-llms](https://www.wearedevelopers.com/jobs/ext/2217878-ai-ml-engineer-llms). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# AI / ML Engineer (LLMs)

- **Company:** EvolutionIQ
- **Location:** New York, NY, United States (Remote available)
- **Experience:** Expert
- **Salary:** $200,000.0 - $235,000.0
- **Contract:** Permanent contract
- **Skills:** Clean Code Principles, Training Data, Artificial Intelligence, Python (Programming Language), Machine Learning, Search Technologies, Software Deployment, Web Services, Large Language Models, Prompt Engineering, Production Code, Machine Learning Operations, Microservices
- **Published:** August 25, 2026
- **Apply:** https://job-boards.greenhouse.io/evolutioniq/jobs/6161432004

## About the Role

* 5-8+ years of experience writing performant Python code following modern best practices
 * Minimum 1 year of experience building and deploying products powered by large language models (LLMs) in fast-paced, professional environments
 * Proven experience leading technical projects and driving them from concept through production deployment
 * Experience making architectural decisions for AI/ML systems and evaluating technical tradeoffs across scalability, reliability, performance, and maintainability
 * Hands-on experience with statistical machine learning techniques as well as hybrid approaches combining LLMs, retrieval-augmented generation (RAG), and embeddings-based models, including vector search and similarity measures
 * Proven ability to build and integrate API services within service-oriented or microservice architectures
 * Strong skills in evaluating and interpreting LLM outputs and AI model predictions, with a focus on aligning model behavior with real-world business and user outcomes
 * Expertise in prompt engineering and fine-tuning of large language models for domain-specific applications
 * Strong communication and collaboration skills, with the ability to influence technical direction and work effectively with Product, Engineering, SMEs, and other stakeholders

Bonus Points:

 * Experience translating state-of-the-art AI/ML research into production code
 * Comfortable collaborating with data labelers and subject matter experts to improve training data and evaluation processes
 * Experience building agentic or autonomous AI systems in production
 * Background working with multimodal data (e.g., images, audio)
 * Experience mentoring engineers or providing technical leadership across projects or teams

## Description

About You: As an ambitious AI / ML Engineer, you will play a key role in advancing our industry-leading medical synthesis product. You take strong ownership of your work and have a proven track record of leading projects end-to-end, from ideation and requirements gathering through architecture, implementation, deployment, and iteration. You are comfortable operating with a high degree of autonomy, making thoughtful architectural and technical decisions, and helping guide the direction of AI/ML solutions across the product. Thriving in a fast-paced startup environment, you stay current with the latest AI and machine learning research. You're passionate about applying hybrid approaches that combine large language models (LLMs), statistical machine learning techniques, and retrieval-augmented generation (RAG) with embeddings-based models to deliver better, more reliable outcomes for our users.

In this Role You Will:

 * Lead AI/ML projects end-to-end, taking ownership from initial ideation and requirements gathering through architecture, development, deployment, and ongoing optimization
 * Make high-level architectural and technical decisions for AI/ML systems, balancing scalability, performance, reliability, maintainability, and business impact
 * Design, build, and deploy AI-powered and LLM-driven features for our claim synthesis product, including robust extraction of key information from complex medical documents and human-in-the-loop summarization workflows
 * Develop and implement hybrid machine learning solutions that leverage statistical models, LLMs, and embeddings-based retrieval techniques such as RAG to improve system accuracy, scalability, and robustness
 * Write clean, scalable, and efficient code while optimizing the performance of existing AI/ML systems in production
 * Collaborate closely with data labelers and subject matter experts (SMEs) to rigorously evaluate AI system outputs and continuously improve model performance
 * Partner closely with Product, Engineering, and other cross-functional teams to gather requirements, define technical approaches, prioritize work, and rapidly iterate on feedback
 * Provide technical leadership and guidance to other engineers, helping establish best practices and driving consistency across AI/ML solutions
 * Break down complex, ambiguous problems into well-defined technical solutions and drive projects forward while balancing short-term delivery with long-term architectural considerations
 * Translate cutting-edge AI/ML research and novel techniques into production-grade, reliable, and maintainable solutions that operate seamlessly in live customer environments


## Related Videos

- [Developer Time Is Valuable - Use the Right Tools - Kilian Valkhof](https://www.wearedevelopers.com/videos/1792-developer-time-is-valuable-use-the-right-tools-kilian-valkhof)
- [Fireside Chat: Deep Learning, Deep Impact: Harnessing AI for Language Innovation](https://www.wearedevelopers.com/videos/612-fireside-chat-deep-learning-deep-impact-harnessing-ai-for-language-innovation)
- [Microservices: how to get started with Spring Boot and Kubernetes](https://www.wearedevelopers.com/videos/242-microservices-how-to-get-started-with-spring-boot-and-kubernetes)
- [How to Avoid LLM Pitfalls - Mete Atamel and Guillaume Laforge](https://www.wearedevelopers.com/videos/1328-how-to-avoid-llm-pitfalls-mete-atamel-and-guillaume-laforge)
- [Rust Beyond Systems: Revolutionizing Web Development](https://www.wearedevelopers.com/videos/1111-rust-beyond-systems-revolutionizing-web-development)
- [LLMs in the wild: Building an AI agent that survives production](https://www.wearedevelopers.com/videos/100319-llms-in-the-wild-building-an-ai-agent-that-survives-production)

## Related Articles

- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it)
- [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)