Engineering Manager, AI Platform

REAL DEAL, LLC
New York, NY, United States
3 days ago
Apply on www.themuse.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
$204,000.0 - $306,000.0
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Java GUIs Large Language Models AI Platforms Build Process Data Pipelines Automation Anywhere

Job description

As the manager and team lead of the new AI Tooling and Ecosystem Team, you will lead the development of the suite of tools and services that power Duolingo’s use of AI in the product. You and your team will design systems for managing datasets, evaluating the performance of AI models, and building AI workflows. You will help shape how Duolingo builds features using AI, enabling teams to easily define quality metrics, combine human and AI feedback, and compare model performance. We’re looking for an engineering manager who has experience building AI products or infrastructure and is excited to play a central role in shaping the future of AI at Duolingo!

You will…

  • Drive development of tools and services that empower Duolingo’s product teams to easily and effectively build AI-powered features and workflows.
  • Manage our shared systems and workflows for AI-related datasets, prompts, and evaluations (both human and LLM-as-a-judge).
  • Build processes that allow teams to define success criteria for their AI use-case, identify the most appropriate models, and construct feedback loops for prompt optimization.
  • Streamline common AI development flows so that teams with varying levels of AI expertise can build out AI systems quickly.
  • Collaborate closely with the AI Core Infrastructure Team to ensure that AI workflows are reliable, measurable, and cost efficient.
  • Partner with AI, Product, Data Science, and Platform leaders to build out new AI tooling that supports common use-cases.
  • Own multi-quarter roadmaps and cross-functional alignment that increase AI feature velocity and measurable product impact across Duolingo.

Requirements

  • Experience leading, managing, and building a team of software and/or AI engineers, with demonstrated ability to hire, develop, and retain talent.
  • A track record of building AI-related infrastructure or user-facing products powered by AI.
  • Familiarity with AI evaluation methods, especially approaches that combine human and LLM-as-a-judge evaluations.
  • Strong cross-functional leadership and communication skills; proven ability to align AI, product, data science, and platform partners on strategy and execution.
  • Comfort leading through ambiguity and shaping new ways of working in a fast-evolving AI landscape.
  • The ability to work from or relocate to Pittsburgh, PA or New York, NY.

Exceptional candidates will have…

  • Hands-on experience building evaluation systems and human-in-the-loop data pipelines at scale.
  • A track record of developing internal tools on a platform or infrastructure team, providing tools and services via easy-to-use APIs, MCPs, and web GUIs.
  • Experience navigating build vs. buy decisions and shaping long-term roadmaps based on the needs of internal customers.

Benefits & conditions

The offered salary is dependent upon several factors, including work experience, skills, and internal peer comparisons. The posted range is subject to change in the future. For this role, base salary is supplemented by equity compensation. We encourage you to talk with your recruiter for more information related to compensation for this role! Salary Range: $204,000-$306,000 USD

Benefits: Take a peek at how we care for our employees’ holistic well-being with our benefits here.

About the company

Our mission at Duolingo is to develop the best education in the world and make it universally available. It’s a big mission, and that’s where you come in!

At Duolingo, you’ll join a team that cares about finding innovative solutions to complex technical problems, running countless experiments (300+ at a time!) with our massive user base to make data-driven decisions, and educating our users and employees alike. You’ll have limitless learning opportunities, mentorship and collaboration with world-class minds, and a variety of projects with large scopes - while doing work that’s both fun and meaningful.

Join our life-changing mission to develop education for our half a billion (and growing!) learners around the world.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.themuse.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:59 min

Generating a Swagger JSON file during the build process

Roman Alexis Anastasini · World Congress 2021

5:02 min

Developing terminal user interfaces natively within Java scripts

Jens Knipper Jens Knipper · Europe 2026 Virtual

2:36 min

Choosing between managed AI platforms and custom governance

Péter Farkas Péter Farkas · Europe 2026 Virtual

2:14 min

Exploring internal AI product initiatives and global engineering roles

Maria Apazoglou · Coffee With Developers

1:48 min

Optimizing container images using multi-step build processes

Adrian Kosmaczewski · LIVE

Videos

See all

Related articles

See all