Senior AI / ML Engineer (LLMs)

The Ladders
United States
1 day ago
Apply on arc.dev
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
1 year minimum
Compensation
$200,000.0 - $235,000.0
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Python (Programming Language) Machine Learning Software Deployment Retrieval-Augmented Generation Large Language Models Prompt Engineering Machine Learning Operations

Job description

This role will focus on building and optimizing AI capabilities that support document understanding, summarization, and decision-making workflows. You will lead technical efforts from concept through production, partnering closely with data labelers, subject matter experts, and cross-functional stakeholders to deliver scalable, reliable solutions. The work will combine modern Python engineering, LLMs, retrieval-augmented generation, and statistical modeling to improve model quality and business outcomes., * Lead AI/ML projects from ideation to ongoing optimization.

  • Make high-level architectural decisions balancing system scalability and business impact.
  • Design and deploy AI features for medical document synthesis and summarization.
  • Develop hybrid machine learning solutions to enhance accuracy and scalability.
  • Write efficient, scalable code while optimizing existing systems in production.
  • Collaborate with data labelers and subject matter experts to improve AI model outputs.
  • Partner with cross-functional teams to define requirements and iterate on feedback.

Requirements

  • 5-8+ years of experience writing performant Python code following modern best practices.
  • Minimum 1 year of experience building and deploying products powered by large language models (LLMs) in fast-paced environments.
  • Proven experience leading technical projects from concept through production deployment.
  • Experience making architectural decisions for AI/ML systems with a focus on scalability and reliability.
  • Hands-on experience with hybrid approaches that combine LLMs, RAG, and statistical models.
  • Strong skills in evaluating and interpreting LLM outputs to align with business outcomes.
  • Expertise in prompt engineering for domain-specific applications.

Benefits & conditions

  • Medical, dental, vision, short- and long-term disability, life insurance, and 401(k) matching
  • 100% paid parental leave and flexible schedules for new parents
  • Catered lunches, happy hours, and pet-friendly office spaces
  • $1,000/year for professional development and tuition reimbursement opportunities
  • Visa transfer sponsorship available for applicable candidates

Our client is an equal opportunity employer. We encourage you to apply even if you don’t meet every qualification-your background could be exactly what this team needs.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on arc.dev
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:36 min

Applying supervised machine learning for practical rule extraction

Katja Träumner

1:46 min

Refining complex software instructions using automated prompt engineers

Markus Walker Markus Walker · World Congress 2023

4:37 min

Achieving boring and safe software deployments

Marcel Cremer Marcel Cremer · Europe 2026 Virtual

5:30 min

Building components of a real-world LLM lifecycle

Maxim Salnikov Maxim Salnikov · LIVE

1:57 min

Evolution of machine learning algorithms and computing hardware

Alexandra Waldherr · LIVE

2:21 min

Transitioning from AI co-pilots to AI-native products

Jordan Tigani Jordan Tigani · World Congress 2026 Europe

Videos

See all

Related articles

See all