Machine Learning Platform Engineer

Charlie Health
New York, NY, United States
10 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Compensation
$170,000.0 - $220,000.0
Working hours
Regular working hours

Tech stack

Artificial Intelligence Amazon Web Services Data Analysis Systems Engineering C++ (Programming Language) Clinical Data Repository Cloud Computing Continuous Delivery Continuous Integration Software Debugging Decision Support Systems Programming Tools
+21 more
Python (Programming Language) Machine Learning Recommender Systems Azure Machine Learning Software Engineering AI Infrastructure Datadog Pulumi Scripting Graphics Processing Unit (GPU) Google Cloud System Availability Delivery Pipeline Large Language Models Kubernetes Low Latency Data Management Machine Learning Operations Virtual Agents Terraform Data Pipelines

Job description

Charlie Health leads the nation in high-acuity virtual behavioral care, having delivered life-saving treatment to more than 100,000 clients nationwide. Our ML and AI capabilities are expanding rapidly-powering recommendation systems, clinical decision support, agentic AI products, and developer tooling-and the infrastructure underneath needs to scale with them.

As our first dedicated ML Platform Engineer, you’ll define the technical direction and build the foundational systems that our data scientists, ML engineers, and product teams depend on to ship AI-powered features reliably and at scale. We have several models in production today and are investing in hosted GPU inference to support the next generation of our AI capabilities. You’ll inherit and evolve existing infrastructure while building new platform capabilities-from multi-tenant model serving and GPU inference pipelines to multimodal data management, evaluation frameworks, observability, and infrastructure as code. You’ll own the platform layer that makes ML/AI development at Charlie Health fast, safe, and repeatable as the team grows. If you care about building the systems that let others build great things, this team is for you.

Responsibilities

Infrastructure & Serving

  • Define technical direction for ML/AI infrastructure and make build-vs-buy decisions as the founding platform engineer
  • Design and operate multi-vendor AI infrastructure supporting client-facing and clinician-facing LLM applications across multiple LLM providers
  • Design, build, and operate production model serving systems; maintain infrastructure as code for reproducible ML environments, training pipelines, and deployment workflows
  • Develop high-performance GPU inference pipelines with low latency and high availability
  • Own the multimodal data pipeline layer-manage ingestion, processing, and serving of text, audio, and structured clinical data for ML and AI systems

AI Systems & Tooling

  • Create reliable infrastructure for agentic AI systems, including orchestration, monitoring, evaluation, and observability tooling
  • Build developer tooling that accelerates data science and ML engineering workflows across the organization

Observability & Operations

  • Own AI observability-build monitoring, alerting, and debugging capabilities for production ML systems
  • Partner with ML engineers, data scientists, and product teams to understand infrastructure needs and translate them into scalable platform capabilities
  • Foster a culture of collaboration and learning across engineering, product, and design through mentoring, documentation, presentations, and knowledge sharing
  • Participate in our on-call rotation to ensure model serving uptime, pipeline reliability, and infrastructure health, This role requires 4 days per week in our NYC office (Flatiron District). The team is entirely based out of NYC.

Requirements

  • 4+ years of professional experience in software engineering, with at least 2 years focused on ML infrastructure, ML platform, or AI systems engineering
  • Strong software engineering fundamentals in Python and deep infrastructure expertise
  • Familiarity with cloud ML services (AWS SageMaker, GCP Vertex AI, or similar) and CI/CD for ML pipelines
  • Experience with infrastructure as code (Terraform, Pulumi, or similar) and container orchestration (Kubernetes, ECS)
  • Experience building evaluation and observability systems for LLM-based or agentic AI applications is a plus
  • Excellent at managing ambiguity-able to break down big, messy problems into smaller parts with tractable solutions and clear iterations
  • Growth mindset and sense of humor; you welcome feedback, adapt quickly in a fast-paced environment, and foster a culture of learning and fun
  • Experience with a systems language (Go, Rust, or C++) is a plus, Acute Care, Amazon Web Services (AWS), Artificial Intelligence (AI), Banking Services, Behavioral Health, C++ Programming Language, Clinical Data, Clinical Support, Cloud Computing, Community Support, Continuous Deployment/Delivery, Continuous Integration, Customer Support/Service, Data Analysis, Data Management, Data Science, Debugging Skills, Decision Support, Documentation, Eating Disorders, GCP (Good Clinical Practices), GPU (Graphics Processing Unit), High Availability, Machine Learning, Machine Tool, Mentoring, Needs Assessment, On Call, Onboarding, Process Improvement, Product Design, Production Systems, Programming Tools, Psychiatry and Mental Health, Python Programming/Scripting Language, Rotational Modeling, Rust Programming Language, Sales Pipeline, Software Engineering, Structured Data, Systems Engineering, Team Building, Team Lead/Manager

Benefits & conditions

Charlie Health is pleased to offer comprehensive benefits to all full-time, exempt employees. Read more about our benefits here.

The total target base compensation for this role will be between $170,000-$220,000 per year at the commencement of employment. Please note, pay will be determined on an individualized basis and will be impacted by location, experience, expertise, internal pay equity, and other relevant business considerations. Further, cash compensation is only part of the total compensation package, which, depending on the position, may include stock options and other Charlie Health-sponsored benefits.

Our Values

  • Connection: Care deeply & inspire hope.
  • Congruence: Stay curious & heed the evidence.
  • Commitment: Act with urgency & don’t give up.

About the company

Why Charlie Health?

Millions of people across the country are navigating mental health conditions, substance use disorders, and eating disorders, but too often, they’re met with barriers to care. From limited local options and long wait times to treatment that lacks personalization, behavioral healthcare can leave people feeling unseen and unsupported.

Charlie Health exists to change that. Our mission is to connect the world to life-saving behavioral health treatment. We deliver personalized, virtual care rooted in connection-between clients and clinicians, care teams, loved ones, and the communities that support them. By focusing on people with complex needs, we’re expanding access to meaningful care and driving better outcomes from the comfort of home.

As a rapidly growing organization, we’re reaching more communities every day and building a team that’s redefining what behavioral health treatment can look like. If you’re ready to use your skills to drive lasting change and help more people access the care they deserve, we’d love to meet you., Please be cautious of potential recruitment fraud. If you are interested in exploring opportunities at Charlie Health, please go directly to our Careers Page: https://www.charliehealth.com/careers/current-openings. Charlie Health will never ask you to pay a fee or download software as part of the interview process with our company. In addition, Charlie Health will not ask for your personal banking information until you have signed an offer of employment and completed onboarding paperwork that is provided by our People Operations team. All communications with Charlie Health Talent and People Operations professionals will only be sent from @charliehealth.com email addresses. Legitimate emails will never originate from gmail.com, yahoo.com, or other commercial email services.

Recruiting agencies, please do not submit unsolicited referrals for this or any open role. We have a roster of agencies with whom we partner, and we will not pay any fee associated with unsolicited referrals.

At Charlie Health, we value being an Equal Opportunity Employer. We strive to cultivate an environment where individuals can be their authentic selves. Being an Equal Opportunity Employer means every member of our team feels as though they are supported and belong. We value diverse perspectives to help us provide essential mental health and substance use disorder treatments to all young people.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

1:04 min

Introduction to Bitcoin script parsing tools

Steve Shadders · LIVE

5:34 min

Managing token budgets and enterprise usage of coding agents

Chris Heilmann +2 · LIVE

1:55 min

Contrasting Terraform with Pulumi and cloud-specific tools

Devlin Duldulao · LIVE

3:14 min

Structuring career paths and localized data architectures

Ulrich Wurstbauer +1 · LIVE

1:53 min

Evaluating traditional scripting languages for modern development tasks

Jens Knipper Jens Knipper · Europe 2026 Virtual

Videos

See all

Related articles

See all