Staff ML Platform Engineer

Datavant
Austin, TX, United States
1 day ago
Apply on dejobs.org
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Compensation
$224,000.0 - $280,000.0
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) Artificial Intelligence Amazon Web Services Computer Vision Big Data Continuous Integration Cursor (Graphical User Interface Elements) Github Identity and Access Management Java Virtual Machine (JVM) Python (Programming Language) Machine Learning
+15 more
Open Source Technology Tensorflow Azure Machine Learning Software Engineering Pytorch Large Language Models Snowflake Apache Spark Caching Kubernetes Low Latency Apache Kafka Machine Learning Operations Terraform Databricks

Job description

  • Set technical direction across ML training, serving, and observability, and be the final escalation point for the most elusive infrastructure problems (GPU capacity, Spark tuning, production incidents)
  • Own and evolve our paved-road framework (the shared CI/CD spine, model-workflow scaffolding, and Databricks Asset Bundles) so Data Science teams can go from a config file to a production workflow without bespoke plumbing
  • Lead architecture for LLM-endpoint serving across managed providers (Databricks, AWS, Snowflake) and self-hosted deployments, covering latency, cost, caching, evaluation, and PHI-safe routing
  • Own the standards and tooling for MLflow, model registry, training image supply chain, and observability across training and inference
  • Partner closely with your Data & ML Platform teammates to present a cohesive ML platform to the Data Science, App Dev, and Operations teams at Datavant
  • Serve as a key technical input to vendor and platform selection decisions across model providers, ML tooling, and observability
  • Mentor senior engineers on the team, provide technical guidance to platform consumers, and stay hands-on writing high-leverage code and Infrastructure-as-Code alongside your teammates

Requirements

  • 10+ years of software engineering experience, with 3+ years designing, evolving, and operating enterprise-scale ML platforms in production
  • Strong technical judgment under ambiguity and a track record of setting standards, influencing peers, and raising the bar across teams
  • Hands-on production experience with Databricks and/or Amazon SageMaker, MLflow (or an equivalent tracking + registry system), and at least one core ML framework (PyTorch, TensorFlow, or similar)
  • Fluency in Java (or a JVM equivalent) and Python, with real depth in Apache Spark for large-scale data and distributed compute
  • Real depth in AWS: networking, IAM, GPU compute, and the storage and messaging services this role touches, with the judgment to know what to reach for and when
  • Fluency with Terraform, containers, Kubernetes, and GitHub-based CI/CD for ML workloads
  • Direct experience serving LLMs in production, including cost management, evaluation harnesses, and safe handling of sensitive prompts and outputs
  • AI-native working style: daily use of Claude Code, Cursor, Copilot, or equivalent, with views on how they make a team faster
  • Clear written and verbal communication, especially in async, remote settings

What Helps You Stand Out

  • Prior technical leadership on a healthcare or regulated-industry ML platform (HIPAA, HITRUST, SOC 2, or equivalent)
  • Direct experience with Databricks Asset Bundles, Unity Catalog, and open table formats (Iceberg, Delta)
  • Production experience with specialized inference pipelines beyond generic model serving (e.g., document understanding, computer vision, or streaming inference)
  • GPU capacity planning at strategic, tactical, and operational horizons
  • Experience with real-time and event-driven inference and streaming platforms (Kafka, Kinesis)
  • Evaluation and red-teaming experience for clinical or safety-sensitive AI
  • Background contributing to open-source ML infrastructure or publishing on production ML systems

Benefits & conditions

We are committed to building a diverse team of Datavanters who are all responsible for stewarding a high-performance culture in which all Datavanters belong and thrive. We are proud to be an Equal Employment Opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, sex, sexual orientation, gender identity, religion, national origin, disability, veteran status, or other legally protected status.

At Datavant our total rewards strategy powers a high-growth, high-performance, health technology company that rewards our employees for transforming health care through creating industry-defining data logistics products and services.

The range posted is for a given job title, which can include multiple levels. Individual rates for the same job title may differ based on their level, responsibilities, skills, and experience for a specific job.

The estimated total cash compensation range for this role is:

$224,000-$280,000 USD

To ensure the safety of patients and staff, many of our clients require post-offer health screenings and proof and/or completion of various vaccinations such as the flu shot, Tdap, COVID-19, etc. Any requests to be exempted from these requirements will be reviewed by Datavant Human Resources and determined on a case-by-case basis. Depending on the state in which you will be working, exemptions may be available on the basis of disability, medical contraindications to the vaccine or any of its components, pregnancy or pregnancy-related medical conditions, and/or religion.

About the company

Datavant is the data collaboration platform trusted for healthcare. Guided by our mission to make the world’s health data secure, accessible and actionable, we provide critical data solutions for organizations across the healthcare ecosystem - including providers, health plans, researchers, and life sciences companies. From fulfilling a single patient’s request for their medical records to powering the AI revolution in healthcare, Datavanters are building the future of how data is connected and used to improve health.

By joining Datavant today, you’re stepping onto a driven and highly collaborative team that is passionate about creating transformative change in healthcare., Datavant is committed to a work environment free from job discrimination. We are proud to be an Equal Employment Opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, sex, sexual orientation, gender identity, religion, national origin, disability, veteran status, or other legally protected status. To learn more about our commitment, please review our EEO Commitment Statement here (https://www.datavant.com/eeo-commitment-statement) . Know Your Rights (https://www.eeoc.gov/know-your-rights-workplace-discrimination-illegal) , explore the resources available through the EEOC for more information regarding your legal rights and protections. In addition, Datavant does not and will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dejobs.org
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters · World Congress 2023

3:15 min

Reversing the caching model for artifact delivery

Thijs Feryn Thijs Feryn · World Congress 2026 Europe

2:35 min

Preventing remote code execution in PyTorch models

Balázs Kiss · World Congress 2023

3:23 min

Exploring specialized career paths within the data science ecosystem

Julian Joseph · LIVE

2:40 min

Using GitHub primitives for internal documentation and corporate operations

Kyle Daigle · Coffee With Developers

Videos

See all

Related articles

See all