> Markdown version of [/jobs/ext/1917603-software-engineer-ml-infrastructure](https://www.wearedevelopers.com/jobs/ext/1917603-software-engineer-ml-infrastructure). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Software Engineer - ML Infrastructure - **Company:** Epsilon, Inc. - **Location:** San Francisco, CA, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** A/B Testing, Airflow, Amazon Web Services, BigQuery, Cloud Computing, Information Engineering, Extract Transform Load (ETL), Data Systems, Dicom, Distributed Computing Environment, Distributed Systems, Python (Programming Language), Language Modeling, Software Deployment, Reinforcement Learning, Pytorch, Snowflake, Apache Spark, Backend, Containerization, Kubernetes, Production Code, Health Level Seven International, Machine Learning Operations, TensorRT, Data Pipelines, Docker, Databricks - **Published:** August 4, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=e5b12d9efc6c6a98 ## About the Role * 5+ years building ML infrastructure, data pipelines, or ML systems in production * Strong Python skills and expertise in PyTorch or JAX * Experience with distributed training at scale (FSDP, DeepSpeed, or Megatron-style parallelism) and the systems concerns of keeping large GPU jobs efficient * Hands-on experience with data pipeline technologies (e.g., Spark, Airflow, BigQuery, Snowflake, Databricks, Chalk) and schema design * Experience with distributed systems, cloud infrastructure (AWS/GCP), and containerization (Docker/Kubernetes) * Track record of building scalable data systems and shipping production ML infrastructure * Ability to move quickly and handle competing priorities in a fast-paced environment, * Experience building reinforcement learning training infrastructure: rollout generation, reward-model serving, or online/off-policy learning systems * Experience with high-performance inference and serving (vLLM, SGLang, TensorRT, or Triton) for both training-time rollouts and production * Experience building internal training or experimentation platforms used by research teams * Experience supporting A/B testing and experimentation workflows, including canary deployments and monitoring statistical significance * Familiarity with vision-language models (VLMs) or multimodal architectures * Experience with medical imaging formats (DICOM) and healthcare data standards * Familiarity with MLOps practices and model deployment pipelines * Experience with privacy-preserving data systems and HIPAA compliance ## Description We're seeking a Software Engineer to build the ML infrastructure and data systems that let our research team train and ship state-of-the-art models for medical imaging. Sitting in the Engineering team and working closely with research, you'll own the data pipelines that unify live production traffic with offline datasets, the distributed training and reinforcement learning infrastructure our foundation-model and post-training work runs on, and the inference and evaluation systems that carry models from experimentation into production. This role requires someone who can move fluidly between ML systems, data engineering, distributed training, and production deployment, and who measures success by how quickly the research team can iterate., * Build and optimize distributed training infrastructure for foundation models on large-scale medical imaging, including the long-context parallelism and checkpointing that volumetric CT/MR training demands. * Build the reinforcement learning training stack (high-throughput rollout generation, reward-model serving, and experience collection), enabling the research team to run online, multi-reward RL at scale. * Build high-throughput data loading and preprocessing that keeps GPUs saturated on large volumetric and multimodal datasets. * Design and implement robust data pipelines to collect, process, and store large-scale multimodal medical imaging data from both production traffic and offline sources. * Build centralized data storage solutions with standardized formats (e.g., protobufs) that enable efficient retrieval and training across the organization. * Partner with researchers to prototype new ideas and translate them into production-ready code, owning end-to-end delivery from experimentation through deployment and monitoring. * Contribute to production serving and deployment pipelines - model rollout, canary deployments, and monitoring - alongside the backend team. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [DevOps for Machine Learning](https://www.wearedevelopers.com/videos/179-devops-for-machine-learning) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [ZEISS & Microsoft - Building the Next Generation Medical Ecosystem in the Cloud](https://www.wearedevelopers.com/videos/424-zeiss-microsoft-building-the-next-generation-medical-ecosystem-in-the-cloud) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) - [Introduction to Azure Machine Learning](https://www.wearedevelopers.com/videos/368-introduction-to-azure-machine-learning) ## Related Articles - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production](https://www.wearedevelopers.com/magazine/115-mlops-deploying-maintaining-and-evolving-machine-learning-models-in-production) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)