> Markdown version of [/jobs/ext/4432473-senior-machine-learning-engineer](https://www.wearedevelopers.com/jobs/ext/4432473-senior-machine-learning-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Machine Learning Engineer

- **Company:** Goliath Partners
- **Location:** San Francisco, CA, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Amazon Web Services, C++ (Programming Language), Nvidia CUDA, Computer Programming, Computer Engineering, Distributed Computing Environment, Distributed Systems, Python (Programming Language), Machine Learning, Open Source Technology, Performance Tuning, Tensorflow, Software Engineering, Software Systems, Pytorch, DeepSpeed, Large Language Models, Kubernetes, Information Technology, Low Latency, Machine Learning Operations, Megatron, Docker
- **Published:** October 20, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=251c44f4d08ec809

## About the Role

* 5+ years of experience in ML Infrastructure, Distributed Systems, or Software Engineering, or equivalent demonstrated expertise.
 * Strong programming skills in Python and C++ or Go.
 * Hands-on experience with PyTorch, JAX, or similar ML frameworks.
 * Experience building scalable distributed training and inference infrastructure.
 * Strong knowledge of Kubernetes, Docker, AWS/GCP, and GPU compute environments.
 * Experience optimizing system performance, reliability, latency, and throughput.
 * Proven ability to design and own production ML infrastructure at scale., * Bachelor's or Master's degree in Computer Science, Computer Engineering, Mathematics, or a related technical field.
 * PhD in Computer Science, Machine Learning, or Distributed Systems is a plus.
 * Exceptional engineers with demonstrated technical impact and deep systems expertise are strongly encouraged to apply.

What Sets You Apart

 * Experience supporting large-scale LLM or foundation model training.
 * Expertise in CUDA, Triton, NCCL, or GPU performance optimization.
 * Experience with distributed training frameworks such as Ray, DeepSpeed, or Megatron-LM.
 * Contributions to high-performance ML systems or influential open-source infrastructure projects.
 * Experience building infrastructure at leading AI research labs or high-growth technology companies.

We're particularly interested in engineers who have owned complex infrastructure systems, solved difficult scaling challenges, and directly improved the performance of production ML workloads.