> Markdown version of [/jobs/ext/2719385-inference-lead-machine-learning-platform-engineer-lead-real-time-inference](https://www.wearedevelopers.com/jobs/ext/2719385-inference-lead-machine-learning-platform-engineer-lead-real-time-inference). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Inference Lead (Machine Learning Platform Engineer Lead Real-Time Inference)

- **Company:** Stellent IT LLC
- **Location:** Charlotte, NC, United States
- **Experience:** Expert
- **Contract:** Temporary contract
- **Skills:** Application Programming Interfaces (APIs), Cloud Computing, Continuous Integration, Disaster Recovery, Load Testing, Machine Learning, Performance Tuning, Reliability Engineering, Load Balancing, Autoscaling, Kubernetes, Information Technology, Low Latency, Microservices
- **Published:** September 4, 2026
- **Apply:** https://www.dice.com/job-detail/cd281f9b-f06e-453f-86f8-787a2a6f1791

## About the Role

* Online inference and real-time model-serving architecture.
 * REST/gRPC APIs and distributed microservices.
 * Kubernetes, containers, autoscaling, and traffic management.
 * Performance engineering, latency optimization, and load testing.
 * Monitoring, SLOs, capacity planning, and production operations.
 * CI/CD and progressive-deployment approaches.
 * Resilience and high-availability engineering.
 * Cloud and on-premises deployment experience., * Degree in computer science, engineering, or a related discipline.
 * Experience with enterprise model-serving platforms and inference runtimes.
 * Cloud, Kubernetes, SRE, or ML engineering certification.

## Description

* Architect low-latency online inference and real-time model-serving solutions.
 * Develop scalable APIs, microservices, and deployment patterns for predictive models.
 * Implement Kubernetes-based deployment, autoscaling, load balancing, and traffic-management strategies.
 * Conduct benchmarking, performance tuning, capacity planning, and load testing.
 * Optimize latency, throughput, resource consumption, availability, and cost.
 * Define monitoring, alerting, SLOs, runbooks, and incident-response practices.
 * Build CI/CD pipelines for repeatable model and service releases.
 * Design resilience, failover, rollback, disaster recovery, and graceful-degradation patterns.
 * Lead technical reviews and mentor inference and platform engineers.


## Related Videos

- [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops)
- [Understanding Kubernetes in a visual way](https://www.wearedevelopers.com/videos/100085-understanding-kubernetes-in-a-visual-way)
- [Fifty Shades of Kubernetes Autoscaling](https://www.wearedevelopers.com/videos/813-fifty-shades-of-kubernetes-autoscaling)
- [Swapping Low Latency Data Storage Under High Load](https://www.wearedevelopers.com/videos/746-swapping-low-latency-data-storage-under-high-load)
- [Efficient deployment and inference of GPU-accelerated LLMs​](https://www.wearedevelopers.com/videos/929-efficient-deployment-and-inference-of-gpu-accelerated-llms)
- [Instant KAI Sandboxes with vCluster: Multi-Tenant, Multi-Scheduler GPU Sharing](https://www.wearedevelopers.com/videos/100333-instant-kai-sandboxes-with-vcluster-multi-tenant-multi-scheduler-gpu-sharing)

## Related Articles

- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)
- [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere)
- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)