> Markdown version of [/jobs/ext/4509077-ml-engineer-inference-model-deployment](https://www.wearedevelopers.com/jobs/ext/4509077-ml-engineer-inference-model-deployment). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# ML Engineer - Inference & Model Deployment

- **Company:** Hiring 4 U, Inc.
- **Location:** Cupertino, CA, United States
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Cloud Computing, Software Code Optimization, Profiling, Software Debugging, Distributed Systems, Machine Learning, Microsoft Software, Graphics Processing Unit (GPU), Large Language Models, Deep Learning, Backend, Discretization, Attention Mechanisms, Production Code, SGLang, Search Engines, Machine Learning Operations, TensorRT, Mixed Precision, VLLM
- **Published:** November 2, 2026
- **Apply:** https://www.careerbuilder.com/job-details/ml-engineer-inference-model-deployment-cupertino-ca--db3092ae-b1e5-44b0-912f-f6031549c86d

## About the Role

LinkedIn, Job Search Engines, Microsoft FAST, Production Systems, Artificial Intelligence (AI), Performance Modeling, GPU (Graphics Processing Unit), Cloud Computing, Research Skills, Memory Hardware, * Have deployed and optimized deep learning models in production environments.

 * Have experience with large-scale model serving, multi-GPU inference, or high-throughput inference systems.
 * Understand inference optimization techniques such as quantization, pruning, compilation, batching, caching, and memory optimization.
 * Have strong instincts for profiling, benchmarking, and debugging model performance.
 * Are familiar with efficient attention mechanisms, transformer optimization, or modern LLM/embedding/ranking model infrastructure.
 * Have worked with inference frameworks or serving stacks such as SGLang, vLLM, TensorRT, or equivelant.
 * Can write clean, production-quality code and integrate ML systems into backend infrastructure.
 * Are comfortable with cloud platforms, distributed systems, storage systems, and modern ML training or serving workflows.
 * Want ownership, leverage, and responsibility from day one.

## Description

Job discovery is broken. Indeed and LinkedIn want to keep it that way. Join our team and help millions of people put food on the table by finding the perfect job., We are looking for a founding ML engineer who can help us turn powerful AI and ML models into fast, reliable production systems. You will own the bridge between model development and real user-facing infrastructure: deploying models, optimizing inference latency and throughput, scaling serving systems, and making sure our models run efficiently in production.

This is a hands-on engineering role for someone who loves the details of model performance, GPU utilization, inference architecture, and production reliability.

What You'll Do

 * Deploy and integrate researcher-trained model checkpoints into our cloud infrastructure and production pipelines.
 * Profile and benchmark model performance to identify latency, throughput, memory, and compute bottlenecks.
 * Implement optimization techniques such as quantization, pruning, batching, caching, efficient attention, and precision trade-offs while preserving model quality.
 * Build scalable multi-GPU inference systems for search, ranking, recommendations, agents, and other AI-powered product experiences.
 * Design reliable model-serving architecture that can support millions of users.
 * Develop efficient training and fine-tuning workflows where needed, including distributed training, mixed precision, and parallelism strategies.
 * Work closely with our search & engineering teams to make model deployment a smooth part of our development workflow.