> Markdown version of [/jobs/ext/4626892-software-engineer-ml-infrastructure](https://www.wearedevelopers.com/jobs/ext/4626892-software-engineer-ml-infrastructure). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Software Engineer - ML Infrastructure

- **Company:** Specter Incorporated
- **Location:** San Francisco, CA, United States
- **Contract:** Permanent contract
- **Skills:** LanceDB, A/B Testing, Artificial Intelligence, Computer Vision, C++ (Programming Language), Cloud Computing, Software Code Optimization, Cyber Security, Distributed Systems, Python (Programming Language), Machine Learning, Object Detection, Operational Databases, Tensorflow, Sensor Fusion, Software Engineering, Management of Software Versions, Video Editing, Qdrant, Pytorch, Autoscaling, Large Language Models, Apache Spark, SGLang, Machine Learning Operations, TensorRT, VLLM, Lidar, Data Pipelines
- **Published:** November 7, 2026
- **Apply:** https://www.careerbuilder.com/job-details/software-engineer-ml-infrastructure-san-francisco-ca--3e2e5c43-348a-479c-9a5b-aeeb072bd95d

## About the Role

Software Engineering, Artificial Intelligence (AI) Agents, Materials Tracking, Computer Security, Wireless Communications, Robotics, Artificial Intelligence (AI), Cloud Computing, Machine Learning, Computer Vision, * Strong software engineering fundamentals in Python, with working proficiency in a systems language (Rust, Go, C++) for performance-sensitive data and inference paths.

 * Working proficiency with ML frameworks (PyTorch, TensorFlow) and model optimization tooling.
 * Deep experience building and operating model inference systems at scale, request routing, batching, autoscaling, caching, and latency/throughput tuning under real production load.
 * Hands-on experience with distributed compute frameworks for ML and data workloads (Ray, Spark, or equivalent), including GPU cluster management and orchestration.
 * Strong understanding of distributed systems fundamentals: partitioning, replication, backpressure, exactly-once semantics.
 * Experience with vector databases (QDrant, LanceDB, or equivalent) for similarity search and retrieval workloads.
 * Familiarity with LLM/VLM serving frameworks (VLLM, SGLang, TensorRT-LLM) in production is a strong plus.
 * Familiarity with video processing, sensor fusion, or multi-modal perception systems is a plus.

## Description

* Designing and implementing scalable ML training and inference pipelines for perception models (object detection, tracking, classification, segmentation) and VLMs.
 * Developing continuous training and evaluation systems to improve model performance from production data feedback loops.
 * Designing large-scale multi-modal data pipelines for ingesting, processing, and indexing video and sensor data spanning both batch and streaming workloads.
 * Creating data pipelines for ingesting, labeling, versioning, and managing massive multi-modal sensor datasets (video, radar, lidar, thermal).
 * Implementing model monitoring, A/B testing frameworks, and performance analytics for deployed perception systems.
 * Collaborating with perception researchers to transition models from research to production at scale across thousands of edge nodes.
 * Building tools and infrastructure for distributed training, hyperparameter optimization, and experiment tracking.