> Markdown version of [/jobs/ext/731804-software-engineer-ai-infrastructure-training-inference](https://www.wearedevelopers.com/jobs/ext/731804-software-engineer-ai-infrastructure-training-inference). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Software Engineer (AI Infrastructure / Training / Inference) - **Company:** SpreeAI Corporation - **Location:** San Francisco, CA, United States - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Application Programming Interfaces (APIs), Artificial Intelligence, Systems Engineering, C++ (Programming Language), Cloud Computing, Data Structures, Software Debugging, Distributed Computing Environment, Distributed Systems, Systems Theories, Python (Programming Language), Machine Learning, Object-Oriented Software Development, Performance Tuning, AI Infrastructure, Pytorch, Delivery Pipeline, Grafana, Backend, Build Management, Kubernetes, Information Technology, Machine Learning Operations, Hardware Infrastructure, Docker, Golang - **Published:** June 29, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=2988eea7cf884e14 ## About the Role Do you have experience in Distributed computing?, * Degree in Computer Science, Engineering, or comparable combination of education and practical experience. * Strong object-oriented programming skills (Python, C++, Java, Go, or similar). * Strong data structures and algorithms foundations. * Experience building production backend or distributed systems. * Understanding of cloud infrastructure concepts and containerized systems., * Experience with Kubernetes, Docker, or container orchestration. * Familiarity with GPU-based ML workloads or distributed training/inference systems. * Experience with model serving frameworks (vLLM, Triton, Ray Serve, or similar). * Experience with observability tools and performance debugging. * Familiarity with PyTorch or ML workflows. * Interest in optimizing systems for efficiency, scalability, and developer velocity. ## Description We are hiring Software Engineers focused on AI Infrastructure to build the systems that enable frontier multimodal AI to operate reliably at production scale. This role exists because modern generative and vision models require infrastructure beyond traditional backend engineering - including GPU orchestration, large-scale inference systems, performance optimization, and developer platforms that allow applied scientists to move fast without sacrificing reliability or cost efficiency. You will work on: * Scalable model serving and inference pipelines. * Distributed GPU infrastructure. * Performance and cost optimization. * Reliability, observability, and production readiness. You will operate at the boundary between systems engineering and machine learning - building the "paved roads" that allow advanced AI systems to scale safely and efficiently. What you'll do * Design and build scalable infrastructure supporting training and inference workflows. * Develop high-performance APIs and backend services for AI model serving. * Optimize GPU utilization, latency, and throughput for multimodal workloads. * Build distributed systems supporting large-scale generative models. * Improve observability, monitoring, and reliability of AI systems. * Partner closely with Applied Science teams to productionize research systems. * Drive improvements in deployment workflows, automation, and platform usability. ## Related Videos - [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops) - [Go with the Flow: Stop the Leaks Before Your Memory's a Waterfall!](https://www.wearedevelopers.com/videos/100073-go-with-the-flow-stop-the-leaks-before-your-memory-s-a-waterfall) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock) - [Developing an AI.SDK](https://www.wearedevelopers.com/videos/198-developing-an-ai-sdk) - [Scoring 2000 Products per Request: Performance Pitfalls in Golang](https://www.wearedevelopers.com/videos/2073-scoring-2000-products-per-request-performance-pitfalls-in-golang) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)