Software Engineer (AI Infrastructure / Training / Inference)

SpreeAI Corporation
San Francisco, CA, United States
1 day ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Java (Programming Language) Application Programming Interfaces (APIs) Artificial Intelligence Systems Engineering C++ (Programming Language) Cloud Computing Computer Programming Data Structures Software Debugging Distributed Computing Environment Distributed Systems Systems Theories
+21 more
Python (Programming Language) Machine Learning Object-Oriented Software Development Performance Tuning Systems Development Life Cycle Software Engineering AI Infrastructure Scripting Graphics Processing Unit (GPU) Pytorch Delivery Pipeline Grafana Reliability of Systems Backend Build Management Kubernetes Information Technology Machine Learning Operations Hardware Infrastructure Docker Golang

Job description

We are hiring Software Engineers focused on AI Infrastructure to build the systems that enable frontier multimodal AI to operate reliably at production scale. This role exists because modern generative and vision models require infrastructure beyond traditional backend engineering - including GPU orchestration, large-scale inference systems, performance optimization, and developer platforms that allow applied scientists to move fast without sacrificing reliability or cost efficiency.

You will work on:

  • Scalable model serving and inference pipelines.
  • Distributed GPU infrastructure.
  • Performance and cost optimization.
  • Reliability, observability, and production readiness.

You will operate at the boundary between systems engineering and machine learning - building the “paved roads” that allow advanced AI systems to scale safely and efficiently.

What you’ll do

  • Design and build scalable infrastructure supporting training and inference workflows.
  • Develop high-performance APIs and backend services for AI model serving.
  • Optimize GPU utilization, latency, and throughput for multimodal workloads.
  • Build distributed systems supporting large-scale generative models.
  • Improve observability, monitoring, and reliability of AI systems.
  • Partner closely with Applied Science teams to productionize research systems.
  • Drive improvements in deployment workflows, automation, and platform usability.

Requirements

  • Degree in Computer Science, Engineering, or comparable combination of education and practical experience.
  • Strong object-oriented programming skills (Python, C++, Java, Go, or similar).
  • Strong data structures and algorithms foundations.
  • Experience building production backend or distributed systems.
  • Understanding of cloud infrastructure concepts and containerized systems.

Preferred Qualifications

  • Experience with Kubernetes, Docker, or container orchestration.
  • Familiarity with GPU-based ML workloads or distributed training/inference systems.
  • Experience with model serving frameworks (vLLM, Triton, Ray Serve, or similar).
  • Experience with observability tools and performance debugging.
  • Familiarity with PyTorch or ML workflows.
  • Interest in optimizing systems for efficiency, scalability, and developer velocity.

Skills: Algorithms, Application Programming Interface (API), Artificial Intelligence (AI), Automation, C++ Programming Language, Cloud Computing, Computer Programming, Computer Science, Cost Control, Data Structures, Debugging Tools, Distributed Computing, Docker, GPU (Graphics Processing Unit), Go Programming Language (Golang), Java, Large-Scale Systems, Leading Edge Technology, Machine Learning, Object Oriented Programming (OOP), Performance Tuning/Optimization, Process Improvement, Production Systems, Python Programming/Scripting Language, Retail, Scalable System Development, Software Engineering, Systems Administration/Management, Systems Engineering, Systems Reliability, Technical Recruiting, Usability Engineering, eCommerce

About the company

SPREEAI is a fast-growing, innovative AI company at the forefront of fashion and e-commerce, revolutionizing how consumers engage with fashion through lifelike photorealistic try-on technology and hyper-personalized shopping experiences. Our mission is to redefine the retail landscape with cutting-edge AI solutions that blend high fashion and technology. We thrive in a dynamic, fast-paced environment where creativity meets technology to drive real impact. If you are passionate about innovation and shaping the future of fashion, SPREEAI offers a platform to make your mark.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

1:08 min

Building solutions with open source GoLang infrastructure tools

Jad Wahab · LIVE

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · World Congress 2025

1:52 min

Structuring and scaling the backend engineering team

Stefan Lingler Stefan Lingler +1 · Coffee With Developers

2:37 min

Optimizing technical profiles for AI sourcing and recruitment

Mina Golesorkhi Mina Golesorkhi · World Congress 2026 Europe

6:16 min

Event-driven Golang backend architecture and cloud deployment

Irina Branovic Irina Branovic · World Congress 2026 Europe

Videos

See all

Related articles

See all