> Markdown version of [/jobs/ext/3065838-senior-backend-engineer-machine-learning-infrastructure](https://www.wearedevelopers.com/jobs/ext/3065838-senior-backend-engineer-machine-learning-infrastructure). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Backend Engineer: Machine Learning Infrastructure

- **Company:** Constructors, Inc.
- **Location:** United States (Remote available)
- **Experience:** Expert
- **Salary:** $80,000.0 - $120,000.0
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Amazon Web Services, Microsoft Azure, Databases, Data Structures, Python (Programming Language), Machine Learning, Azure Machine Learning, Large Language Models, Backend, Kubernetes, Machine Learning Operations, Terraform, Data Pipelines
- **Published:** September 25, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=1220559799df8d35

## About the Role

* 5+ years of professional experience in backend or platform engineering
 * Extensive Python knowledge (our primary language)
 * Hands-on experience developing on a public cloud (AWS, GCP, or Azure) or with self-managed Kubernetes - AWS is our primary platform, but we're not limited to it
 * Experience designing and building distributed, high-load services and APIs
 * Strong knowledge of data structures, algorithms, and their trade-offs
 * Design-driven engineering mindset: we're a coding-assistant-friendly environment and expect you to use modern AI tools - but you lead with system design and a strong understanding of their applicability and trade-offs
 * Ownership and proactivity: you can't close your eyes to problems, but are ready to solve them and take responsibility for outcomes
 * You are friendly and willing to help your teammates & others

Nice to have:

 * Experience with Rust (or C/C++/Go) - a strong plus
 * Experience developing or contributing to ML platforms or ML infrastructure - a strong plus
 * Experience setting up and operating any vector database (Qdrant, Milvus, Weaviate, OpenSearch, pgvector, etc.) - a strong plus
 * Experience with model serving / inference infrastructure, including LLMs
 * Experience with Infrastructure as Code (Terraform or similar)

## Description

The ML Infrastructure team builds and operates the shared backend services and platform capabilities that Constructor's ML and product teams rely on to develop, deploy, and run machine learning at scale - from model serving (including LLMs) to the specialized storages and data pipelines behind it., * Design, build, and operate high-load distributed backend services that power the company's ML infrastructure

 * Take end-to-end ownership of core ML services and related data pipelines: from design and implementation to deployment, observability, and continuous improvement
 * Partner with ML and product teams to understand their needs and turn them into reliable, reusable platform capabilities
 * Make and defend technical decisions: evaluate trade-offs, design first, and own the outcome
 * Be responsible for what you and your team do


## Related Videos

- [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock)
- [Kubernetes and Microservices with Multi-Model Databases](https://www.wearedevelopers.com/videos/382-kubernetes-and-microservices-with-multi-model-databases)
- [Infrastructure as Code: The Developer's Secret Weapon](https://www.wearedevelopers.com/videos/1221-infrastructure-as-code-the-developer-s-secret-weapon)
- [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops)
- [Nest.js - TypeScript in the backend can also be clean](https://www.wearedevelopers.com/videos/1033-nest-js-typescript-in-the-backend-can-also-be-clean)
- [Inside Bitpanda's Tech Stack: Scaling a European Fintech Leader - Markus Dorner](https://www.wearedevelopers.com/videos/1979-inside-bitpanda-s-tech-stack-scaling-a-european-fintech-leader-markus-dorner)

## Related Articles

- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production](https://www.wearedevelopers.com/magazine/115-mlops-deploying-maintaining-and-evolving-machine-learning-models-in-production)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Why Upskilling And Reskilling is Important For Developers](https://www.wearedevelopers.com/magazine/428-why-upskilling-and-reskilling-is-important-for-developers)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)