> Markdown version of [/jobs/ext/4010625-machine-learning-infrastructure-engineer-llm-agentic-ai](https://www.wearedevelopers.com/jobs/ext/4010625-machine-learning-infrastructure-engineer-llm-agentic-ai). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Machine Learning Infrastructure Engineer - LLM & Agentic AI

- **Company:** MSSPS LLC
- **Location:** United States (Remote available)
- **Experience:** Starter
- **Salary:** $150,000.0 - $215,000.0
- **Contract:** Permanent contract
- **Skills:** LangGraph Framework, Java (Programming Language), Application Programming Interfaces (APIs), Artificial Intelligence, Application Integration Architecture, Cloud Computing, Cyber Security, Data Structures, Distributed Systems, Python (Programming Language), Machine Learning, Azure Machine Learning, Software Engineering, Web Services, AI Infrastructure, LangChain, Retrieval-Augmented Generation, Large Language Models, Prompt Engineering, Generative AI, Backend, Agentic-AI, Build Management, Containerization, Kubernetes, Information Technology, Cybercrime, AutoGen, Machine Learning Operations, VLLM, Model Inference, Grpc, llama.cpp, Docker, Golang, Microservices
- **Published:** October 29, 2026
- **Apply:** https://www.builtincolorado.com/job/machine-learning-infrastructure-engineer-llm-agentic-ai/11941641?handler=ApplyRedirect

## About the Role

* Bachelor's or Master's degree in Computer Science or a related field, or equivalent practical experience.
 * 2 years of experience with software development or 1 year of experience with an advanced degree in an industry setting.
 * 2 years of experience with data structures or algorithms in either an academic or industry setting.
 * 2 years of experience with developing backend infrastructure, distributed systems, APIs (REST / gRPC), and microservices for MLOps related projects.
 * Experience with cloud computing technologies, including containerization, orchestration, and deployment (Docker, Kubernetes, etc).
 * Experience in one or more of the following programming languages: Python, Java, Go., * Experience working on LLM applications in high-sensitivity domains (e.g., finance, defense, health).
 * Experience with Generative AI frameworks (e.g., LangChain, LangGraph, AutoGen, or other frameworks) and technologies (prompt engineering, vector databases, RAG, etc.).
 * Experience with observability practices in ML systems (e.g., metrics, cost tracking).
 * Experience deploying and scaling LLMs for inference using frameworks such as vLLM, llama.cpp, and etc.
 * Experience working on ML platform teams and/or building tools for researchers.
 * Knowledge of SecOps concepts, activities, workflows is a plus.

## Description

Build scalable infrastructure for LLM-based agentic AI supporting autonomous security operations. Responsibilities include designing agent orchestration frameworks, LLM inference and resource-management systems, MCP servers, supporting APIs, and distributed backend services. The role collaborates with machine learning, security research, engineering, and product teams. Required experience includes backend infrastructure, distributed systems, APIs, microservices, cloud deployment, containerization, orchestration, and Python, Java, or Go.
The summary above was generated by AI

Join a fast-growing global leader in cybersecurity, trusted by some of the biggest names in the industry. In addition to some of the world's largest enterprises and government agencies, more than 30% of the world's top MSSPs rely on our platform. We're at the forefront of protecting organizations against sophisticated cyber threats using cutting-edge AI and automation technologies. Our culture is built on diversity, openness, and collaboration, fostering creativity and innovation that drives real impact in the market.

We are looking for a highly skilled Machine Learning Infrastructure Engineer with a passion for building robust and scalable systems to power Stellar Cyber's Autonomous SOC applications. In this role, you will be at the forefront of AI infrastructure innovation, responsible for developing the foundational components that enable intelligent agents to work like true SOC analysts to operate in dynamic SecOps environments.
Responsibilities

 * Design and build Agentic AI frameworks to orchestrate LLM-based agents capable of reasoning, planning, and executing SecOps tasks in Stellar Cyber's Open XDR platform.
 * Design and develop scalable LLM inference infrastructure that supports runtime- and cost-efficient serving and resource management across LLM hosting providers.
 * Develop MCP servers that interact with Open XDR platform services and features, and integrate with LLM-based agents.
 * Develop other supporting API services necessary for Autonomous SOC applications to provide reliable and extensible interface for agent operations.
 * Collaborate closely with machine learning / security researchers, UI / backend / infrastructure engineers, and product management to align infrastructure with evolving product needs.