> Markdown version of [/jobs/ext/2706169-software-engineer-ai-ml-infrastructure](https://www.wearedevelopers.com/jobs/ext/2706169-software-engineer-ai-ml-infrastructure). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Software Engineer, AI/ML Infrastructure

- **Company:** Glean, Ai
- **Location:** United States
- **Experience:** Experienced
- **Salary:** $175,000.0 - $270,000.0
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Artificial Intelligence, Batch Processing, Software Debugging, Python (Programming Language), Language Modeling, Multi-Agent Systems, Generative AI, Information Technology, Production Code, Machine Learning Operations, Software Coding, Data Pipelines, Golang
- **Published:** September 4, 2026
- **Apply:** https://startup.jobs/software-engineer-ai-ml-infrastructure-glean-website-6034165

## About the Role

* 2-6 years of experience
 * BA/BS in computer science, math, sciences, or a related degree
 * Proven ability to design, build, and ship production-ready software, ideally around AI/ML infrastructure (Batch processing pipelines, Serving infrastructure, etc.)
 * Strong coding skills (Python, Go, Java)
 * Thrive in a customer-focused, tight-knit and cross-functional environment - being a team player and willing to take on whatever is most impactful for the company is a must
 * A proactive and positive attitude to lead, learn, troubleshoot and take ownership of both small tasks and large features

## Description

Glean is looking for software engineers to help build the world's best search and assistant product for work. Our engineers work on a range of systems across the stack, including generative AI, RAG, query understanding, document understanding, domain-adapted language models, natural language question-answering, evaluation, and experimentation. We interact regularly with customers, deeply understand their pain points, and use whatever tool is necessary, simple or complex, to solve their problems.
You will:

 * Design, build, and improve AI/ML systems and data pipelines infrastructure, including platforms that power large language model serving, routing, and orchestration at scale
 * Work with and enable other engineers focused on modeling and Agentic capabilities
 * Build agentic systems that leverage AI to proactively monitor, diagnose, debug and maintain infrastructure health at scale across cloud deployments
 * Write robust code that's easy to read, maintain, and test
 * Mentor more junior engineers, or learn from battle-tested ones


## Related Videos

- [Building Products in the era of GenAI](https://www.wearedevelopers.com/videos/827-building-products-in-the-era-of-genai)
- [Go with the Flow: Stop the Leaks Before Your Memory's a Waterfall!](https://www.wearedevelopers.com/videos/100073-go-with-the-flow-stop-the-leaks-before-your-memory-s-a-waterfall)
- [Why and when should we consider Stream Processing frameworks in our solutions](https://www.wearedevelopers.com/videos/1085-why-and-when-should-we-consider-stream-processing-frameworks-in-our-solutions)
- [Your imaginations is (no longer) the limit: how Generative AI empowers people to be creative](https://www.wearedevelopers.com/videos/741-your-imaginations-is-no-longer-the-limit-how-generative-ai-empowers-people-to-be-creative)
- [MLOps and AI Driven Development](https://www.wearedevelopers.com/videos/347-mlops-and-ai-driven-development)
- [Agentic AI in Go](https://www.wearedevelopers.com/videos/100274-agentic-ai-in-go)

## Related Articles

- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [What is Software Engineering in the Age of AI?](https://www.wearedevelopers.com/magazine/640-what-is-software-engineering-in-the-age-of-ai)
- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [The State of WebDev AI 2025 Results: What Can We Learn?](https://www.wearedevelopers.com/magazine/581-the-state-of-webdev-ai-2025-results-what-can-we-learn)