> Markdown version of [/jobs/ext/2103390-software-engineer-llm-infrastructure](https://www.wearedevelopers.com/jobs/ext/2103390-software-engineer-llm-infrastructure). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Software Engineer, LLM Infrastructure

- **Company:** Greenhouse Software, Inc.
- **Location:** Mountain View, CA, United States
- **Experience:** Experienced
- **Salary:** $175,000.0 - $270,000.0
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Artificial Intelligence, Batch Processing, Software Debugging, Python (Programming Language), Language Modeling, Large Language Models, Multi-Agent Systems, Generative AI, Information Technology, Production Code, Machine Learning Operations, Software Coding, Data Pipelines, Golang
- **Published:** August 18, 2026
- **Apply:** https://job-boards.greenhouse.io/gleanwork/jobs/4501783005

## About the Role

* 2-6 years of experience
 * BA/BS in computer science, math, sciences, or a related degree
 * Proven ability to design, build, and ship production-ready software, ideally around AI/ML infrastructure (Batch processing pipelines, Serving infrastructure, LLM orchestration etc.)
 * Strong coding skills (Python, Go, Java)
 * Thrive in a customer-focused, tight-knit and cross-functional environment - being a team player and willing to take on whatever is most impactful for the company is a must
 * A proactive and positive attitude to lead, learn, troubleshoot and take ownership of both small tasks and large features

## Description

Glean is looking for software engineers to help build the world's best search and assistant product for work. Our engineers work on a range of systems across the stack, including generative AI, RAG, query understanding, document understanding, domain-adapted language models, natural language question-answering, evaluation, and experimentation. We interact regularly with customers, deeply understand their pain points, and use whatever tool is necessary, simple or complex, to solve their problems.
You will:

 * Design, build, and improve AI/ML systems and data pipelines infrastructure, including platforms that power large language model serving, routing, and orchestration at scale.
 * Work with and enable other engineers focused on modeling and Agentic capabilities
 * Build agentic systems that leverage AI to proactively monitor, diagnose, debug and maintain infrastructure health at scale across cloud deployments
 * Write robust code that's easy to read, maintain, and test
 * Mentor more junior engineers, or learn from battle-tested ones


## Related Videos

- [MLOps and AI Driven Development](https://www.wearedevelopers.com/videos/347-mlops-and-ai-driven-development)
- [Go with the Flow: Stop the Leaks Before Your Memory's a Waterfall!](https://www.wearedevelopers.com/videos/100073-go-with-the-flow-stop-the-leaks-before-your-memory-s-a-waterfall)
- [Why and when should we consider Stream Processing frameworks in our solutions](https://www.wearedevelopers.com/videos/1085-why-and-when-should-we-consider-stream-processing-frameworks-in-our-solutions)
- [Your imaginations is (no longer) the limit: how Generative AI empowers people to be creative](https://www.wearedevelopers.com/videos/741-your-imaginations-is-no-longer-the-limit-how-generative-ai-empowers-people-to-be-creative)
- [How E.On productionizes its AI model & Implementation of Secure Generative AI.](https://www.wearedevelopers.com/videos/623-how-e-on-productionizes-its-ai-model-implementation-of-secure-generative-ai)
- [Scoring 2000 Products per Request: Performance Pitfalls in Golang](https://www.wearedevelopers.com/videos/2073-scoring-2000-products-per-request-performance-pitfalls-in-golang)

## Related Articles

- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [A Guide to Green Tech and Green IT Careers](https://www.wearedevelopers.com/magazine/374-a-guide-to-green-tech-and-green-it-careers)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)