> Markdown version of [/jobs/ext/4352475-software-engineer-ai-inference](https://www.wearedevelopers.com/jobs/ext/4352475-software-engineer-ai-inference). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Software Engineer -- AI Inference

- **Company:** Intezra, Inc.
- **Location:** Columbia, MD, United States
- **Experience:** Starter
- **Salary:** $130,000.0 - $160,000.0
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Amazon Web Services, Continuous Integration, Python (Programming Language), Octopus Deploy, Reliability Engineering, Cloud Services, Prometheus, AI Infrastructure, Large Language Models, Grafana, Containerization, Kubernetes, LiteLLM, Model Inference, Docker, Programming Languages
- **Published:** October 22, 2026
- **Apply:** https://www.thejobnetwork.com/job/553646cf-e512-4edb-9bc4-87a84180ef24/software-engineer-ai-inference

## About the Role

* 3+ years with a Bachelor's degree, OR
 * 4 additional years of relevant experience in lieu of a degree, * Experience with Python and/or other modern programming languages.
 * Familiarity with Argo CD and/or other CI/CD frameworks.
 * Experience with Kubernetes/Helm.
 * Familiarity with AWS or other cloud service providers.
 * Ability to learn new technologies quickly.
 * Strong communication skills and willingness to ask questions.

Nice to Haves

 * Experience with vLLM, LiteLLM, or similar inference-serving frameworks.
 * Experience with other LLM hosting frameworks and practices.
 * Experience supporting production software using Site Reliability Engineering (SRE) best practices.
 * Experience with Elastic, Grafana/Prometheus, or other observability frameworks and practices.
 * Experience with Docker and containerization.

## Description

Join us in building the next generation of AI infrastructure that will power innovation across the customer organization. We're seeking software engineers to support our AI infrastructure team - helping build and maintain the foundation for customer AI capabilities while supporting a broader ecosystem of AI-enabled applications.

Your focus will be ensuring access to the highest-quality LLMs for users throughout the inference software stack. Requirements shift quickly as needs evolve and new technologies emerge, so you'll keep sharpening your skills and learning to turn loosely defined problems into working solutions.

Responsibilities

 * Procure, configure, and test new inference models, preparing them for release to the user base.
 * Develop in-house services and techniques to guarantee continual high-quality inference service for customers.
 * Work with model vendor teams and representatives to create reliable pipelines for closed-source model usage.
 * Collaborate with teammates on surge efforts to support short-term, high-priority inference needs.
 * Engage with other teams in the organization to establish solid infrastructure for services and integrate LLM-powered tools for user needs.