> Markdown version of [/jobs/ext/4613526-senior-software-engineer-inference](https://www.wearedevelopers.com/jobs/ext/4613526-senior-software-engineer-inference). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Software Engineer - Inference

- **Company:** NEURAL SOLUTIONS LLC
- **Location:** Columbia, MD, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Amazon Web Services, Continuous Integration, Python (Programming Language), Octopus Deploy, Reliability Engineering, Cloud Services, AI Infrastructure, Large Language Models, Kubernetes, LiteLLM, Programming Languages
- **Published:** November 7, 2026
- **Apply:** https://www.juju.com/job/28_25197_33dcb3186d5ee9cde657b1d31fcc471e

## About the Role

* Experience with Python and/or other modern programming languages.
 * Experience with Argo CD and/or other CI/CD frameworks.
 * Experience with Kubernetes/Helm.
 * Experience with AWS or other cloud service providers.
 * Strong communication skills and ability to mentor other engineers.
 * Excellent leadership and stakeholder management skills.

Nice to Have:

 * Experience with vLLM, LiteLLM, or similar inference-serving frameworks.
 * Experience supporting production software using Site Reliability Engineering (SRE) best practices.
 * Knowledge of and interest in hosting AI capabilities.

Experience Required: 12 years with Bachelor's degree in a technical discipline or 16 years without degree

## Description

Join us in building the next generation of AI infrastructure that will power innovation across our organization. We're seeking a senior software engineer to support our AI infrastructure team. Your focus will be ensuring access to the highest available quality LLMs to users throughout the inference software stack., * Lead the evaluation, configuration, and deployment of inference models for our users.

 * Mentor engineers and grow development best practices and standards for the team.
 * Develop in-house services and techniques to guarantee continual high-quality inference service for our customer.
 * Engage with other teams within our organization to establish solid infrastructure for our services and integrate LLM-powered tools for user needs.
 * Collaborate with teammates on surge efforts to support short-term, high-priority inference needs from our customer.