> Markdown version of [/jobs/ext/3389802-junior-software-engineer-inference](https://www.wearedevelopers.com/jobs/ext/3389802-junior-software-engineer-inference). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Junior Software Engineer - Inference

- **Company:** NEURAL SOLUTIONS LLC
- **Location:** Columbia, MD, United States
- **Experience:** Starter
- **Salary:** $138,000.0 - $163,000.0
- **Contract:** Permanent contract
- **Skills:** Amazon Web Services, Continuous Integration, Python (Programming Language), Octopus Deploy, Cloud Services, Prometheus, AI Infrastructure, Large Language Models, Grafana, AI Platforms, Kubernetes, Programming Languages
- **Published:** September 12, 2026
- **Apply:** https://www.clearancejobs.com/jobs/9159031/junior-software-engineer-inference

## About the Role

* Experience with Python and/or modern programming languages.
 * Familiarity with Argo CD or other CI/CD frameworks.
 * Experience with Kubernetes/Helm.
 * Familiarity with AWS or another cloud service provider.

Nice to Have:

 * Experience with vLLM, LiteLLM, or similar inference-serving frameworks.
 * Experience supporting production software using SRE best practices.
 * Knowledge of Elastic, Grafana/Prometheus, and observability practices.

Experience Required: 3 years with Bachelor's degree in a technical field, or 7 years without degree

## Description

We're seeking a software engineer to support our AI infrastructure team, helping build and maintain the foundation for advanced AI capabilities while ensuring access to high-quality LLMs., * Procure, configure, and test new inference models, preparing them for release to users.

 * Develop in-house services and techniques to ensure continuous high-quality inference service.
 * Collaborate with model vendor teams to create reliable pipelines for closed-source model usage.
 * Support surge efforts to address short-term, high-priority inference needs.
 * Engage with other teams to establish solid infrastructure for AI services and integrate LLM-powered tools.