> Markdown version of [/jobs/ext/1895211-junior-software-engineer-inference](https://www.wearedevelopers.com/jobs/ext/1895211-junior-software-engineer-inference). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Junior Software Engineer - Inference

- **Company:** NEURAL SOLUTIONS LLC
- **Location:** Columbia, MD, United States
- **Experience:** Starter
- **Salary:** $138,000.0 - $163,000.0
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Amazon Web Services, Continuous Integration, Python (Programming Language), Octopus Deploy, Reliability Engineering, Cloud Services, Prometheus, AI Infrastructure, Large Language Models, Grafana, Containerization, Kubernetes, Docker, Programming Languages
- **Published:** August 2, 2026
- **Apply:** https://www.clearancejobs.com/jobs/9071022/junior-software-engineer-inference

## About the Role

* Experience with Python and/or other modern programming languages.
 * Familiarity with Argo CD and/or other CI/CD frameworks.
 * Experience with Kubernetes/Helm.
 * Familiarity with AWS or other cloud service providers.
 * Ability to learn new technologies quickly.
 * Strong communication skills and willingness to ask questions.

Nice to Have:

 * Experience with vLLM, LiteLLM, or similar inference-serving frameworks.
 * Experience with other LLM hosting frameworks and practices.
 * Experience supporting production software using Site Reliability Engineering (SRE) best practices.
 * Experience with Elastic, Grafana/Prometheus, or other observability frameworks and practices.
 * Experience with Docker and containerization.
 * Experience in traffic shaping and quality-of-service engineering.
 * Knowledge of and interest in hosting AI capabilities.

Experience Required: 3 years with Bachelor's degree in a technical discipline or 7 years without degree

## Description

We're seeking a software engineer to support our AI infrastructure team at Columbia, MD. In this role, you'll help build and maintain the foundation for customer AI capabilities while supporting a broader ecosystem of AI-enabled applications. Your focus will be ensuring access to the highest available quality LLMs to users throughout the inference software stack., * Procure, configure, and test new inference models, preparing them for release to our user base.

 * Develop in-house services and techniques to guarantee continual high-quality inference service for our customer.
 * Work with model vendor teams and representatives to create reliable pipelines for closed-source model usage.
 * Collaborate with teammates on surge efforts to support short-term, high-priority inference needs from our customer.
 * Engage with other teams in our organization to establish solid infrastructure for our services and integrate LLM-powered tools for user needs.


## Related Videos

- [5 steps for running a Kubernetes environment at scale](https://www.wearedevelopers.com/videos/88-5-steps-for-running-a-kubernetes-environment-at-scale)
- [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered)
- [Data binning and understanding histograms](https://www.wearedevelopers.com/videos/2086-data-binning-and-understanding-histograms)
- [LLMOps-driven fine-tuning, evaluation, and inference with NVIDIA NIM & NeMo Microservices](https://www.wearedevelopers.com/videos/1582-llmops-driven-fine-tuning-evaluation-and-inference-with-nvidia-nim-nemo-microservices)
- [All your telemetry data from any source in one place](https://www.wearedevelopers.com/videos/57-all-your-telemetry-data-from-any-source-in-one-place)
- [Keycloak case study: Making users happy with service level indicators and observability](https://www.wearedevelopers.com/videos/1599-keycloak-case-study-making-users-happy-with-service-level-indicators-and-observability)

## Related Articles

- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)
- [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)
- [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it)