> Markdown version of [/jobs/ext/1882238-senior-software-engineer-inference](https://www.wearedevelopers.com/jobs/ext/1882238-senior-software-engineer-inference). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Software Engineer - Inference

- **Company:** NEURAL SOLUTIONS LLC
- **Location:** Columbia, MD, United States
- **Experience:** Expert
- **Salary:** $204,000.0 - $247,000.0
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Amazon Web Services, Continuous Integration, Python (Programming Language), Octopus Deploy, Reliability Engineering, Cloud Services, Large Language Models, Kubernetes, Programming Languages
- **Published:** August 2, 2026
- **Apply:** https://www.clearancejobs.com/jobs/9071025/senior-software-engineer-inference

## About the Role

* Experience with Python and/or other modern programming languages.
 * Experience with Argo CD and/or other CI/CD frameworks.
 * Experience with Kubernetes/Helm.
 * Experience with AWS or other cloud service providers.
 * Strong communication skills and ability to mentor other engineers.
 * Excellent leadership and stakeholder management skills.

Nice to Have:

 * Experience with vLLM, LiteLLM, or similar inference-serving frameworks.
 * Experience supporting production software using Site Reliability Engineering (SRE) best practices.
 * Knowledge of and interest in hosting AI capabilities.

Experience Required: 12 years with Bachelor's degree in a technical discipline, or 16 years without degree

## Description

* Lead the evaluation, configuration, and deployment of inference models for our users.
 * Mentor engineers and grow development best practices and standards for the team.
 * Engage with other teams in our organization to establish solid infrastructure for our services and integrate LLM-powered tools for user needs.
 * Collaborate with teammates on surge efforts to support short-term, high-priority inference needs from our customer.


## Related Videos

- [Leverage Cloud Computing Benefits with Serverless Multi-Cloud ML ](https://www.wearedevelopers.com/videos/78-leverage-cloud-computing-benefits-with-serverless-multi-cloud-ml)
- [Understanding Kubernetes in a visual way](https://www.wearedevelopers.com/videos/100085-understanding-kubernetes-in-a-visual-way)
- [LLMOps-driven fine-tuning, evaluation, and inference with NVIDIA NIM & NeMo Microservices](https://www.wearedevelopers.com/videos/1582-llmops-driven-fine-tuning-evaluation-and-inference-with-nvidia-nim-nemo-microservices)
- [ZEISS & Microsoft - Building the Next Generation Medical Ecosystem in the Cloud](https://www.wearedevelopers.com/videos/424-zeiss-microsoft-building-the-next-generation-medical-ecosystem-in-the-cloud)
- [Instant KAI Sandboxes with vCluster: Multi-Tenant, Multi-Scheduler GPU Sharing](https://www.wearedevelopers.com/videos/100333-instant-kai-sandboxes-with-vcluster-multi-tenant-multi-scheduler-gpu-sharing)
- [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops)

## Related Articles

- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)