> Markdown version of [/jobs/ext/2283460-software-engineer-ii-ai-infrastructure](https://www.wearedevelopers.com/jobs/ext/2283460-software-engineer-ii-ai-infrastructure). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Software Engineer II - AI Infrastructure - **Company:** Black Eagle Defense - **Location:** Fort Meade, MD, United States - **Experience:** Expert - **Salary:** $143,000.0 - $200,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Amazon Web Services, Software Applications, Cloud Computing, Cloud Engineering, Configuration Management, Data Infrastructure, DevOps, Distributed Systems, Python (Programming Language), Machine Learning, Prometheus, Search Technologies, Software Deployment, Software Engineering, Solution Deployment Descriptor, Systems Integration, Web Applications, AI Infrastructure, Data Logging, Data Processing, Cloud Platform System, High Performance Computing, Spring Cloud, System Availability, Large Language Models, Grafana, Multi-Agent Systems, AI Platforms, Kubernetes, Infrastructure Automation Frameworks, Information Technology, Deployment Automation, Machine Learning Operations, Virtual Agents, BIG-IP Access Policy Manager (APM) - **Published:** August 28, 2026 - **Apply:** https://www.clearancejobs.com/jobs/9124548/software-engineer-ii-ai-infrastructure ## About the Role QUALIFICATIONS Eight (8) years of experience as a SWE in programs and contracts of similar scope, type, and complexity are required. A Bachelor's degree in Computer Science or a related discipline from an accredited college or university is required. Four (4) years of additional SWE experience on projects with similar software processes may be substituted for a bachelor's degree., * Proven experience building, deploying, and maintaining production systems at scale * Experience designing and optimizing high-volume web application architectures for performance, scalability, and reliability * Strong background in systems integration across diverse technologies, platforms, and services * Hands-on experience with cloud engineering and solution deployment within AWS environments * Proficiency in administering and deploying applications within Kubernetes-based environments * Strong Python development skills for automation, infrastructure, and application development efforts * Experience implementing observability and monitoring solutions using technologies such as APM, OpenTelemetry, Grafana, and Prometheus * Familiarity with CI/CD pipelines, automation frameworks, and DevOps best practices * Strong understanding of infrastructure automation, deployment strategies, and operational excellence principles * Strong change management, stakeholder engagement, and organizational influence skills * Ability to operate effectively within ambiguous environments and establish structure for evolving requirements * Strong analytical, troubleshooting, and problem-solving skills * Excellent written and verbal communication skills * Ability to collaborate effectively across multidisciplinary engineering and operational teams * Experience supporting the full lifecycle of cloud-native applications and platform services from design through production operations, * Experience with AI inference serving technologies such as vLLM, LiteLLM, or similar platforms * Experience developing solutions using agentic AI frameworks such as LangChain or comparable technologies * Knowledge of vector databases, embedding models, and semantic search architectures * Experience designing and supporting retrieval-augmented generation (RAG) solutions and AI-enabled applications * Familiarity with large language model deployment, optimization, and inference workflows * Experience with high-performance computing environments and distributed systems architectures * Knowledge of scalable data processing, distributed computing, and resource optimization techniques * Experience supporting enterprise AI platforms and machine learning infrastructure * Familiarity with emerging AI technologies, frameworks, and platform capabilities * Experience integrating AI services and infrastructure into cloud-native environments and production systems ## Description DUTIES As a successful candidate for the Software Engineer II - AI Infrastructure role, you will support the development, operation, and evolution of the next generation of AI infrastructure that enables innovation across the customer organization. As part of a full-stack engineering team, you will design, implement, and maintain scalable platform capabilities that serve as the foundation for AI-powered applications and services. Your efforts will focus on AI inference infrastructure while supporting a broader ecosystem that includes advanced analytics, retrieval-augmented generation (RAG), autonomous agents, and emerging AI technologies. In this role, you will independently design, develop, deploy, and optimize infrastructure components that deliver reliable, secure, and high-performance AI capabilities at scale. You will collaborate with engineers, platform teams, and stakeholders to enhance platform reliability, drive adoption of modern technologies and engineering practices, and ensure AI services remain scalable, observable, and operationally resilient. Through cloud engineering, automation, systems integration, and platform development, you will help deliver the infrastructure that powers mission-critical AI solutions across the enterprise., * Design, implement, and optimize infrastructure supporting AI model inference at scale * Develop, deploy, and maintain production AI services and applications, including retrieval-augmented generation (RAG), autonomous agents, and emerging AI technologies * Analyze ambiguous requirements and define scalable, maintainable solutions for complex systems and operational challenges * Drive the adoption of modern technologies, engineering standards, and best practices across development teams * Implement monitoring, logging, and observability capabilities to improve visibility into AI platform performance and reliability * Automate infrastructure provisioning, deployment, and configuration management using Infrastructure-as-Code principles * Ensure the availability, reliability, scalability, and performance of AI platform components and supporting services * Contribute to the implementation of security best practices for AI systems, services, and data environments * Design and integrate platform capabilities that support enterprise AI initiatives and operational requirements * Collaborate with engineers, platform teams, and stakeholders to improve AI infrastructure and service delivery * Troubleshoot complex infrastructure, platform, and application issues within production environments * Provide technical guidance, knowledge sharing, and informal mentorship to junior engineers * Support the continuous improvement and modernization of AI infrastructure, cloud environments, and platform operations * Contribute to the full lifecycle of AI platform development, from design and implementation through deployment and sustainment ## Related Videos - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [5 steps for running a Kubernetes environment at scale](https://www.wearedevelopers.com/videos/88-5-steps-for-running-a-kubernetes-environment-at-scale) - [Understanding Kubernetes in a visual way](https://www.wearedevelopers.com/videos/100085-understanding-kubernetes-in-a-visual-way) - [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops) - [#90DaysOfDevOps - The DevOps Learning Journey](https://www.wearedevelopers.com/videos/548-90daysofdevops-the-devops-learning-journey) - [DevOps Maturity Check – a way to balance autonomy and alignment](https://www.wearedevelopers.com/videos/58-devops-maturity-check-a-way-to-balance-autonomy-and-alignment) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)