> Markdown version of [/jobs/ext/599275-ai-integration-engineer](https://www.wearedevelopers.com/jobs/ext/599275-ai-integration-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # AI Integration Engineer - **Company:** Booz Allen Hamilton Inc. - **Location:** Annapolis Junction, MD, United States - **Experience:** Experienced - **Salary:** $112,800.0 - $257,000.0 - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, Application Integration Architecture, Systems Engineering, Microsoft Azure, Cloud Computing, Nvidia CUDA, Computer Networks, Databases, Computer Engineering, Data Infrastructure, DevOps, Distributed Computing Environment, Distributed Systems, Domain Name System (DNS), General-Purpose Computing on Graphics Processing Units, Monitoring of Systems, PostgreSQL, Nginx, Redis, Tensorflow, Prometheus, Azure Machine Learning, Systems Integration, TCP/IP, Virtual Machines, Virtualization Technology, Workflow Management Systems, AI Infrastructure, Pulumi, Graphics Processing Unit (GPU), Google Cloud, Load Balancing, High Performance Computing, Pytorch, Large Language Models, Grafana, Multi-Agent Systems, Generative AI, Firewalls (Computer Science), AI Platforms, Kubernetes, Deployment Automation, HuggingFace, Dask, Machine Learning Operations, TensorRT, Hardware Infrastructure, Terraform, Docker - **Published:** June 18, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=6f1a02dd37f87c76 ## About the Role Do you have experience in Virtualization?, Do you have a Bachelor's degree?, * 5+ years of experience in infrastructure engineering or system integration roles * 2+ years of experience supporting large-scale AI/ML systems or GPU-centric environments * Experience with cloud platforms such as AWS, Azure, or Google Cloud, and their AI-focused services, including SageMaker, GCP AI Platform, and Azure Machine Learning * Experience with networking concepts, including TCP/IP, DNS, NGINX, load balancing, and firewalls, applied to AI model and infrastructure deployment * Experience integrating MLOps pipelines using tools such as MLflow, Kubeflow, TensorFlow Serving, or Vertex AI, including integration of AgentOps frameworks such as LangSmith and Arize Phoenix, to monitor autonomous decision-making paths and agent reasoning traces * Experience with orchestration frameworks for multi-agent systems such as LangGraph, CrewAI, or AutoGen, and managing the stateful databases required to support them, including Redis and Postgres * Experience working with NVIDIA GPU technologies, including CUDA, NCCL, TensorRT, and DGX systems, and container or orchestration tools such as Kubernetes, Docker, Terraform, or Pulumi * Ability to manage and optimize distributed, high-performance computing environments, including clusters of GPUs and cloud-based GPU instances * TS/SCI clearance with a polygraph * Bachelor's degree in CS, Computer Engineering, or Systems Engineering Nice If You Have: * Experience with AI/ML frameworks for model training and deployment such as PyTorch, TensorFlow, or Hugging Face Transformers * Experience implementing observability and monitoring systems such as Grafana, Prometheus, and ELK, for AI infrastructure to track performance and operational health * Experience with security practices for AI systems, including encryption, role-based access controls, secure APIs, and compliance frameworks such as SOC 2 and GDPR * Experience with Agentic Safety, including the implementation of Human-in-the-Loop (HITL) approval gateways and automated kill switches for autonomous processes * Experience with Vector Database infrastructure such as Pinecone, Weaviate, or Milvus, and Retrieval-Augmented Generation (RAG) pipelines used to provide agents with contextual memory * Knowledge of distributed computing frameworks such as Ray, Horovod, or Dask, for AI training jobs * Knowledge of AI ethics and operational risk assessments, ensuring deployed systems align with organizational policies and standards * Certified Kubernetes Administrator (CKA) or Kubernetes Application Developer (CKAD) Certification * AWS Certified Solutions Architect or similar Cloud Certifications * NVIDIA Certifications such as the NVIDIA Certified Advanced GPU Infrastructure Specialist Certification ## Description We are seeking a highly motivated AI Integration Engineer to join our team and help design, deploy, and maintain the infrastructure that supports artificial intelligence (AI) systems, including Large Language Models (LLMs) and distributed AI workloads. This role is critical to bridging the gap between advanced AI models, compute infrastructure, and operational workflows. You will be responsible for managing AI readiness by architecting scalable infrastructure solutions, integrating complex systems, and maintaining operational excellence to ensure stable deployments of AI and machine learning applications. The ideal candidate has a strong background in high-performance computing, cloud infrastructure, MLOps or DevOps, and AI ecosystem integration. This is an exciting opportunity to be at the forefront of AI operational infrastructure and contribute to cutting-edge projects. What You'll Work On: * Serve as the technical point of contact for integrating LLMs and other AI workloads across infrastructure systems, operational tools, and application pipelines. * Architect, deploy, and maintain scalable GPU computing environments and infrastructure required for autonomous agentic workflows, including persistent state management, long-term memory systems such as Vector DBs, and multi-step reasoning traces. * Develop, manage, and optimize CI/CD pipelines for AI deployments, ensuring smooth transitions from model development to production environments. * Oversee network and infrastructure connectivity, ensuring seamless communication between distributed systems, GPUs, virtual machines (VMs), APIs, and Command and Control (C2) tools. * Design and secure tool-calling environments where agents interact with external APIs, ensuring strict governance and sandboxing for autonomous actions. * Provide diagnostic and troubleshooting expertise for AI systems, monitoring infrastructure to maintain availability, security, and performance benchmarks. * Collaborate across engineering, data, and AI teams to align infrastructure solutions with business and operational goals. ## Related Videos - [Reducing LLM Calls with Vector Search Patterns - Raphael De Lio (Redis)](https://www.wearedevelopers.com/videos/1714-reducing-llm-calls-with-vector-search-patterns-raphael-de-lio-redis) - [Post-Quantum Cryptography: Preparing for Q-Day](https://www.wearedevelopers.com/videos/100179-post-quantum-cryptography-preparing-for-q-day) - [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops) - [Streaming AI Responses in Real-Time with SSE in Next.js & NestJS](https://www.wearedevelopers.com/videos/1630-streaming-ai-responses-in-real-time-with-sse-in-next-js-nestjs) - [Your Next AI Needs 10,000 GPUs. Now What?](https://www.wearedevelopers.com/videos/1590-your-next-ai-needs-10-000-gpus-now-what) - [Accelerating Authentication Architecture: Taking Passwordless to the Next Level](https://www.wearedevelopers.com/videos/733-accelerating-authentication-architecture-taking-passwordless-to-the-next-level) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere) - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)