AI Engineer
Role details
Job location
Tech stack
Job description
As an AI/ML Engineer, you recognize that enterprise-grade AI requires thoughtful design, responsible implementation, and precise communication to ensure alignment across mission teams. You enjoy exploring new AI technologies, improving workflows, and translating user needs into well-structured technical solutions. We're looking for someone with a strong foundation in software development, scripting, automation, systems development, application integration, data engineering, DevOps, IT, or related technical disciplines who can apply that experience to AI/ML-enabled capabilities in sensitive and high-impact environments.
As an AI/ML Engineer on our team, you'll help build and refine multi-step LLM workflows, develop retrieval augmented pipelines, integrate models into operational systems, and perform prompt evaluations to ensure consistency and accuracy. You'll partner closely with senior technical leaders for guidance while contributing to production-aligned capabilities that support Veteran-facing environments and adjacent mission teams.
Work with us to shape real-world AI solutions and accelerate innovation across enterprise systems.
Requirements
- 6+ years of experience in software development, scripting, automation, systems development, data engineering, application integration, DevOps, IT, systems administration, or cloud services
- Experience with AI/ML, LLM-enabled applications, prompt engineering, Python-based automation, APIs, data workflows, or emerging technology solutions
- Experience designing, testing, and iterating on prompts for production-oriented LLM applications
- Experience supporting RAG pipelines, including chunking strategies, embeddings, retrieval tuning, and grounding responses in source data
- Experience in Python, including scripting, debugging, writing reusable code, and working with external APIs
- Experience with tools for version control and collaborative coding workflows such as Git or Github
- Experience creating, troubleshooting, or maintaining functional software components in one or more programming languages
- Ability to align stakeholders, clarify requirements, and reduce rework
- Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements
- Bachelor's degree in a STEM, computer science, information technology, or engineering field
Nice If You Have:
- Experience with prompting strategies such as few-shot prompting, structured JSON or function calling prompts, or similar prompt design approaches
- Experience building or supporting multi-step LLM workflows or agents using LangChain, LlamaIndex, Semantic Kernel, LangGraph, or similar tools
- Experience implementing basic guardrails, output validation logic, error handling, or safe handling of model outputs in LLM systems
- Experience with vector databases or semantic search, such as pgvector, Azure AI Search, FAISS, or similar tools
- Experience evaluating prompts or building regression testing approaches for LLM behavior
- Experience with basic SQL, Microsoft SQL Server, or healthcare, claims, or research data
- Experience with Azure cloud services or Azure ML/AI Foundry tooling and integrating applications with APIs, databases, cloud services, or enterprise systems
- Experience working with PHI/PII or in HIPAA, IRB, or ATO governed environments
- Knowledge of responsible AI concepts including bias considerations, validation practices, and safe handling of model outputs
- Possession of excellent verbal and written communication skills
Benefits & conditions
At Booz Allen, we celebrate your contributions, provide you with opportunities and choices, and support your total well-being. Our offerings include health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, work-life programs, and dependent care. Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values. Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen's benefit programs. Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits. We encourage you to learn more about our total benefits by visiting the Resource page on our Careers site and reviewing Our Employee Benefits page. Salary at Booz Allen is determined by various factors, including but not limited to location, the individual's particular combination of education, knowledge, skills, competencies, and experience, as well as contract-specific affordability and organizational requirements. The projected compensation range for this position is $77,600.00 to $176,000.00 (annualized USD). The estimate displayed represents the typical salary range for this position and is just one component of Booz Allen's total compensation package for employees. This posting will close within 90 days from the Posting Date.
Identity Statement
As part of the hiring process, we will ask you to complete an identity verification process that leverages advanced biometrics and artificial intelligence to ensure authenticity and protect against identity fraud. You are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud.