AI/ML Engineer
Role details
Job location
Tech stack
Job description
As an AI/ML Engineer, you're excited by the rapid evolution of AI and the impact modern LLM technologies can have on real users. You understand that building dependable AI capabilities requires more than clever prompts - it requires thoughtful engineering, clear communication, and the ability to collaborate across diverse technical and mission teams. We're seeking someone with a strong foundation in IT, systems, software, data, cloud, infrastructure, integration, or related technical disciplines who is eager to apply that experience to scalable AI/ML solutions that support enterprise-level environments and sensitive data workflows.
As an AI/ML Engineer on our team, you'll design and refine prompts, help build LLM-powered workflows, and support the development of retrieval augmented systems that improve decision making and operational efficiency. You'll work closely with senior technical leaders who will guide AI/ML direction while you contribute hands-on execution and apply your broader IT and technical experience to real mission applications. You'll collaborate with cross-functional teams and apply modern AI practices in secure, regulated environments.
Requirements
- 8+ years of experience in IT, systems administration, software development, systems integration, cloud services, data engineering, cybersecurity, infrastructure, enterprise applications, or automation
- Experience with AI/ML, LLM-enabled tools, prompt engineering, automation, analytics, data workflows, or emerging technology solutions
- Experience in designing, testing, and iterating on prompts for LLM-powered applications
- Experience with Retrieval Augmented Generation such as chunking, embeddings, retrieval, and grounding responses in source data
- Experience with Python, including writing clean and reusable code
- Experience with Git, GitHub, or version control tools
- Experience supporting the assessment, design, integration, documentation, implementation, or troubleshooting of IT or technical solutions
- Ability to effectively communicate, confirm requirements, reduce churn, and maintain alignment across teams
- Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements
- Bachelor's degree in a Computer Science, Information Technology, or STEM field
Nice If You Have:
- Experience with prompting techniques such as few-shot prompting, structured output formats, ReAct, or similar prompting approaches
- Experience building or supporting simple multi-step LLM workflows using tools such as LangChain, LlamaIndex, Semantic Kernel, LangGraph, or similar tools
- Knowledge of responsible AI practices including content filtering, guardrails, output validation, or safe handling of model outputs
- Experience working with PHI, PII, or within HIPAA, IRB, or ATO environments
- Experience with vector databases or semantic search systems
- Experience building evaluation sets for prompt testing
- Experience with enterprise tools such as Jira, Confluence, or API-driven workflows
- Experience in healthcare, research data, or regulated data environments
- Experience with Microsoft Azure services, Azure OpenAI, or Azure ML and AI Foundry tooling
- Experience applying IT, systems, software, data, cloud, or integration experience to emerging technology initiatives
Benefits & conditions
At Booz Allen, we celebrate your contributions, provide you with opportunities and choices, and support your total well-being. Our offerings include health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, work-life programs, and dependent care. Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values. Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen's benefit programs. Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits. We encourage you to learn more about our total benefits by visiting the Resource page on our Careers site and reviewing Our Employee Benefits page.
Salary at Booz Allen is determined by various factors, including but not limited to location, the individual's particular combination of education, knowledge, skills, competencies, and experience, as well as contract-specific affordability and organizational requirements. The projected compensation range for this position is $99,000.00 to $225,000.00 (annualized USD). The estimate displayed represents the typical salary range for this position and is just one component of Booz Allen's total compensation package for employees. This posting will close within 90 days from the Posting Date.
Identity Statement
As part of the hiring process, we will ask you to complete an identity verification process that leverages advanced biometrics and artificial intelligence to ensure authenticity and protect against identity fraud. You are expected to be on camera during interviews and assessments. We reserve the right to take your picture to verify your identity and prevent fraud.