> Markdown version of [/jobs/ext/2932718-ai-engineer-monitoring-observability-and-governance](https://www.wearedevelopers.com/jobs/ext/2932718-ai-engineer-monitoring-observability-and-governance). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# AI Engineer - Monitoring, Observability, and Governance

- **Company:** Bank of America
- **Location:** Richmond, VA, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Agile Methodology, Artificial Intelligence, Component-Based Software Engineering, Application Performance Management, DevOps, Python (Programming Language), Language Modeling, OpenShift, Performance Tuning, Software Engineering, Systems Integration, Management of Software Versions, Large Language Models, Generative AI, Containerization, Kubernetes, Information Technology, Low Latency, Data Management, Virtual Agents, Api Design, Splunk, Automation Anywhere, Software Library
- **Published:** September 16, 2026
- **Apply:** https://www.techcareers.com/job.asp?id=3392087979&tx=KK6363FFJ&pt=1&aff=0B19D771-A501-4A5E-8338-2A822B784D54&utm_source=Job%20Feed&utm_medium=textkernel&utm_campaign=DE&utm_term=0B19D771-A501-4A5E-8338-2A822B784D54

## About the Role

* Bachelor's or Master's degree in Computer Science, Data Science, MIS, related field, or equivalent experience.
 * 10+ years of software engineering experience designing, building, and scaling production applications.
 * Strong Python development experience, including data and machine learning libraries.
 * Experience deploying and supporting containerized workloads on OpenShift or Kubernetes.
 * Experience taking LLM or RAG-based applications into production.
 * Understanding of AI risks, agent behavior, and governance frameworks.
 * Experience building APIs and integrating third-party platforms.
 * Experience with OpenAI APIs and orchestration frameworks such as LangChain.
 * Understanding of inference performance optimization and observability.
 * Experience implementing AI guardrails and model-based evaluation frameworks.
 * Experience working in Agile environments.
 * Demonstrated technical leadership and stakeholder influence., * Experience delivering technology solutions in large, complex, regulated organizations, preferably financial services.
 * Experience with annotation pipelines, feedback loops, fine-tuning, and alignment techniques.
 * Familiarity with prompt versioning and lifecycle management.
 * Experience with Galileo, LangSmith, Splunk, or similar observability platforms.
 * Knowledge of additional GenAI frameworks such as LlamaIndex or Haystack.
 * Experience supporting evaluation and guardrails for agentic AI workflows.
 * Strong collaboration skills and ability to quickly learn emerging technologies.

Skills:

 * Application Development
 * Automation
 * Influence
 * Solution Design
 * Technical Strategy Development
 * Architecture
 * Business Acumen
 * DevOps Practices
 * Result Orientation
 * Solution Delivery Process
 * Analytical Thinking
 * Collaboration
 * Data Management
 * Risk Management
 * Test Engineering

## Description

This role is responsible for engineering and operating third-party applications within an on-premises OpenShift environment supporting enterprise GenAI monitoring, observability, and governance. The position will develop and integrate application components, deploy and support containerized services, and maintain AI guardrail and observability platforms such as Galileo and LangSmith. The engineer will monitor application quality, safety, and performance while helping operationalize model-based evaluation workflows and supporting enterprise AI governance initiatives.

The domain is GenAI operations: the applications you run provide guardrails and observability for LLM- and RAG-powered systems across the enterprise. You will work with these vendor tools to monitor application quality, safety, and performance-tracking metrics such as attribution, grounding, prompt-injection detection, tone, bias, and PII handling-and surface them through dashboards and alerting. Where the platform uses model-based evaluation (LLMs-as-Judges and specialized/small language models), you will help operationalize, calibrate, and maintain those workflows.

Because the AI landscape changes quickly, the ideal engineer learns new tools and environments fast, brings a pragmatic build-and-operate mindset, and can lead cross-functional work to move initiatives forward.

Responsibilities:

 * Develop, deploy, and support vendor applications in a fully on-premises OpenShift environment.
 * Build APIs and integrations connecting guardrail and observability tools with enterprise GenAI applications.
 * Implement and maintain operational monitoring for application performance, safety, latency, and quality metrics.
 * Develop and calibrate model-based evaluation workflows including annotation and feedback processes.
 * Utilize orchestration frameworks such as LangChain for guardrails, prompt management, and scoring workflows.
 * Create observability dashboards and alerting capabilities.
 * Troubleshoot production issues and improve scalability, reliability, and performance.
 * Support emerging agentic and multi-step AI workflows.
 * Lead and mentor team members while driving engineering standards and cross-functional delivery., Bank of America and its affiliates consider for employment and hire qualified candidates without regard to race, religious creed, religion, color, sex, sexual orientation, genetic information, gender, gender identity, gender expression, age, national origin, ancestry, citizenship, protected veteran or disability status or any factor prohibited by law, and as such affirms in policy and practice to support and promote the concept of equal employment opportunity, in accordance with all applicable federal, state, provincial and municipal laws. The company also prohibits discrimination on other bases such as medical condition, marital status or any other factor that is irrelevant to the performance of our teammates.

View your "Know your Rights (https://www.eeoc.gov/sites/default/files/2023-06/22-088_EEOC_KnowYourRights6.12.pdf) " poster.

View the LA County Fair Chance Ordinance (https://dcba.lacounty.gov/wp-content/uploads/2024/08/FCOE-Official-Notice-Eng-Final-8.30.2024.pdf) .


## Related Videos

- [Our journey with Spring Boot in a microservice architecture](https://www.wearedevelopers.com/videos/511-our-journey-with-spring-boot-in-a-microservice-architecture)
- [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform)
- [This Is Not Your Father's .NET](https://www.wearedevelopers.com/videos/967-this-is-not-your-father-s-net)
- [Pioneering AI Assistants in Banking](https://www.wearedevelopers.com/videos/1627-pioneering-ai-assistants-in-banking)
- [The Missing Layer Between Enterprise Data and AI Agents](https://www.wearedevelopers.com/videos/100286-the-missing-layer-between-enterprise-data-and-ai-agents)
- [DevOps Maturity Check – a way to balance autonomy and alignment](https://www.wearedevelopers.com/videos/58-devops-maturity-check-a-way-to-balance-autonomy-and-alignment)

## Related Articles

- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts)
- [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)