> Markdown version of [/jobs/ext/1486041-vice-president-generative-ai-platform-engineering](https://www.wearedevelopers.com/jobs/ext/1486041-vice-president-generative-ai-platform-engineering). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Vice President, Generative AI Platform Engineering - **Company:** Fmr LLC - **Location:** Durham, NC, United States (Remote available) - **Experience:** Experienced - **Salary:** $140,000.0 - $285,000.0 - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, Computer Vision, Microsoft Azure, Cloud Engineering, Distributed Systems, Identity and Access Management, Key Management, Network Control, Microsoft Platform Builder, Release Management, Azure Machine Learning, Software Engineering, Management of Software Versions, AI Infrastructure, Large Language Models, Multi-Agent Systems, Multi-Cloud, Generative AI, Event Driven Architecture, AI Platforms, Kubernetes, Information Technology, Machine Learning Operations, Virtual Agents, Automation Anywhere - **Published:** July 29, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=80235dadc9470c63 ## About the Role * Bachelor's degree in computer science, Engineering, Mathematics, or related field. * Advanced degree preferred. * 15+ years of technology leadership experience. * 10+ years leading large-scale software engineering organizations. * 3+ years building cloud-native AI/ML platforms. * Experience delivering enterprise GenAI and agentic AI platforms. * Hands-on experience building AI solutions, agentic workflows, AI agents, and LLM-powered applications. * Experience with a good understanding of two or more of the following: LangGraph, CrewAI, OpenAI, Anthropic, Amazon Bedrock, Azure AI Foundry, or comparable emerging agent frameworks. * Strong understanding of LLMs and AI orchestration platforms, model capabilities and limitations, context management, token economics, and cost/latency trade-offs. * Good understanding of RAG architecture with a strong focus on retrieval - chunking and embedding strategies, vector databases, hybrid search, re-ranking, and evaluating retrieval quality. * Solid understanding of the Model Context Protocol (MCP), including its current limitations and security considerations. * Experience operating Kubernetes as the foundation of AI infrastructure is a huge plus. Especially for model serving, GPU scheduling and resource management, and autoscaling inference and agent workloads, along with deep grounding in distributed systems, APIs, and event-driven architecture. * Experience designing or operating a model/LLM gateway to manage LLM access at enterprise scale with centralized authentication and key management, policy-based routing across providers, quotas and rate limits, caching, and per-team cost attribution. * Hands-on experience with multi-cloud environments including AWS and Azure. * Demonstrated experience building and operating production platforms - AI or otherwise adopted by hundreds of users or developers (e.g., internal developer platforms or shared engineering services). * Demonstrated success operating highly available enterprise platforms with defined SLOs and SLAs. * Experience implementing AI governance, model risk management, and regulatory controls. * Familiarity with Responsible AI and AI governance frameworks, and the adaptability to deepen that expertise as security requirements and regulatory expectations evolve. * Experience managing large technology budgets and strategic vendor relationships. * Experience in financial services or another highly regulated industry is a strong advantage., * Think like a platform builder and enterprise architect. * Possess strong product and engineering leadership skills. * Drive innovation while maintaining operational discipline. * Have the executive presence to influence CIOs, CTOs, and business leaders. * Balance speed of innovation with governance and risk management. * Demonstrate a passion for transforming enterprises through AI. ## Description As the Vice President of Generative AI Platform Engineering, you will lead the architecture, engineering, delivery, and operations of the firm's enterprise Generative AI Platform. You will be responsible for building the foundational technology capabilities that enable secure, scalable, and compliant, and governed by the adoption of AI Agents, LLM-powered applications, and agentic workflows across the enterprise. Reporting to the SVP, Head of AI/ML Technology, this leader will establish and execute the engineering strategy for a next-generation AI Control Plane that enables model access, agent orchestration, tool integration, governance, identity management, observability, evaluation, and compliance monitoring at enterprise scale. You will lead teams of software engineers, platform engineers, and ML engineers responsible for designing and operating shared capabilities that support thousands of developers, hundreds of AI-enabled applications, and mission-critical business workflows. Success in this role requires deep expertise in distributed systems, AI platform engineering, cloud-native architecture, GenAI technologies, agent frameworks, AI governance, and enterprise-scale operational excellence. Key Responsibilities * Partner closely with the SVP, Head of AI/ML Technology to execute the long-term enterprise AI vision. * Translate strategic AI objectives into scalable platform capabilities and engineering roadmaps. * Own the architecture, delivery, and continuous evolution of Fidelity's enterprise Generative AI Platform and its AI Control Plane which will be the single, governed layer through which every LLM application, AI agent, and agentic workflow across the firm is provisioned, secured, observed, and controlled. * Define the platform's reference architectures, technical standards, and "golden paths" which will be opinionated, pre-approved patterns for building, deploying, and operating GenAI and agentic applications * Establish the engineering practices (design review, testing, release management) and operational processes (capacity, cost, change, and incident management) that keep the platform reliable at enterprise scale. * Offer reusable building blocks such as RAG pipelines, vector stores, a governed tool/connector catalog, and memory services, as managed, self-service capabilities * Own end-to-end agent lifecycle management: an agent and tool registry, least-privilege capability boundaries, session state and memory, versioning, and rollback and incident-response mechanisms for AI workflows and agents. * Establish unified identity and access management for both human and non-human (agent) identities across the platform. * Deliver deep observability: end-to-end tracing of agent reasoning and tool calls, telemetry, quality and drift monitoring, and cost and latency dashboards. * Build and lead a high-performing team of engineers, architects, engineering managers, ML engineers, and product leaders. * Create a culture of innovation, accountability, craftsmanship, and operational excellence. ## Related Videos - [Understanding Kubernetes in a visual way](https://www.wearedevelopers.com/videos/100085-understanding-kubernetes-in-a-visual-way) - [The Open-source Java SDK for Multi-Cloud Development - Sandeep Pal](https://www.wearedevelopers.com/videos/2113-the-open-source-java-sdk-for-multi-cloud-development-sandeep-pal) - [This App Reached 10,000 Users in One Week. Here's How.](https://www.wearedevelopers.com/videos/100329-this-app-reached-10-000-users-in-one-week-here-s-how) - [Beyond GPT: Building Unified GenAI Platforms for the Enterprise of Tomorrow](https://www.wearedevelopers.com/videos/1525-beyond-gpt-building-unified-genai-platforms-for-the-enterprise-of-tomorrow) - [Instant KAI Sandboxes with vCluster: Multi-Tenant, Multi-Scheduler GPU Sharing](https://www.wearedevelopers.com/videos/100333-instant-kai-sandboxes-with-vcluster-multi-tenant-multi-scheduler-gpu-sharing) - [Building Products in the era of GenAI](https://www.wearedevelopers.com/videos/827-building-products-in-the-era-of-genai) ## Related Articles - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)