> Markdown version of [/jobs/ext/1459924-ai-platform-engineer](https://www.wearedevelopers.com/jobs/ext/1459924-ai-platform-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # AI Platform Engineer - **Company:** Great American Insurance Company - **Location:** Cincinnati, OH, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Artificial Intelligence, Automation of Tests, Microsoft Azure, Software Quality, Cyber Security, DevOps, Identity and Access Management, Python (Programming Language), Network Security, Cloud Services, Search Technologies, Software Engineering, Datadog, Large Language Models, Prompt Engineering, Rate Limiting, AI Platforms, Git Flow, Kubernetes, Information Technology, Production Code, Data Management, Machine Learning Operations, Api Gateway, Terraform - **Published:** July 27, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=54a3b318fd40bfd4 ## About the Role * 5+ years of software engineering experience with a strong development background. You write production code, not just scripts. * Hands-on experience with AI Foundry (or equivalent enterprise AI platforms) including model deployment, evaluation, and lifecycle management. * Practical experience building RAG systems end-to-end: embeddings, vector databases (e.g., pgvector, Pinecone, Weaviate, Azure AI Search), retrieval tuning, and evaluation. * Working knowledge of MCP server implementation and the patterns for exposing tools and data to LLMs safely. * Strong DevOps practice: Git-based workflows, CI/CD pipelines, containers, Kubernetes, IaC (Terraform or equivalent), and observability tooling. * Familiarity with LLM APIs, prompt engineering, token economics, and the failure modes of production LLM systems. * Security and governance instincts: you assume every endpoint will be attacked and every model call will be audited. * Platform engineering mindset: you build self-service capabilities with golden paths, not bespoke solutions for each consumer. * Prefer familiarity with the P&C Insurance industry ## Description P&C IT Services provides professional services to help our business units and corporate functions use technology to create, manage, and optimize information and business processes. IT Services can include a wide range of activities such as: software development, data management, Cloud services, IT security, network security, technical support, establishing and overseeing access rights, procuring and maintaining equipment or software, managing the infrastructure, and defining security procedures, The overall goal of IT Services is to provide technology solutions that increase efficiency, reduce costs, and give our company a competitive advantage over our competitors. Great American's culture is built on connection, shared learning, and strong relationships. To support this, employees in this role are expected to be on-site a minimum of two days a week if local to Cincinnati, with the potential to work three days remotely. Core in-office days are Tuesday and Thursday but will be determined by business needs. The AI Platform Engineer is a hands-on engineering role building and operating the enterprise AI platform that powers our Software Developer, Data Scientist, and Knowledge Worker communities. You will design, implement, and run the platform services that make LLMs, RAG systems, and MCP servers safely consumable across the enterprise. You will work inside a small, high-leverage platform team where code quality, automation, and operational excellence are the expectation, not the goal. You will report to the AI Platform Delivery Leader. What You'll Own Platform Engineering * Build and maintain core platform services including the LLM gateway, model registry, RAG pipelines, vectorization services, and MCP server infrastructure. * Implement AI Foundry-based capabilities and integrate them with existing enterprise platforms (API gateway, IAM, observability, ECM). * Develop reusable Python and/or Java libraries, SDKs, and golden-path templates that let consumers onboard in under an hour. * Own the automation that provisions access, onboards models, runs compliance checks, and emits telemetry, so platform scale is never gated by team size. RAG and Vectorization * Design and operate retrieval pipelines including chunking, embedding, vector store management, re-ranking, and evaluation. * Tune retrieval quality against real consumer workloads and publish evaluation harnesses that let consumers measure their own RAG implementations. * Integrate vectorization services with the ECM system and other enterprise data sources under the governance controls defined by the platform. MCP and Agent Infrastructure * Build, host, and operate MCP servers that expose enterprise capabilities safely to LLM consumers. * Implement the authentication, authorization, rate limiting, and audit patterns that make MCP usage enterprise-ready. * Partner with consuming teams to define and publish the MCP contracts the platform supports. DevOps and Operations * Treat the platform as a product: CI/CD pipelines, IaC, automated testing, progressive delivery, and full observability are table stakes. * Own the on-call rotation for the services you build. Write the runbooks, automate the toil, and drive incident postmortems to real fixes. * Build safety, governance, and compliance controls into the pipeline so they are enforced by default, not added later. ## Related Videos - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Debugging in the Dark](https://www.wearedevelopers.com/videos/1658-debugging-in-the-dark) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) - [AI-Augmented DevOps with Platform Engineering](https://www.wearedevelopers.com/videos/1614-ai-augmented-devops-with-platform-engineering) - [DevOps Maturity Check – a way to balance autonomy and alignment](https://www.wearedevelopers.com/videos/58-devops-maturity-check-a-way-to-balance-autonomy-and-alignment) - [Why Git Still Matters](https://www.wearedevelopers.com/videos/100288-why-git-still-matters) ## Related Articles - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [From Prototype to Production: Build AI Agents with This Free 4-Course Learning Path](https://www.wearedevelopers.com/magazine/655-from-prototype-to-production-build-ai-agents-with-this-free-4-course-learning-path)