> Markdown version of [/jobs/ext/2436107-senior-software-development-engineer-genai](https://www.wearedevelopers.com/jobs/ext/2436107-senior-software-development-engineer-genai). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Software Development Engineer - GenAI - **Company:** CVS Health - **Location:** United States (Remote available) - **Experience:** Expert - **Salary:** $92,700.0 - $185,400.0 - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, Data Analysis, Microsoft Azure, Code Review, Python (Programming Language), MongoDB, Routing, Node.Js, OAuth, OpenID, Redis, Prometheus, Software Engineering, Systems Integration, TypeScript, Datadog, Flask (Web Framework), Large Language Models, Grafana, Prompt Engineering, Backend, Git, Fastapi, Build Management, Containerization, Information Technology, Apache Kafka, Restful APIs, Software Version Control, Docker, Microservices - **Published:** August 7, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=3887a758ab12980a ## About the Role * 5+ years of professional software engineering experience, including 2+ years building production backend services in Python and/or TypeScript/Node.js * 2+ years of experience designing and building RESTful APIs or microservices using frameworks such as FastAPI, Flask, Express, or NestJS * Experience integrating with one or more LLM/AI provider APIs (e.g., Anthropic, OpenAI, AWS Bedrock, Google Vertex AI) in a production system * Experience with at least one major cloud provider (AWS, Azure, or GCP) * Experience with the following (or equivalents): Redis, Kafka, and MongoDB in a production environment * Experience with OAuth2/OIDC or JWT-based authentication and authorization systems * Experience with observability/telemetry tooling (e.g., OpenTelemetry, Prometheus, Grafana, Langfuse, Datadog) * Experience with containerized applications (Docker) and CI/CD pipelines * Experience with version control systems (Git) and code review processes, * Genuine, self-motivated curiosity about GenAI and emerging AI infrastructure - someone who follows the space on their own and shows up with new ideas, tools, or approaches unprompted * Strong team player who collaborates readily and shares ideas openly, even while operating on a team of senior engineers with established conventions * Comfortable respectfully challenging established patterns and proposing alternatives as part of a collaborative team dynamic * Prior experience building LLM/GenAI infrastructure itself (e.g., LLM gateways, agentic orchestration systems, RAG platforms) - not just consuming provider APIs, but designing the systems around them * Ability to reason about system design trade-offs in distributed, stateful systems (e.g., cache invalidation, consumer group rebalancing, blue-green deployment of stateful services) * Strong written and verbal communication skills, with the ability to explain technical trade-offs to both engineers and non-technical stakeholders * Comfort operating with ambiguity and evolving requirements in a fast-moving technical landscape * Experience or interest in prompt engineering, model routing strategies, or LLM cost optimization techniques * Experience in a regulated industry (healthcare, finance, or similar), with familiarity around compliance considerations for sensitive data (PHI/PII) * Interest in eventually growing into technical leadership on a specific platform service * Collaborative mindset with a bias toward building reusable, well-documented internal tooling Education Bachelor's degree or equivalent work experience in Mathematics, Statistics, Computer Science, Analytics, Engineering, or related discipline. Master's degree preferred ## Description Our team owns the foundational AI/GenAI platform services that power CVS Health's internal agentic and LLM-driven tooling - including LLM routing and cost governance infrastructure, internal developer tooling for AI-assisted software development, retrieval-augmented generation (RAG) capabilities, and orchestration tools for building and deploying agentic workflows. We sit at the intersection of platform engineering and applied GenAI: we're responsible for making it fast, safe, and cost-effective for engineering teams across the enterprise to build with LLMs, while navigating the compliance realities of operating in a healthcare environment (PHI/PII handling, HIPAA, BAA requirements with model providers). This role will design and build core platform services - spanning areas like auth, quota/cost management, observability, and routing policy - and will help define what our next generation of foundational AI services looks like as the GenAI landscape evolves. The team is deeply senior and highly collaborative; we're looking for someone who brings genuine, self-driven enthusiasm for this space - someone who explores new ideas and tools because they're excited to, not because they were asked to - while working closely with the rest of the team to bring those ideas to life. ## Related Videos - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Reducing LLM Calls with Vector Search Patterns - Raphael De Lio (Redis)](https://www.wearedevelopers.com/videos/1714-reducing-llm-calls-with-vector-search-patterns-raphael-de-lio-redis) - [Keeping applications secure by evolving OAuth 2.0 and OpenID Connect](https://www.wearedevelopers.com/videos/100152-keeping-applications-secure-by-evolving-oauth-2-0-and-openid-connect) - [How to Avoid LLM Pitfalls - Mete Atamel and Guillaume Laforge](https://www.wearedevelopers.com/videos/1328-how-to-avoid-llm-pitfalls-mete-atamel-and-guillaume-laforge) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) - [Building Products in the era of GenAI](https://www.wearedevelopers.com/videos/827-building-products-in-the-era-of-genai) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [What is Agentic Programming and Why Should Developers Care?](https://www.wearedevelopers.com/magazine/625-what-is-agentic-programming-and-why-should-developers-care)