> Markdown version of [/jobs/ext/1861402-senior-software-engineer-ai-platform](https://www.wearedevelopers.com/jobs/ext/1861402-senior-software-engineer-ai-platform). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Software Engineer, AI Platform

- **Company:** Isolved, Inc.
- **Location:** United States (Remote available)
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** .NET Framework, Artificial Intelligence, Audit Trail, Microsoft Azure, C Sharp (Programming Language), Data Architecture, Identity and Access Management, Python (Programming Language), Regression Testing, Search Technologies, Software Engineering, TypeScript, AI Infrastructure, Datadog, Large Language Models, Multi-Agent Systems, Rate Limiting, Web Filtering, Build Management, AI Platforms, Low Latency, Machine Learning Operations, Terraform, Dynatrace
- **Published:** July 31, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=368aa3eeca2a5b5a

## About the Role

+ 5+ years of professional software engineering experience, with Python as your primary language
 + 2+ years building production LLM-powered systems - inference, RAG, agentic patterns, or AI infrastructure
 + Deep Python expertise - this is the primary language for AI platform work
 + Working proficiency in C#/.NET - the platform serves teams that live in C#, so interop is real and matters
 + Strong hands-on experience with agentic frameworks - Semantic Kernel, LangGraph, LangChain, or you've built your own
 + Production experience with RAG architecture: chunking strategies, embedding models, vector search, retrieval quality, and the failure modes that don't show up in demos
 + Azure AI Foundry / Azure OpenAI experience - model deployment, API integration, observability tooling
 + Experience building internal platforms or SDKs that other engineers depend on - you understand what makes a platform feel good to use
 + Strong grasp of AI observability: token usage, latency, cost tracking, and distributed tracing across multi-agent workflows
 + Preferred:
+
o Experience with TypeScript and building developer SDKs or tooling
o Hands-on experience with AI evaluation frameworks (LLM-as-judge, automated regression testing)
o Knowledge of AI governance practices, including access control, audit logging, and security safeguards
o Familiarity with container-based deployments (e.g., Azure Container Apps) and infrastructure-as-code (Terraform)
o Awareness of AI regulatory frameworks such as NIST AI RMF or ISO/IEC 42001

## Description

The isolved Senior Software Engineer, AI Platform role owns both program execution and technical direction, leading ~20 engineers across domain teams (Tax, Benefits, Time, Payroll, Shared Logic), alongside two Engineering Managers and a Data Architect. The position blends delivery leadership with deep technical involvement, serving as a key decision-maker, escalation point for complex challenges, and ultimate owner of program outcomes., * Design and build a scalable LLM gateway with model routing, prompt management, cost attribution, rate limiting, and caching

 * Develop and operate RAG pipelines, embedding services, and vector search infrastructure for platform-wide use
 * Implement platform-level cost optimization strategies, including semantic caching and model selection by workload
 * Build and maintain agentic runtime infrastructure, including orchestration, state management, and human-in-the-loop patterns
 * Develop extensible MCP server and tool ecosystems for product team integration
 * Design and support multi-agent coordination patterns using modern frameworks and protocols
 * Establish comprehensive AI observability, including usage, latency, cost tracking, and distributed tracing
 * Implement AI governance controls, including access management, audit logging, content filtering, and security protections
 * Build AI incident detection and response capabilities, including monitoring for failures, hallucinations, and cost anomalies
 * Create developer-friendly SDKs across languages (Python, .NET, TypeScript) to simplify platform adoption
 * Define "paved road" patterns for common AI use cases and support onboarding of product teams
 * Build automated evaluation pipelines and continuously monitor production quality and model performance


## Related Videos

- [Azure AI Foundry for Developers: Open Tools, Scalable Agents, Real Impact](https://www.wearedevelopers.com/videos/1541-azure-ai-foundry-for-developers-open-tools-scalable-agents-real-impact)
- [The Power of Purpose: Unlocking Potential and Innovation](https://www.wearedevelopers.com/videos/1110-the-power-of-purpose-unlocking-potential-and-innovation)
- [Debugging in the Dark](https://www.wearedevelopers.com/videos/1658-debugging-in-the-dark)
- [Infrastructure as Code: The Developer's Secret Weapon](https://www.wearedevelopers.com/videos/1221-infrastructure-as-code-the-developer-s-secret-weapon)
- [Developer Experience, Platform Engineering and AI powered Apps](https://www.wearedevelopers.com/videos/990-developer-experience-platform-engineering-and-ai-powered-apps)
- [It's Not Vibe Coding If You Know What You're Doing](https://www.wearedevelopers.com/videos/100119-it-s-not-vibe-coding-if-you-know-what-you-re-doing)

## Related Articles

- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere)
- [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it)
- [The State of WebDev AI 2025 Results: What Can We Learn?](https://www.wearedevelopers.com/magazine/581-the-state-of-webdev-ai-2025-results-what-can-we-learn)