> Markdown version of [/jobs/ext/1499144-senior-software-engineer-ai-platform-engineering](https://www.wearedevelopers.com/jobs/ext/1499144-senior-software-engineer-ai-platform-engineering). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Software Engineer - AI Platform Engineering - **Company:** Mayo Clinic - **Location:** Rochester, MN, United States - **Experience:** Expert - **Salary:** $141,024.0 - $204,526.0 - **Contract:** Permanent contract - **Skills:** Agile Methodology, Artificial Intelligence, Amazon Web Services, Data Analysis, Microsoft Azure, Big Data, Cloud Computing, Code Review, Databases, Distributed Systems, Python (Programming Language), Open Source Technology, Cloud Services, Software Engineering, Software Systems, Systems Architecture, Data Logging, Google Cloud, Large Language Models, Multi-Agent Systems, HybridCloud, Containerization, AI Platforms, Kubernetes, Information Technology, Build Process, Machine Learning Operations, Software Coding, Software Version Control, Dynatrace, Programming Languages - **Published:** July 30, 2026 - **Apply:** https://www.juju.com/job/00000000gkjzk9 ## About the Role Required qualifications for this position include: Bachelor's Degree in Computer Science/Engineering or related field with 5 years of experience as noted below; OR an Associate's degree in Computer/Science/Engineering or related field with 7 years of experience. Have in-depth knowledge of software engineering with experience coding applications or services in a high-level programming language, preferably Python, and a basic knowledge of related fields. Demonstrated problem solving and time management skills. Possesses strong technical aptitude for designing and implementing software solutions. Experience with modern application development frameworks Knowledge of professional software engineering practices & best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations. Deep hands-on technical expertise, excellent verbal and written communication skills. Experience with Agile software development techniques. * Preferred qualifications for this position include: * Master's degree in Computer Science/Engineering or related field. * Ability to use a wide variety of open-source technologies and cloud-based services. * Experience writing software for the cloud (GCP, AWS, Azure). * Experience in databases, analytics, big data systems or business intelligence products. * Experience building high-performance, highly available and scalable distributed systems. * Experience developing software for healthcare related industries. ## Description As a **Senior Software Engineer for AI Platform Engineering** , you will bridge the gap between high-scale systems architecture and frontier AI. You will be one of architects and builders of our **Model & Agent Runtimes** -the specialized engines that govern how models and autonomous agents execute across our hybrid-cloud footprint. This isn't just about deployment; it's about a **platform-first mindset** . You will ensure that AI capabilities are scalable, secure, and governed through world-class AgentOps, LLMOps, and MLOps practices. What You'll Do + **Architect the Future of Runtimes:** Design and implement high-performance hosting environments for both specialized models and autonomous agents. + **Scale Hybrid-Cloud Infrastructure:** Build multi-tenant platform capabilities that support seamless agent and model execution across diverse cloud and on-prem environments. + **Drive Operational Excellence:** Implement robust solutions for real-time monitoring, distributed tracing, and automated evaluation of agents & models in production. + **Operational Stewardship:** Act as a member of our rotational platform operational team, ensuring the reliability and uptime of critical AI services. + **Collaborate & Advocate:** Partner with cross-functional AI teams to identify system friction, streamlining their workflows and accelerating the delivery of AI-driven value. What You'll Bring + **Deep Systems Expertise:** Proven experience building scalable back-end systems, ideally with a focus on containerization and orchestration (Kubernetes). + **AI/ML Fluency:** Strong understanding of the lifecycle of LLMs and autonomous agents, including inference optimization and RAG architectures. + **Operational Rigor:** A track record of implementing observability (logging, metrics, tracing) in complex, distributed environments. ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [AI in High-Stakes Industries: Lessons Learned](https://www.wearedevelopers.com/videos/100253-ai-in-high-stakes-industries-lessons-learned) - [Kubernetes and Microservices with Multi-Model Databases](https://www.wearedevelopers.com/videos/382-kubernetes-and-microservices-with-multi-model-databases) - [The Power of Purpose: Unlocking Potential and Innovation](https://www.wearedevelopers.com/videos/1110-the-power-of-purpose-unlocking-potential-and-innovation) - [The Software Engineer 2030: From Coder To AI Orchestrator? - Patrick Schnell](https://www.wearedevelopers.com/videos/1825-the-software-engineer-2030-from-coder-to-ai-orchestrator-patrick-schnell) - [Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases](https://www.wearedevelopers.com/videos/1146-fault-tolerance-and-consistency-at-scale-harnessing-the-power-of-distributed-sql-databases) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)