> Markdown version of [/jobs/ext/4771533-principal-ai-infrastructure-engineer](https://www.wearedevelopers.com/jobs/ext/4771533-principal-ai-infrastructure-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Principal AI Infrastructure Engineer - **Company:** Sage Group - **Location:** Atlanta, GA, United States - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Application Programming Interfaces (APIs), Amazon Web Services, Microsoft Azure, Cyber Security, Continuous Integration, Software Debugging, Distributed Systems, Identity and Access Management, Python (Programming Language), Key Management, Open Source Technology, Role-Based Access Control, Software Engineering, TypeScript, Management of Software Versions, AI Infrastructure, Large Language Models, Prompt Engineering, Agentic-AI, Kubernetes, Production Code, Golang - **Published:** November 18, 2026 - **Apply:** https://sagehr.my.salesforce-sites.com/careers/fRecruit__ApplyJob?vacancyNo=VN44272 ## About the Role Extensive engineering experience, including significant ownership of architecture and technical strategy for large-scale distributed or platform systems, and hands-on experience building LLM-powered or agent-based systems in production. Technical Skills * Expert in distributed systems design: durable workflows, queues and async processing, idempotency, consistency, failure recovery and operating at scale. * Deep experience building cloud platforms (AWS preferred, or GCP/Azure): Kubernetes, containers, infrastructure as code, and multi-account or multi-tenant isolation. * Strong security architecture judgement: identity and access management, short-lived credentials, secrets management, sandboxing, supply-chain security and auditability. * Production experience with LLM systems: agents and tool use, context engineering, model routing, evaluation, and the ways they fail. * Proficient in one or more of Python, TypeScript, Go, Java or Rust, and still able to write, review and debug production code. * Experience defining API and event contracts, versioning and backward compatibility across teams. Leadership & Ownership * A track record of setting technical direction across multiple teams and seeing it through to production. * Makes sound decisions under uncertainty, makes trade-offs visible, and changes course when the evidence says so. * Exceptional written and verbal communication; can align engineers, architects, product and senior leaders around complex decisions. * Raises the bar for senior engineers through design reviews, examples and pairing. Mindset & Collaboration * Growth mindset: curious, always learning and open to feedback. * Works closely with the engineers who use these tools every day, helping the whole organization build software better and faster. Nice to Have * Experience with durable workflow engines such as Temporal, or similar. * Experience with microVM or container sandboxing (for example Firecracker, Kata Containers or gVisor). * Built developer platforms, CI/CD or code-review systems used across a large engineering organization. * Experience with policy engines (for example OPA or Cedar) and fine-grained authorization. * Open-source or public contributions in agent tooling or LLM infrastructure. ## Description You'll set the technical direction for major parts of the platform and stay close enough to the code to make sound calls. You'll turn the platform vision into an architecture teams across Sage can build on and rely on, and set the engineering bar across squads. Key Responsibilities * Own the architecture for one or more core platform areas, such as orchestration, execution environments, agent identity and access, or the model gateway, from design through production. * Make and record key architecture decisions: service boundaries, contracts between components, technology choices and build-versus-buy, with options and trade-offs written down. * Design the platform's trust model: isolation, least privilege, short-lived task-scoped access, evidence tied to exact code revisions, and safe failure handling, so autonomy can grow without growing risk. * Lead the hardest technical problems hands-on: reliability, performance, security incidents, and scaling to many concurrent agent runs. * Set engineering standards for testing, observability, security, deployment and recovery, and make sure they're adopted, not just documented. * Work with architects and senior engineers from teams across Sage to turn their requirements into platform capabilities, and explain decisions back to them. * Partner with ML engineers on evaluation and model strategy, so infrastructure and agent quality improve together. * Mentor senior engineers and grow technical leadership across our distributed team. What You'll Own Technical direction and architecture for your platform areas, cross-squad technical trade-offs, and acceptance of engineering evidence before capabilities go live. You escalate product, security, legal or commercial policy questions with a clear recommendation.