> Markdown version of [/jobs/ext/2847710-principal-software-engineer-ai-compute-platform](https://www.wearedevelopers.com/jobs/ext/2847710-principal-software-engineer-ai-compute-platform). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Principal Software Engineer, AI Compute Platform - **Company:** ARM - **Location:** Seattle, WA, United States - **Experience:** Expert - **Salary:** $262,700.0 - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Computing Platforms, Cloud Computing, Computer Programming, Relational Databases, Programming Tools, Distributed Computing Environment, Distributed Systems, Python (Programming Language), PostgreSQL, Machine Learning, Prometheus, Pytorch, Grafana, Backend, Build Management, AI Platforms, Kubernetes, Apache Kafka - **Published:** September 11, 2026 - **Apply:** https://www.jofdav.com/jobs/59633965-principal-software-engineer-ai-compute-platform ## About the Role * 8+ years of experience building distributed systems, cloud platforms, or production backend services * Experience with distributed ML training or inference systems * Strong programming skills in Go, Python, or similar systems languages * Practical knowledge of APIs, Kubernetes, containers, asynchronous processing, and relational databases. * Ability to build clear interfaces and simplify infrastructure for engineers and researchers. * Clear communication and a collaborative approach to problem-solving. Desired Skills and Experience: * Experience with Kubernetes operators, schedulers, resource management, or GitOps or equivalent experience * Knowledge of RPC systems, PostgreSQL, Kafka, OpenTelemetry, Prometheus and Grafana * Familiarity with distributed AI platforms, inference serving, or frameworks such as PyTorch, Ray, or vLLM * Experience delivering developer tools or platform capabilities from early build through production * Technical leadership, mentoring experience, or an advanced degree or equivalent experience in a related field ## Description As a Principal Software Engineer on the AI Compute Platform team, you will design and build a secure, reliable, and easy-to-use platform for running AI workloads at scale. You will develop control-plane services, APIs, orchestration systems, and developer tools for distributed training and inference, working closely with compute infrastructure teams, AI engineers, and internal users to improve reliability, scalability, and developer productivity across Arm's AI workloads., * Build scalable backend services, APIs, and asynchronous workflows for managing AI workloads. * Develop Kubernetes controllers that manage workload submission, recovery, and long-running service lifecycles. * Deliver secure multi-tenant capabilities covering access, secrets, quotas, and auditability. * Improve platform scalability, observability, reliability, and developer workflows. * Partner across teams to deliver distributed training, evaluation, and inference capabilities while strengthening engineering quality. ## About Arm Arm is the industry’s highest-performing and most power-efficient compute platform with unmatched scale that touches 100 percent of the connected global population. To meet the insatiable demand for compute, Arm is delivering advanced solutions that allow the world’s leading technology companies to unleash the unprecedented experiences and capabilities of AI. Together with the world’s largest computing ecosystem and 22 million software developers, we are building the future of AI on Arm. [Company profile](https://www.wearedevelopers.com/companies/3413-arm) ### More Jobs at Arm - [Staff Software Engineer, AI Inference Runtime](https://www.wearedevelopers.com/jobs/ext/2847708-staff-software-engineer-ai-inference-runtime) - [Staff Memory Controller Performance Architect](https://www.wearedevelopers.com/jobs/ext/2844510-staff-memory-controller-performance-architect) - [Staff Software Engineer, AI Compute Infrastructure](https://www.wearedevelopers.com/jobs/ext/2847711-staff-software-engineer-ai-compute-infrastructure) - [Staff Software Engineer, AI Inference Cloud](https://www.wearedevelopers.com/jobs/ext/2844507-staff-software-engineer-ai-inference-cloud) - [Principal Software Engineer, AI Compute Infrastructure](https://www.wearedevelopers.com/jobs/ext/2847709-principal-software-engineer-ai-compute-infrastructure) ## Related Videos - [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops) - [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock) - [5 steps for running a Kubernetes environment at scale](https://www.wearedevelopers.com/videos/88-5-steps-for-running-a-kubernetes-environment-at-scale) - [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding) - [Unleashing the Full Potential of the Arm Architecture – Write Once, Deploy Anywhere](https://www.wearedevelopers.com/videos/940-unleashing-the-full-potential-of-the-arm-architecture-write-once-deploy-anywhere) - [Nest.js - TypeScript in the backend can also be clean](https://www.wearedevelopers.com/videos/1033-nest-js-typescript-in-the-backend-can-also-be-clean) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere) - [What is Software Engineering in the Age of AI?](https://www.wearedevelopers.com/magazine/640-what-is-software-engineering-in-the-age-of-ai)