Staff Software Engineer, Physical & Edge AI Platforms

We are seeking a Software Engineer to help build the next generation of Physical and Edge AI platforms on Arm. In this role, you will work on foundational software that enables AI workloads, such as vision, robotics, speech, and sensor-driven intelligence, to be deployed, managed, and consumed reliably on-device, outside of the cloud.

You will focus on building platform-level services, developer tooling, and runtime infrastructure that improve developer productivity and make advanced AI capabilities accessible through clean, stable abstractions. This is a high-impact role working on systems that sit at the intersection of distributed systems, edge computing, and AI infrastructure.

Responsibilities

Platform & systems development

• Design and implement reliable, scalable system services for edge and physical AI workloads.

• Build runtime infrastructure that supports deployment, lifecycle management, and updates of AI-powered components on-device.

• Develop abstractions that decouple applications from underlying AI frameworks, models, and hardware accelerators.

Developer experience & tooling

• Create APIs, SDKs, and developer tooling that streamline how engineers build and integrate AI-powered features.

• Improve end-to-end developer workflows, from local development to on-device deployment and updates.

• Build observability and diagnostics capabilities to help developers understand performance, failures, and system behavior.

Performance, reliability, and scale

• Design software that performs reliably under edge constraints such as limited resources, real-time requirements, and heterogeneous hardware.

• Contribute to system-level performance optimization across CPUs and AI accelerators.

• Ensure systems are maintainable, testable, and robust in production environments.

Cross-functional collaboration

• Work closely with architects, product managers, and AI engineers to shape platform capabilities and developer-facing abstractions.

• Collaborate across teams to design clean APIs, service boundaries, and integration points.

• Contribute to reference implementations, documentation, and example workflows.

• Strong experience designing and building systems software, platform services, or distributed systems in production.

• Proficiency in C/C++, Rust, Go, or Python (language choice depends on component).

• Solid understanding of:

• Linux-based systems

• Process isolation, IPC, and service lifecycles

• API design and versioning

• Experience building developer platforms, SDKs, or internal tooling.

• Strong fundamentals in algorithms, data structures, and performance optimization.

• Ability to work across multiple layers of the stack, from APIs down to system behavior.

• Excellent problem-solving, communication, and collaboration skills.

"Nice to Have" Skills and Experience

• Experience with container technologies and modern packaging/deployment approaches.

• Familiarity with edge computing, embedded Linux, or real-time systems.

• Exposure to AI/ML inference systems, even from a platform or infrastructure perspective.

• Experience with heterogeneous computing (CPUs, GPUs, NPUs, DSPs).

• Background in robotics, vision systems, or physical AI applications.

• Contributions to open-source systems or developer tooling projects.

• Familiarity with security concepts such as secure boot, isolation, or attestation.

Salary Range:$202,300-$273,700 per year

We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment

Arm is the industry’s highest-performing and most power-efficient compute platform with unmatched scale that touches 100 percent of the connected global population. To meet the insatiable demand for compute, Arm is delivering advanced solutions that allow the world’s leading technology companies to unleash the unprecedented experiences and capabilities of AI. Together with the world’s largest computing ecosystem and 22 million software developers, we are building the future of AI on Arm.