AI/ML Staff Software Engineer

Globalfoundries U.S. Inc.
Austin, TX, United States
about 2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$106,000.0 - $184,000.0
Working hours
Regular working hours
Languages
English
Job source

Tech stack

Artificial Intelligence Systems Engineering Compilers Extract Transform Load (ETL) Dynamic Random-Access Memory Open Source Technology Tensorflow Reduced Instruction Set Computing Smart Devices Toolchain Network Switches Machine Learning Operations

Job description

We’re looking for a seasoned AI/ML Staff Software Engineer to lead workload-driven architecture strategy across hardware and software boundaries. You will define how we study, model, and optimize AI/ML workloads for current and next-generation products, drive alignment across HW and SW engineering organizations, and serve as a technical authority on performance and architecture tradeoffs. This is a senior individual contributor role with significant cross-functional scope and organizational influence., We’re looking for a seasoned AI/ML Staff Software Engineer to lead workload-driven architecture strategy across hardware and software boundaries. You will define how we study, model, and optimize AI/ML workloads for current and next-generation products, drive alignment across HW and SW engineering organizations, and serve as a technical authority on performance and architecture tradeoffs. This is a senior individual contributor role with significant cross-functional scope and organizational influence.

Essential Responsibilities

Own workload characterization and hardware performance analysis for AI/ML systems - selecting representative workloads, defining measurement methodology, building support for MIPS products (e.g., the S8200), and projecting system-level KPIs. Your findings will directly inform SoC architecture decisions, memory subsystem design, and HW/SW co-optimization strategy.

Define the software frameworks across the product portfolio: what metrics matter, how to measure them accurately, how to estimate them pre-silicon, and how to use them to make architectural bets. Leverage open-source infrastructure like MLIR and IREE to implement and validate this work. Set the standard for how the team approaches this and mentor junior engineers in applying it.

Represent software in architectural discussions with hardware teams (CPU, SoC, memory, interconnect) and software teams (compilers, runtimes, ML frameworks). Identify critical bottlenecks - compute throughput, DRAM bandwidth, on-chip memory, data movement latency, or software overhead - and build the case for specific architectural changes or optimization investments.

Present findings and recommendations to senior engineering leadership and product stakeholders. You should be as comfortable writing a one-page architectural recommendation as a detailed technical memo.

Other Responsibilities:

  • Perform all activities in a safe and responsible manner and support all Environmental, Health, Safety & Security requirements and programs.

Requirements

Do you have experience in Technical writing within technology?, BS or MS (preferred) in EE, CE, CS, or equivalent, with 5+ years in systems engineering, hardware architecture, ML systems, or performance engineering, and a track record of technical leadership.

Deep expertise in CPU and SoC architecture - memory hierarchies, out-of-order execution, vector/SIMD pipelines, power management - and how these interact with AI/ML workloads. Strong command of system-level memory bandwidth constraints (DDR/LPDDR bandwidth, channel configuration, utilization efficiency) and the ability to reason quantitatively about memory-bound vs. compute-bound workloads.

Experience with AI/ML acceleration on edge devices - NPUs, dedicated inference accelerators, DSP-based pipelines - and the HW/SW co-design challenges involved. Familiarity with model quantization, sparsity, or other efficiency techniques and their hardware interaction is a strong plus.

Familiarity with AI compiler infrastructure: MLIR-based toolchains, IREE, TVM, TFLite, or equivalent. Understanding how graph representations are transformed, tiled, scheduled, and lowered to hardware will improve your ability to identify where compiler strategy and hardware architecture must be co-designed. Prior contributions to such toolchains are a significant differentiator.

Effective cross-functional collaborator who can drive technical consensus without direct authority, writes clearly, and calibrates technical depth for different audiences.

Preferred Qualifications

  • Prior implementation of CPU hardware features such as vector extensions (AVX, NEON, RVV) or matrix extensions (AMX, SME)
  • Experience defining or co-defining SoC architecture requirements from workload analysis
  • Contributions to graph lowering in MLIR/IREE or similar compiler infrastructure
  • Internal or external publications or contributions to technical standards
  • Experience mentoring junior systems engineers
  • Knowledge of RISC-V architecture and Vector/Matrix extensions

Other Requirements

  • English fluency (written and verbal)
  • Up to 10% travel

About the company

GlobalFoundries is a leading full-service semiconductor foundry providing a unique combination of design, development, and fabrication services to some of the world’s most inspired technology companies. With a global manufacturing footprint spanning three continents, GlobalFoundries makes possible the technologies and systems that transform industries and give customers the power to shape their markets. For more information, visit www.gf.com ., G lobal F oundries is an equal opportunity employer, cultivating a diverse and inclusive workforce. We believe having a multicultural workplace enhances productivity, efficiency and innovation whilst our employees feel truly respected, valued and heard.

As an affirmative employer, all qualified applicants are considered for employment regardless of age, ethnicity, marital status, citizenship, race, religion, political affiliation, gender, sexual orientation and medical and/or physical abilities.

All offers of employment with GlobalFoundries are conditioned upon the successful completion of background checks , medical screenings as applicable and subject to the respective local laws and regulations., An offer with GlobalFoundries is conditioned upon the successful completion of pre-employment conditions, as applicable, and subject to applicable laws and regulations.

GlobalFoundries is fully committed to equal opportunity in the workplace and believes that cultural diversity within the company enhances its business potential. GlobalFoundries goal of excellence in business necessitates the attraction and retention of highly qualified people. Artificial barriers and stereotypic biases detract from this objective and may be illegally discriminatory.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:51 min

Evolution of custom compilers and virtual machines

Florian Rappl · LIVE

3:12 min

Integrating toolchains to improve engineering efficiency and culture

Amir Friedman Amir Friedman +2 · WWC 2025

1:39 min

Fundamentals of tensors and the TensorFlow library

Håkan Silfvernagel · LIVE

2:14 min

Exploring internal AI product initiatives and global engineering roles

Maria Apazoglou · Coffee With Developers

3:04 min

Clarifying compiled versus interpreted language implementations

Aleksandra Sikora · WWC 2023

2:37 min

Optimizing technical profiles for AI sourcing and recruitment

Mina Golesorkhi Mina Golesorkhi · WWC Europe 2026

Videos

See all

Related articles

See all