Head of Software Engineering

TETRAMEM INC
San Jose, CA, United States
3 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Compensation
$200,000.0 - $350,000.0
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Computing Platforms Compilers Software Debugging Embedded Software Firmware Field-Programmable Gate Array (FPGA) Machine Learning Performance Tuning Software Architecture Tensorflow Software Deployment
+9 more
Software Engineering Toolchain AI Infrastructure Software Organization Application Specific Integrated Circuits Deep Learning Infrastructure Automation Frameworks Hardware Acceleration Machine Learning Operations

Job description

The head of Software Engineering will lead the company’s software organization across machine learning systems, compiler toolchains, SDKs, embedded software, firmware, and AI deployment infrastructure.

This executive will work closely with semiconductor architecture, silicon design, and product teams to build world-class software platforms optimized for TetraMem’s analog in-memory computing chips and AI accelerator systems., Software Strategy & Leadership:

  • Define and execute TetraMem’s software roadmap across ML frameworks, compiler systems, SDKs, embedded platforms, and deployment infrastructure
  • Build and scale a high-performing software engineering organization
  • Establish engineering processes, technical standards, and long-term software architecture strategy
  • Drive execution across multiple software initiatives aligned with company milestones and product commercialization goals

Machine Learning Systems:

  • Lead development and deployment of ML models for edge AI applications
  • Drive advanced optimization techniques including quantization, pruning, compression, and inference acceleration
  • Collaborate with hardware and SDK teams to optimize AI workloads for TetraMem’s analog AI accelerators
  • Improve performance across power and memory constrained environments

Compiler & Toolchain Development:

  • Lead development of compiler toolchains that map deep learning models onto novel in-memory computing hardware
  • Drive innovations in AI inference optimization for speed, efficiency, scalability, and latency reduction
  • Ensure compatibility with mainstream ML frameworks and customer workflows
  • Support software deployment pipelines and runtime optimization strategies

Embedded & Systems Software:

  • Oversee embedded software, firmware, runtime systems, and low-level driver development for FPGA and ASIC platforms
  • Ensure reliability, real-time performance, scalability, and security for AI workloads
  • Drive hardware/software co-optimization and system-level performance tuning
  • Support silicon bring-up, debugging, and platform validation activities

Cross-Functional Collaboration:

  • Partner closely with architecture, silicon, hardware, product, and applications teams
  • Support customer engagements, technical demonstrations, and early commercial deployments
  • Help bridge breakthrough research with production-ready software platforms

Team Building & Mentorship:

  • Recruit, mentor, and develop senior engineers and technical leaders
  • Foster a culture of innovation, collaboration, accountability, and execution excellence
  • Build strong alignment across multidisciplinary engineering teams

Requirements

Do you have experience in Tooling?, Do you have a Master’s degree?, The ideal candidate combines deep technical expertise in AI systems, compilers, embedded software, and semiconductor platforms with strong leadership experience building and scaling engineering organizations., * candidate must possess a Master’s or PhD from an accredited college

  • 10+ years of software engineering experience, including leadership roles in AI infrastructure, machine learning systems, compilers, embedded systems, or semiconductor software platforms
  • Strong background in machine learning frameworks and AI inference optimization
  • Deep understanding of compiler design and toolchains for specialized hardware or AI accelerators
  • Experience with embedded systems, firmware, and low-level optimization on FPGA or ASIC platforms
  • Proven track record building and scaling high-performing engineering teams
  • Strong communication and cross-functional leadership skills, * Experience in semiconductor, deep-tech, AI accelerator, or edge AI companies
  • Familiarity with AI chip commercialization and silicon product deployment
  • Experience working closely with hardware and silicon engineering teams
  • Experience with edge AI inference systems and low-power computing architectures
  • Experience supporting SDKs or developer ecosystems for AI hardware platforms

Benefits & conditions

Pulled from the full job description

  • 401(k)
  • Health insurance
  • 401(k) matching
  • Paid time off
  • Vision insurance
  • Dental insurance
  • Life insurance, * 401(k)
  • 401(k) matching
  • Dental insurance
  • Flexible schedule
  • Health insurance
  • Life insurance
  • Paid time off
  • Vision insurance

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:19 min

Orchestrating over-the-air firmware updates for vehicle modules

Denis Grahovac ¡ WWC 2021

1:51 min

Evolution of custom compilers and virtual machines

Florian Rappl ¡ LIVE

3:12 min

Integrating toolchains to improve engineering efficiency and culture

Amir Friedman Amir Friedman +2 ¡ WWC 2025

1:20 min

Identifying multi-disciplinary talent for developer experience engineering roles

Hazal Mestci +1 ¡ Coffee With Developers

2:20 min

Utilizing custom firmware for variable torque manipulation

Daniel Meilak Daniel Meilak +1 ¡ WWC Europe 2026

2:42 min

Dissecting artificial intelligence layers from compute to applications

Christian Nagel Christian Nagel +3 ¡ WWC Europe 2026

Videos

See all

Related articles

See all