Software Engineer, AI Developer Tools

Gusto
San Jose, CA, United States
1 day ago
Apply on job-boards.greenhouse.io
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Compensation
$180,000.0 - $200,000.0
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Programming Tools Network Troubleshooting Software Systems AI Infrastructure Large Language Models Multi-Agent Systems Prompt Engineering AI Platforms

Job description

As a Staff Engineer on the Developer Productivity - AI Developer Tools team, you will be the architectural anchor shaping the AI platform that accelerates engineering across Gusto. You will redefine how our entire engineering organization builds, tests, and ships software by architecting a highly secure, context-aware, “AI-native” development lifecycle.

Your mission is to eliminate developer friction through AI tools, multi-agent systems, and intelligent automation. Whether you are building bespoke internal coding assistants, automating sprawling codebase refactors, or deploying AI to self-heal CI/CD pipelines, your work will directly multiply the velocity of hundreds of builders. Help us drive developer productivity by building the next generation of AI tools.

About the Team:

The AI Developer Tools team is a specialized team within Developer Productivity. We believe AI is the next great leap in software craftsmanship. Our goal is to provide every builder at Gusto with a suite of “superpowers” tools that deeply understand our codebase and absorb operational toil so engineers can focus on creative problem-solving. We treat our fellow engineers as our primary customers, prioritizing developer experiences that are not just powerful, but absolutely delightful to use.

Here’s what you’ll do day-to-day:

  • Architect AI Core Infrastructure: Design, scale, and maintain the internal platform and APIs that integrate LLMs into the developer workflow, with a heavy focus on autonomous agents, custom retrieval-augmented generation (RAG), and smart context-delivery systems.
  • Drive Technical Leadership & Vision: Establish engineering best practices for building with AI at Gusto, including robust evaluation frameworks (evals), guardrails for code safety, and strategies for optimizing model latency and token spend.
  • Collaborate & Evangelize: Partner closely with product engineering teams to uncover systemic friction points, and collaborate with core Infrastructure and Security teams to ensure all AI tooling is scalable, compliant, and secure.
  • Optimize Feedback Loops: Identify and eliminate critical bottlenecks in the local-to-production lifecycle at scale across Gusto.
  • Maintain Enterprise Reliability: Treat AI infrastructure with production-grade rigor. Monitor system health, diagnose complex integration or networking issues, and mitigate model drift or downtime., Glassdoor Indeed Facebook Built In Colorado News Article Conference or Meetup Company Blog Company Employee Company Website Billboard/Outdoor Ads

Are you legally authorized to work in the country where you are applying?* Select… Will you now or in the future require visa sponsorship for employment?* Select…

If you’ll require this employer to commence, i.e., “sponsor,” an immigration or work permit case in order to employ you, either now or at some point in the future, then you should answer yes. An example of an immigration or work permit case that may require sponsorship now or in the future would be an H-1B or other employment-based work permit sponsorship., In addition to the information required to consider your application, below is a set of demographic questions that help us identify areas for improvement in our process and further support the development and execution of our diversity efforts and programs as well as to create a more inclusive environment for all employees.

Requirements

  • 8+ Years of Systems Expertise: You are a seasoned engineer who is highly comfortable navigating massive, complex codebases and delivering production-grade, distributed software.
  • Production AI Experience: You have a proven track record of moving AI beyond prototypes. You possess a deep understanding of prompt engineering, fine-tuning, RAG architectures, and orchestrating multi-agent workflows.
  • Developer-First Mindset: You are passionate about Developer Experience and Productivity. You intuitively understand what makes an internal tool frictionless, fast, and empowering for other engineers.
  • Strategic Execution: You don’t just build wrappers; you think deeply about data privacy, security, cost management, and systemic reliability when deploying AI solutions.
  • Exceptional Communication: You can seamlessly translate bleeding-edge AI capabilities into clear, actionable infrastructure strategies, mentoring junior engineers and aligning cross-functional stakeholders along the way.
  • Working as a Team: You work across team boundaries and bring other teams and groups along with you towards our strategic vision., You are considered to have a disability if you have a physical or mental impairment or medical condition that substantially limits a major life activity, or if you have a history or record of such an impairment or medical condition. Disabilities include, but are not limited to:
  • Blindness
  • Deafness
  • Cancer
  • Diabetes
  • Epilepsy
  • Autism
  • Cerebral palsy
  • HIV/AIDS
  • Schizophrenia
  • Muscular dystrophy
  • Bipolar disorder
  • Major depression
  • Multiple sclerosis (MS)
  • Missing limbs or partially missing limbs
  • Post-traumatic stress disorder (PTSD)
  • Obsessive compulsive disorder
  • Impairments requiring the use of a wheelchair
  • Intellectual disability

Benefits & conditions

At Gusto, we’re on a mission to grow the small business economy. We handle the hard stuff - payroll, health insurance, 401(k)s, and HR - so owners can focus on their craft and their customers. With teams in Denver, San Francisco, and New York, we support more than 500,000 small businesses nationwide and are building a workplace that reflects the people we serve.

All full-time employees receive competitive base pay, benefits, and equity (RSUs) - because everyone who helps build Gusto should share in its success. Offer amounts are determined by role, level, and location. Learn more about our Total Rewards philosophy.

AI is a fundamental part of how work gets done at Gusto. We expect all team members to actively engage with AI tools relevant to their role and grow their fluency as the technology evolves. AI experience requirements vary by role and will be assessed during the interview process.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on job-boards.greenhouse.io
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:21 min

Using artificial intelligence to reimagine developer experience

Alexander Trusheim Alexander Trusheim +1 ¡ World Congress 2025

2:36 min

Choosing between managed AI platforms and custom governance

PÊter Farkas PÊter Farkas ¡ Europe 2026 Virtual

2:36 min

Experiencing Conway's Law in heterogeneous software systems

Michael Jaeger Michael Jaeger ¡ Europe 2026 Virtual

2:30 min

Evaluating and selecting an AI pair programming tool

Alexander Trusheim Alexander Trusheim +1 ¡ World Congress 2025

1:31 min

Essential AI and human skills for future teams

Alexander Weißhaupt Alexander Weißhaupt +1 · World Congress 2025

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou ¡ Coffee With Developers

Videos

See all

Related articles

See all