> Markdown version of [/jobs/ext/4626751-senior-systems-hardware-experts-ai-benchmarking](https://www.wearedevelopers.com/jobs/ext/4626751-senior-systems-hardware-experts-ai-benchmarking). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Systems & Hardware Experts - AI Benchmarking

- **Company:** Brain Trust, LLC
- **Location:** San Francisco, CA, United States
- **Experience:** Expert
- **Salary:** $16,200
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Systems Engineering, Computer Engineering, Linux, Network Connections, Virtual Agents
- **Published:** November 7, 2026
- **Apply:** https://www.careerbuilder.com/job-details/senior-systems-hardware-experts-ai-benchmarking-san-francisco-ca--9f74b9cb-3a42-4596-8f71-95710a45d996

## About the Role

Artificial Intelligence (AI), Benchmarking, Network Connectivity, Artificial Intelligence (AI) Agents, Systems Engineering, Linux Operating System, Computer Engineering, Artificial Intelligence (AI), Benchmarking, Publications, * At least 9 years of relevant professional experience in systems engineering or hardware engineering.

 * A completed master's degree or higher. Candidates with a completed bachelor's degree, at least 10 years of relevant professional experience and a publication may also be considered.
 * Applicants must have completed their degrees and must not currently be enrolled in a degree program.
 * At least one academic or professional publication.
 * Practical comfort working in a Linux terminal.
 * Current residence in Argentina, Mexico, Puerto Rico, New Zealand, Canada, the United Kingdom, the United States, Australia, Peru, Colombia, Austria, Ireland, Spain, Luxembourg, Italy, France, Germany, Belgium, the Netherlands, Sweden, Finland, Singapore, Denmark, Norway and Switzerland.

## Description

Bring your expertise to the problems today's most advanced AI agents still struggle to solve.

We're looking for experienced systems engineering or hardware engineering professionals to develop challenging tasks for an AI benchmark. You'll draw on problems from your own field and turn them into clearly defined challenges that an AI agent must solve from scratch in a Linux terminal.

What you'll do

 * Identify difficult, meaningful problems in your area of expertise.
 * Translate those problems into tasks that can be solved in a Linux terminal.
 * Design challenges that expose limitations in advanced AI agents. Each task is tested against three leading models, with three attempts per model, and must prove difficult enough that the models mostly fail.