AI Researcher - Reinforcement Learning

1X, LLC
San Carlos, CA, United States
about 2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
$200,000.0 - $300,000.0
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence C++ (Programming Language) Information Engineering Python (Programming Language) Reinforcement Learning Pytorch Build Tools Codebase

Job description

  • Train and deploy RL policies for manipulation and locomotion tasks that perform reliably in real-world home environments measured by field task success rates, not just simulation benchmarks
  • Advance sim-to-real transfer techniques that measurably narrow the gap between simulation training performance and real-world policy behavior, enabling faster iteration cycles
  • Build training and evaluation infrastructure that lets the team iterate on policies faster with standardized benchmarks, automated regression detection, and clear connections between training metrics and field performance
  • Partner with hardware, controls, data, and QA teams to ship RL-trained skills to production customer sites, owning the handoff from research to deployment

Key Competencies

  • Sim-to-real practitioner closing the sim-to-real gap on physical systems; understands domain randomization, reward shaping, and the engineering required to make simulated policies transfer reliably to real hardware
  • RL algorithms depth with strong foundation in RL algorithms (PPO, SAC, TD-MPC, or similar); can choose the right approach for the task and modify or extend it when standard methods fall short
  • Full-stack ownership owning data engineering, model architecture, and deployment; treats a promising training curve as the beginning of the job, not the end
  • Effective cross-functional partner working closely with hardware, controls, QA, and data teams to translate RL research into deployed robot skills, and communicates technical constraints clearly across disciplines

Requirements

Do you have experience in Simulated training environment?, * Strong Python and/or C++ with experience in large codebases and build tools (Bazel or equivalent)

  • Proficiency with PyTorch for RL policy training and experimentation
  • Hands-on experience with simulation platforms (Isaac Sim, MuJoCo, or equivalent) for policy training at scale
  • Demonstrated experience training RL policies for manipulation or locomotion tasks, including addressing the sim-to-real gap on physical hardware
  • Preferred Skills
  • Experience with model-based RL or world-model-guided policy learning that leverages predictive models to improve sample efficiency
  • Familiarity with imitation learning or learning from demonstration (behavior cloning, GAIL, IQL) as a complement or bootstrap to RL
  • Experience deploying RL-trained policies to physical robots in production environments, including monitoring, failure analysis, and iterative improvement
  • Background in legged locomotion, dexterous manipulation, or contact-rich control for physical systems

Benefits & conditions

Pulled from the full job description

  • Parental leave
  • Health insurance
  • 401(k) matching
  • Paid time off
  • Vision insurance
  • Health savings account
  • Dental insurance, * Comprehensive medical, dental, and vision coverage
  • Generous paid time off, company holidays, and parental leave
  • 401(k) plan with company match (100% on the first 3% of contributions, 50% on the next 2%)
  • Flexible Spending Accounts (FSA) and Health Savings Accounts (HSA) options
  • Commuter benefits (transit and parking)
  • Short-term and long-term disability, and life insurance
  • Employee Assistance Program (EAP) for mental health, financial, and personal support
  • Onsite snacks and catered lunches, Compensation Range: $200K - $300K

About the company

We’re building humanoid robots that work in home - doing the chores, handling the tasks, and giving people their time back. Simple, but it’s not.

To do this right, we have to solve robotics, AI, manufacturing - at the same time, at scale, in a form factor that has to be safe enough to live with your family. If you’re inspired by this, you’ll thrive here. We’ve been at this since 2014 and we’re at the point where the hard problems are behind us and the hard work is in front of us.

NEO is our flagship - a home robot designed to move, learn, and operate in the real world alongside real people. We’re not demoing it - we’re shipping it. We’re excited to meet you, if this excites you.

If you’ve spent your career working on problems that matter and want to see them actually reach the world - this is that moment. We’re scaling, we’re hiring with intention, and we need people who want to build something that will genuinely change how humans spend their time - safely creating abundance for all., Own the full pipeline from RL algorithm development through production deployment-training NEO on manipulation and locomotion tasks in simulation, closing the sim-to-real gap, and shipping policies that work reliably in real-world home environments. This is critical-path work: the range of tasks NEO can perform safely and reliably is a direct function of the quality of RL policies your team ships. You will collaborate closely with hardware, controls, data collection, and QA teams, and measure your impact by what NEO can do in the field.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:57 min

Advancing simulated reinforcement learning for diverse physical environments

Clemens Wasner Clemens Wasner +3 · WWC Europe 2026

2:35 min

Preventing remote code execution in PyTorch models

Balázs Kiss · WWC 2023

3:34 min

Augmenting codebases with semantic architectures

Zaak Chalal Zaak Chalal · WWC Europe 2026

48 sec

Exploring alternative build tools and experimental web components

Sasha Shynkevich · LIVE

2:03 min

Performing targeted reinforcement learning using specialized simulated laboratory gyms

Sergio Perez Sergio Perez · WWC Europe 2026

1:06 min

Compiling PyTorch environments for advanced time forecasting

Christoph Lohrmann Christoph Lohrmann +1 · WWC Europe 2026

Videos

See all

Related articles

See all