Software Engineer, OpenShell

NVIDIA Ltd.
United States
28 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Compensation
$184,000.0 - $287,500.0
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Audit Trail Data Retention Programming Tools Open Source Technology Performance Tuning Software Engineering Enterprise Software Applications Large Language Models Multi-Agent Systems Kubernetes Information Technology
+5 more
Free and Open-Source Software Machine Learning Operations TensorRT Virtual Agents Data Generation

Job description

Are you ready to translate groundbreaking AI research into secure, production-grade systems? Want to shape the next generation of AI agent infrastructure? Join us!

At NVIDIA OpenShell, we are building the runtime infrastructure for secure, scalable, production-grade AI agents. As an OpenShell Research Engineer, we will look to you to help bring the latest advances in agentic systems into the runtime, tools, and workflows that enterprise builders rely on.

This role sits at the intersection of research, product, and engineering. We expect you to identify promising methods from academia, industry, open source, and internal NVIDIA research, understand where they matter for OpenShell, validate their impact through hands-on prototypes, benchmarks, and real agent workflows, and help us integrate the best ideas into the product.

What You’ll be Doing:

  • Track the cutting edge: How are agentic systems evolving? You’ll follow research in tool use, planning, memory, evaluation, self-improvement, multi-agent workflows, runtime infrastructure, and agent safety/security.
  • Bridge research and product: Identify research ideas that can meaningfully improve OpenShell and translate them into concrete product opportunities.
  • Benchmark and adapt: Reproduce and test promising methods from papers, open-source projects, industry work, and internal NVIDIA research.
  • Build rapid prototypes: Create hands-on proof-of-concepts using OpenShell, including agent harnesses, evaluation loops, self-improving workflows, and runtime-native developer experiences.
  • Red-team systems: Design evaluation and red-team harnesses that measure agent reliability, usefulness, scalability, safety, security, and developer experience.
  • Secure the workflow: Help us design secure-by-default workflows for agents operating with tools, code, files, credentials, and enterprise systems.
  • Partner across teams: Collaborate closely with engineering, product, design, research, solutions, and developer-facing teams to move ideas from prototype to product.

Requirements

  • 8+ years of professional practical experience in research engineering, software development, or a related technical field
  • MS/PhD in Computer Science, Physics, or a related field or equivalent experience
  • A strong background in turning complex research into reusable products, tools, demos, benchmarks, or production systems at scale.
  • Deep experience in several of the following: LLMs, agent harnesses, multimodal generative models, evaluation frameworks, synthetic data generation, post-training, inference infrastructure/optimization, adversarial ML, or agent safety/security.
  • Demonstrated ability to drive independent technical investigation: survey relevant work, run experiments, form a clear point of view, and communicate findings clearly.
  • Strong product sense and care for UX and AX: tools should be intuitive for developers and ergonomic for agents.
  • A focus on real-world impact: we want research to become enterprise capabilities, reference implementations, developer workflows, or product improvements.
  • Outstanding team orientation and comfort collaborating across research, engineering, product, design, solutions, and developer-facing teams.

Ways to stand out from the crowd:

  • Experience with secure agent runtimes, tool sandboxing, capability-based security, or enterprise policy systems.
  • Experience with compliance or enterprise governance requirements such as auditability, data retention, access control, SOC2, HIPAA, GDPR, or regulated deployment environments.
  • Experience with LLM inference infrastructure, model serving, or inference optimization using tools such as Triton, TensorRT-LLM, vLLM, SGLang, Ray, Kubernetes, or cloud GPU platforms.
  • Experience integrating inference backends into agentic systems, including routing across models, tool-aware context management, streaming, structured outputs, retries, monitoring, and cost/performance optimization.
  • Experience developing or maintaining open-source software in AI agents, LLM systems, developer tooling, ML infrastructure, model serving, or related areas.

Benefits & conditions

4.24.2 out of 5 stars Remote $184,000 - $287,500 a year - Full-time, Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD.

About the company

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people on the planet working for us. If you’re creative, passionate and self-motivated, we want to hear from you! NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:14 min

Exploring internal AI product initiatives and global engineering roles

Maria Apazoglou · Coffee With Developers

3:56 min

Leveraging GitOps for AI auditing and instant rollbacks

Jaroslaw Gajewski Jaroslaw Gajewski · WWC Europe 2026

2:28 min

Understanding Kubernetes architecture and core cluster components

Marc Nimmerrichter · WWC 2022

4:52 min

Essential phases in building and refining language models

Anshul Jindal Anshul Jindal +1 · WWC 2025

2:15 min

Open-source community and machine learning frameworks

Gian Marco Iodice Gian Marco Iodice · WWC 2025

1:09 min

Managing enterprise execution with the Operate runtime

Marcin Makowski Marcin Makowski · WWC Europe 2026

Videos

See all

Related articles

See all