> Markdown version of [/jobs/ext/4635567-senior-system-software-engineer-llm](https://www.wearedevelopers.com/jobs/ext/4635567-senior-system-software-engineer-llm). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior System Software Engineer, LLM

- **Company:** NVIDIA Ltd.
- **Location:** New York, NY, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Agile Methodology, Amazon Web Services, Unit Testing, Microsoft Azure, Software Debugging, Python (Programming Language), Cloud Services, Software Engineering, System Software, Google Cloud, Large Language Models, NeMo Guardrails, Information Technology, Free and Open-Source Software, Restful APIs, Oracle Cloud Infrastructure, Programming Languages
- **Published:** November 8, 2026
- **Apply:** https://www.juju.com/job/28_25303_7d207e06bd8b14dff4c263eff08c9f9b

## About the Role

* BS or MS (or equivalent experience) in Computer Science, Electrical Engineering, or a related field
 * 5+ years of software development experience
 * Strong software engineering and Python programming skills
 * Knowledge of RESTful APIs
 * Proficient in agile methodology
 * Experience in software shipping cycles (dev, deploy, release, CI) and open-source software development
 * You are highly motivated, passionate and curious about new technologies
 * Ability to work optimally with multi-functional teams, principals and architects. Coordinates across organizational boundaries and geographies.

Ways to stand out from the crowd

 * Research or product development experience with task-oriented dialogue systems
 * Experience with programming language design and development
 * Systems software engineering knowledge and expertise in optimizing software for computational performance
 * Experience with Cloud Service Providers such as AWS, Azure, GCP, and OCI
 * Contributions to open-source software

## Description

* Work closely with senior engineers to deliver, optimize, maintain, debug, unit test and document next-generation dialogue and security toolkits for large language models
 * Tackle difficult and ambitious problems by contributing to the core development of NeMo Guardrails and Colang
 * Deliver rapid iterations of software based on user feedback and metrics
 * Collaborate with your peers and other teams to craft, develop, test, and maintain integrated applications and features
 * Actively contribute to the adoption of frameworks, standards, and new technologies