> Markdown version of [/jobs/ext/2271424-senior-software-engineer-nim-model-customization](https://www.wearedevelopers.com/jobs/ext/2271424-senior-software-engineer-nim-model-customization). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Software Engineer, NIM Model Customization

- **Company:** NVIDIA Corporation
- **Location:** Santa Clara, CA, United States
- **Experience:** Expert
- **Salary:** $184,000.0 - $287,500.0
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Open Source Technology, Reinforcement Learning, Large Language Models, Information Technology, Nim (Programming Language)
- **Published:** August 27, 2026
- **Apply:** https://nvidia.wd5.myworkdayjobs.com/NVIDIAExternalCareerSite/job/US-CA-Santa-Clara/Senior-Software-Engineer--NIM-Tools_JR2023423

## About the Role

* Bachelor's degree in Computer Science, Engineering, or equivalent experience.
 * Experience in utilizing model customization tools: LoRA, QLoRA, supervised fine-tuning (SFT), reinforcement learning (RL), preference optimization (e.g., DPO), and retrieval-augmented generation (RAG)
 * 7+ years of experience with LLM serving infrastructure (vLLM, TRT-LLM, or equivalent).
 * Deep understanding of model quantization and fine-tuning workflows.
 * Demonstrated history of developing robust platform APIs.
 * Strong collaborative skills and experience working in cross-functional teams.
 * Outstanding problem-solving skills and meticulous attention to detail.

Ways to stand out from the crowd:

 * Experience with large-scale deployment of AI models.
 * Familiarity with compliance and audit processes for AI models.
 * Contributions to open-source AI projects.
 * Strong publication record in relevant fields.
 * Excellent communication skills and a passion for mentorship.

## Description

As a Senior Software Engineer, NIM Tools, you will have the remarkable opportunity to build a groundbreaking model customization and deployment lifecycle platform from inception. This isn't just another feature team-you will be defining the structure for a new product surface accessed by ISVs and CSPs internationally. Your work will empower customers to take models from selection through fine-tuning, evaluation, deployment, and compliance flawlessly.

What you'll be doing:

 * Compose and build the fine-tuning handoff pipeline, including LoRA adapter repackaging, re-quantization, and re-validation into NIM.
 * Develop the evaluation harness, ensuring models meet our high standards.
 * Implement the observability and attestation layer to produce auditable compliance artifacts.
 * Work in close partnership with ISVs and CSPs to roll out NVIDIA NIMs on a large scale.
 * Define and improve durable platform APIs, steering clear of one-off integrations.
 * Ensure flawless completion of projects through strict attention to detail and proven methodologies.


## Related Videos

- [Nemotron: NVIDIA's open model strategy for developers](https://www.wearedevelopers.com/videos/100064-nemotron-nvidia-s-open-model-strategy-for-developers)
- [Creating Industry ready solutions with LLM Models](https://www.wearedevelopers.com/videos/899-creating-industry-ready-solutions-with-llm-models)
- [On the straight and narrow path - How to get cars to drive themselves using reinforcement learning and trajectory optimization](https://www.wearedevelopers.com/videos/205-on-the-straight-and-narrow-path-how-to-get-cars-to-drive-themselves-using-reinforcement-learning-and-trajectory-optimization)
- [Embracing the Hybrid Cloud: Unlocking Success with Open Source Technologies](https://www.wearedevelopers.com/videos/883-embracing-the-hybrid-cloud-unlocking-success-with-open-source-technologies)
- [Adding knowledge to open-source LLMs](https://www.wearedevelopers.com/videos/1522-adding-knowledge-to-open-source-llms)
- [LLMOps-driven fine-tuning, evaluation, and inference with NVIDIA NIM & NeMo Microservices](https://www.wearedevelopers.com/videos/1582-llmops-driven-fine-tuning-evaluation-and-inference-with-nvidia-nim-nemo-microservices)

## Related Articles

- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [The Best Large Language Models on The Market](https://www.wearedevelopers.com/magazine/319-the-best-large-language-models-on-the-market)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)