> Markdown version of [/jobs/ext/4484340-senior-ai-and-hpc-observability-engineer](https://www.wearedevelopers.com/jobs/ext/4484340-senior-ai-and-hpc-observability-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior AI and HPC Observability Engineer

- **Company:** NVIDIA Corporation
- **Location:** Santa Clara, CA, United States
- **Experience:** Expert
- **Salary:** $152,000 - $241,500
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Artificial Intelligence, Software Code Optimization, Computer Programming, Computer Engineering, Information Engineering, Data Infrastructure, Software Debugging, Distributed Data Store, Distributed Systems, Fault Tolerance, Python (Programming Language), Machine Learning, Performance Tuning, Reliability Engineering, Prometheus, Cloud Platform System, High Performance Computing, Concurrency, Apache Spark, Backend, Kubernetes, Information Technology, Apache Flink, Apache Kafka, Machine Learning Operations
- **Published:** October 31, 2026
- **Apply:** https://nvidia.wd5.myworkdayjobs.com/NVIDIAExternalCareerSite/job/US-CA-Santa-Clara/Senior-AI-and-HPC-Observability-Engineer_JR2013994

## About the Role

* Bachelor's degree in Computer Science, Computer Engineering, or related field or equivalent experience
 * 5+ years of experience building backend or distributed systems in production environments
 * Strong programming skills in Python, Go, or Java, with experience developing production-quality software
 * Hands-on experience with modern observability architectures, including metrics, logs, and traces
 * Solid experience with PromQL and time-series data systems
 * Experience building or operating distributed data pipelines using technologies such as Kafka, Spark, or Flink
 * Experience working with Kubernetes and cloud-native infrastructure
 * Strong understanding of distributed systems, concurrency, and fault-tolerant system design. Strong debugging, performance tuning, and production operations skills, * Proven experience designing and scaling observability platforms for AI, GPU, or HPC environments
 * Hands-on expertise with OpenTelemetry, Prometheus, Kafka, and high-volume distributed telemetry pipelines
 * Strong background in data engineering, time-series data modeling, and real-time performance tuning
 * Experience integrating observability with AI/ML pipelines, GPU workload monitoring, or intelligent alerting
 * Demonstrated use of statistical or machine learning techniques for anomaly detection, correlation, or predictive insights

## Description

Observability is at the heart of this transformation. We are looking for a strong AI & HPC Observability Engineer to build and scale next-generation Observability and Telemetry platforms. You will design and develop high-throughput, reliable telemetry pipelines and modern data infrastructure. This role requires solid distributed systems fundamentals, production-grade coding, and a passion for operational excellence.

What You Will Be Doing:

 * Design and scale observability platforms handling high-volume metrics, logs, and traces across distributed environments
 * Build high-performance backend services for telemetry ingestion, processing, and routing
 * Develop and extend OpenTelemetry collectors, processors, exporters, and instrumentation libraries
 * Build and optimize metrics pipelines using large-scale time-series storage systems
 * Design and operate real-time and batch telemetry pipelines using streaming and distributed data technologies
 * Improve platform reliability, performance, and cost efficiency through tuning, capacity planning, and system optimization
 * Develop monitoring, alerting, and service reliability frameworks to ensure platform health and performance
 * Collaborate with platform engineering, infrastructure, and site reliability teams to deliver production-grade observability solutions