Senior Data Engineer - EDA Datacenter Analytics and Observability

NVIDIA Ltd.
Austin, TX, United States
3 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$152,000.0 - $241,500.0
Working hours
Regular working hours
Job source

Tech stack

Data Analysis Computer Clusters Data Centers Information Engineering Data Retention Distributed Computing Environment Distributed Systems Python (Programming Language) Reliability Engineering Prometheus SQL Databases Systems Integration
+10 more
High Performance Computing Data Ingestion Grafana Apache Spark Reliability of Systems Information Technology Apache Kafka Data Management Hardware Infrastructure Data Pipelines

Job description

NVIDIA’s Hardware Infrastructure organization is seeking a Senior Data Engineer to build and evolve analytics-ready data platforms that power observability, reliability analysis, and capacity forecasting for EDA datacenters. In this role, you will focus on transforming large-scale observability and telemetry data into trusted, well-modeled datasets that enable data scientists, analysts, and engineers to drive insights across global CPU and GPU compute clusters. We work closely with observability, infrastructure, and data science teams to ensure that data from EDA workloads and datacenter hardware is high quality, accessible, and optimized for analytical and predictive use cases.

What You’ll Be Doing:

  • Design, build, and maintain analytics-focused data pipelines that ingest, transform, and curate observability data from EDA datacenters
  • Develop reliable ingestion pipelines for metrics, logs, traces, and hardware health telemetry generated by large-scale CPU and GPU clusters
  • Partner with observability engineers to integrate data from tools such as Prometheus, Grafana, Elastic/OpenSearch, and Spark-based platforms into unified analytical datasets
  • Model and organize data to support exploratory analysis, reliability modeling, forecasting, and long-term trend analysis
  • Build and optimize batch and streaming workflows that support both near-real-time analytics and historical analysis
  • Implement data quality checks, validation frameworks, and monitoring to ensure analytical accuracy and consistency
  • Define data retention, aggregation, and enrichment strategies that balance analysis needs, system performance, and storage costs
  • Enable self-service analytics by improving data discoverability, documentation, and usability
  • Collaborate with data scientists and analysts to understand analytical requirements and evolve datasets to support new models and insights
  • Continuously improve pipeline scalability, reliability, and performance as datacenter footprint and workload complexity grow

Requirements

Do you have experience in SQL?, Do you have a Bachelor’s degree?, * MS (preferred) or BS in Computer Science (or equivalent experience) or a related field with at least 5+ years of experience designing, building, and operating large-scale data pipelines and data platforms for distributed systems or infrastructure data

  • Proficiency in Python and SQL, with experience supporting analytical and exploratory workloads
  • Hands-on experience with distributed data processing frameworks such as Spark or similar technologies
  • Familiarity working with observability and telemetry data, including metrics, logs, traces, and time-series data
  • Experience designing data models and schemas that support flexible analysis and forecasting
  • Ability to take ownership of data engineering initiatives and drive them end-to-end in collaboration with multi-functional partners
  • Experience implementing data quality, validation, and monitoring for analytics pipelines
  • Strong communication and collaboration skills, particularly when collaborating with engineering and infrastructure teams
  • Adaptability in fast paced environments with evolving analytical and operational needs

Ways to Stand Out from the Crowd:

  • Experience supporting datacenter infrastructure analytics, hardware reliability programs, or workload performance analysis
  • Familiarity with EDA workflows, HPC environments, or GPU-accelerated compute platforms
  • Experience integrating or operating observability stacks (Prometheus, Grafana, Elastic/OpenSearch, Kafka, Spark, or similar tools)

Benefits & conditions

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

10:40 min

Visualizing Prometheus open metrics using custom Grafana dashboards

Stijn Polfliet · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

51 sec

Repurposing hardware and operating underwater data centers

Chris Heilmann +1 · LIVE

1:05 min

Measuring system availability utilizing Prometheus and straightforward PromQL

Alexander Schwartz Alexander Schwartz · WWC 2025

13:07 min

Configuring application observability with Micrometer and Prometheus

Aleksandr Kalikov · LIVE

4:47 min

Automating frontend performance metrics with Google Lighthouse

Miki Lombardi · JS Congress

Videos

See all

Related articles

See all