Observability & Scale Engineer

Kyndryl, Inc.
Frisco, TX, United States
3 days ago
Apply on www.techcareers.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
4 years minimum
Compensation
$115,080 - $218,520
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Cloud Computing InfiniBand Reliability Engineering Prometheus AI Infrastructure Datadog Graphics Processing Unit (GPU) Grafana Kubernetes Slurm
+2 more
Splunk Dynatrace

Job description

Accountable for operational visibility and capacity planning across the full service stack. Gives leadership early warning of reliability and capacity risk and the evidence needed to optimize costly AI infrastructure and plan expansion., * Design a common telemetry model spanning power, cooling, compute, GPU, NVLink, network, storage, Kubernetes, scheduler, workload, and service layers.

  • Implement and maintain DCGM or equivalent GPU telemetry, Prometheus, Grafana, vendor management telemetry, log pipelines, and enterprise observability integration.
  • Monitor health, ECC conditions, throttling, thermals, link state, retransmissions, congestion, queue depth, storage latency, workload demand, and service SLOs.
  • Build topology-aware dashboards, alerts, dependency views, baseline reports, and operational or executive scorecards.
  • Baseline idle, steady-state, peak, degraded, and recovery conditions and correlate GPU utilization with CPU, memory, network, storage, queue, and application demand.
  • Define evidence-based thresholds and reduce false positives through tuning, suppression, routing, and contextual enrichment.
  • Forecast GPUs, fabric ports, storage bandwidth, rack power, cooling, scheduler demand, and expansion triggers.
  • Identify stranded capacity, bottlenecks, noisy-neighbor conditions, low utilization, and workload-placement inefficiency and recommend corrective action..

Requirements

  • 4+ years in observability, performance engineering, capacity management, SRE, or infrastructure analytics.
  • Hands-on Prometheus, Grafana, time-series data, APIs, dashboarding, and alert engineering.
  • Ability to translate telemetry into operational, performance, and investment recommendations.

Preferred Skills

  • NVIDIA DCGM, NVIDIA Run:ai, NCCL performance, UFM, and Spectrum-X or InfiniBand telemetry.
  • NVIDIA GPU utilization and workload-efficiency analysis, topology-aware monitoring, and AI capacity modeling.
  • Cloud observability, HPC performance engineering, network telemetry, storage analytics, or enterprise capacity management.
  • OpenTelemetry, Elastic, Splunk, Datadog, Dynatrace, VictoriaMetrics, Thanos, or comparable platforms.
  • Slurm accounting, Kubernetes metrics, FinOps, or infrastructure demand forecasting.
  • SRE, observability platform, or cloud-native credentials.

Benefits & conditions

The compensation range for the position in the U.S. is - $115,080 to $218,520 based on a full-time schedule. Your actual compensation may vary depending on your geography, job-related skills and experience. For part time roles, the compensation will be adjusted appropriately. The pay or salary range will not be below any applicable state, city or local minimum wage requirement. There is a different applicable compensation range for the following work locations:

California (San Francisco Bay Area): $138,120 to $262,320

California (All Other): $126,600 to $240,480

Colorado: $115,080 to $218,520

Massachusetts $115,080 to $240,480, This position will be eligible for Kyndryl’s discretionary annual bonus program, based on performance and subject to the terms of Kyndryl’s applicable plans. You may also receive a comprehensive benefits package which includes medical and dental coverage, disability, retirement benefits, paid leave, and paid time off.

Note: If this is a sales commission eligible role, you will be eligible to participate in a sales commission plan in lieu of the annual discretionary bonus program.

About the company

At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward - always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities., Diversity is a whole lot more than what we look like or where we come from, it’s how we think and who we are. We welcome people of all cultures, backgrounds, and experiences. But we’re not doing it single-handily: Our Kyndryl Inclusion Networks are only one of many ways we create a workplace where all Kyndryls can find and provide support and advice. This dedication to welcoming everyone into our company means that Kyndryl gives you - and everyone next to you - the ability to bring your whole self to work, individually and collectively, and support the activation of our equitable culture. That’s the Kyndryl Way.

What You Can Expect

With state-of-the-art resources and Fortune 100 clients, every day is an opportunity to innovate, build new capabilities, new relationships, new processes, and new value. Kyndryl cares about your well-being and prides itself on offering benefits that give you choice, reflect the diversity of our employees and support you and your family through the moments that matter - wherever you are in your life journey. Our employee learning programs give you access to the best learning in the industry to receive certifications, including Microsoft, Google, Amazon, Skillsoft, and many more. Through our company-wide volunteering and giving platform, you can donate, start fundraisers, volunteer, and search over 2 million non-profit organizations. At Kyndryl, we invest heavily in you, we want you to succeed so that together, we will all succeed., At Kyndryl, we achieve progress the world depends on, with purpose. Beginning with the purpose that matters to you . Because here, you will be part of a culture designed with purpose. One that is restless, empathetic and devoted. Where we are committed to sustainable progress for our customers and supporting the communities where we work and live. All of you is what we want. And what we need. Join us, and together, we can advance the vital systems that power human progress.

Kyndryl is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, age, veteran status, or other characteristics. Kyndryl is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.techcareers.com
Prepare application

Good distractions

Loading talks and stories from around this role…