Remote

Calix
San Francisco Bay Area, CA, United States
about 2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Compensation
$136,000.0 - $266,000.0
Working hours
Regular working hours

Tech stack

Artificial Intelligence Application Layers Border Gateway Protocol Big Data BigQuery Cloud Computing Computer Programming Network Congestion Data Infrastructure Data Integration Data Transport Utility Software Debugging
+30 more
Disaster Recovery Distributed Systems Domain Name System (DNS) Identity and Access Management OSI Models Python (Programming Language) Transport Layer PostgreSQL Linux Kernel Machine Learning Network Architecture Routing Packet Analyzer Open Shortest Path First (OSPF) Prometheus Session Management Data Streaming Transmission Control Protocol (TCP) Wireshark Network Switches Computer Networking Systems Google Cloud System Availability Grafana Containerization Kubernetes Low Latency Hashicorp Apache Kafka Terraform

Job description

We are seeking a Staff Site Reliability Engineer (SRE) to lead our global platform reliability and drive our next-generation observability strategy on Google Cloud Platform (GCP). In this role, you will leverage Grafana Labs’ complete telemetry stack and AIOps methodologies to build intelligent, self-healing infrastructure. You will bring deep expertise in scaling enterprise-grade Google Kubernetes Engine (GKE) topologies, managing high-throughput Kafka event streams, and maintaining high-performance PostgreSQL, AlloyDB, and BigQuery ecosystems at massive scale. Crucially, you will provide deep technical leadership across the entire networking stack, diagnosing complex issues from physical-layer transport up to application-layer protocols., * Full-Stack Network Architecture: Architect, optimize, and troubleshoot complex networking infrastructure spanning Layer 1 through Layer 7, ensuring low-latency data transport, secure edge routing, and seamless service mesh integration.

  • Grafana Stack Architecture: Design, scale, and optimize our unified observability platform using the Grafana Labs suite (Grafana, Mimir, Loki, Tempo, and Beyla).

  • AIOps & Intelligent Alerting: Deploy machine learning models and automated anomaly detection to cut through telemetry noise, reduce alert fatigue, and predict network or data pipeline bottlenecks.

  • GKE Platform Engineering: Drive the architecture, scaling, security, and networking of production Google Kubernetes Engine (GKE) clusters.

  • Data & Event Streaming Reliability: Tune, and maintain high-throughput Apache Kafka clusters to guarantee low-latency event delivery and high availability.

  • Large-Scale Database Management: Ensure the performance, scalability, and disaster recovery readiness of our transactional and analytical data tiers across PostgreSQL, AlloyDB, and BigQuery.

  • Automated Incident Response: Integrate AIOps insights with Grafana workflows to automate triage, accelerate root-cause analysis, and trigger auto-remediation scripts.

  • Technical Leadership: Champion the long-term technical roadmap for distributed infrastructure engineering and GCP cloud-native observability standards.

  • Mentorship: Coach senior and junior engineers on advanced debugging techniques, distributed systems thinking, and intelligent operations across a distributed workforce.

Requirements

  • Location/Work Style: Proven track record of high autonomy and successful delivery in a 100% remote engineering environment.

  • Experience: 8+ years in SRE, Production Engineering, or Distributed Systems infrastructure roles.

  • Networking Expertise (L1-L7): Deep technical knowledge and debugging mastery across all OSI layers, including:

  • L1-L3: Physical/fiber infrastructure awareness, switching, and advanced routing protocols (BGP, OSPF).

  • L4: Transport layer tuning (TCP congestion control algorithms, UDP, QUIC).

  • L5-L7: Session management, TLS termination, DNS architecture, and advanced application protocols (HTTP/3, gRPC).

  • Orchestration & Containerization: Expert-level mastery of Google Kubernetes Engine (GKE) internals, custom controllers, multi-cluster networking, and GitOps workflows.

  • Data Infrastructure: Proven track record managing high-throughput Apache Kafka pipelines and large-scale data environments across PostgreSQL, AlloyDB, and BigQuery.

  • Grafana Ecosystem: Deep, hands-on experience deploying and managing Grafana Enterprise/Cloud, Prometheus/Mimir, Loki, and Tempo at scale.

  • AIOps Implementation: Track record applying AI/ML techniques for time-series anomaly detection, log clustering, and correlation (e.g., Grafana Adaptive Metrics, BigPanda).

  • Infrastructure as Code: Advanced, production-scale expertise utilizing HashiCorp Terraform exclusively to provision and manage multi-region GCP cloud architectures.

  • Programming: High proficiency in Go and Python for building custom infrastructure tooling, Kubernetes operators, and data integration scripts.

Preferred Attributes

  • Remote Communicator: Exceptional written and verbal communication skills, with an emphasis on creating clear documentation for asynchronous alignment.

  • GCP Expert: Deep knowledge of Google Cloud architectural best practices, Cloud SDN, Cloud Armor, Interconnect, Identity and Access Management (IAM), and cost optimization.

  • Systems Thinker: Deep understanding of Linux internals, eBPF-based monitoring, kernel-level networking, and packet analysis tools (Wireshark, tcpdump).

Benefits & conditions

This position is 100% fully remote. You can work from anywhere in the United States or Canada with a reliable internet connection, collaborating with a distributed engineering organization across multiple time zones.

About the company

Lead global platform reliability and observability on GCP. Architect full-stack networking (L1-L7), scale GKE, manage high-throughput Kafka pipelines, and maintain PostgreSQL/AlloyDB/BigQuery. Deploy Grafana telemetry stack and AIOps for intelligent alerting and automated incident response. Provide technical leadership, roadmap ownership, and mentor engineers in distributed systems and observability best practices. The summary above was generated by AI The Calix platform enables Communication Service Providers (CSPs) of all sizes to transform and future-proof their businesses. Through real-time data, automation, and actionable insights delivered via Calix One - our cloud-first, AI-powered platform - CSPs can simplify operations, collapse cost, and accelerate innovation. Calix One brings together the automation of everything and the experience of one, empowering customers to deliver differentiated subscriber experiences while driving acquisition, loyalty, and revenue growth. This is the Calix mission: to enable CSPs of all sizes to simplify, innovate, and grow, strengthening both their businesses and the communities they serve. We’re at the forefront of a once in a generational change in the broadband industry. Join us as we innovate, help our customers reach their potential, and connect underserved communities with unrivaled digital experiences.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on builtincolorado.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:04 min

Enhancing network privacy with routing fees and onion routing

Andreas M Antonopoulos · LIVE

10:40 min

Visualizing Prometheus open metrics using custom Grafana dashboards

Stijn Polfliet · LIVE

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

1:20 min

Identifying multi-disciplinary talent for developer experience engineering roles

Hazal Mestci +1 · Coffee With Developers

1:51 min

Overview of the three Google Maps routing applications

Germán Álvarez · LIVE

4:18 min

Prioritizing communication and structural awareness over strict tool mastery

Liam Hurrel +1 · WWC 2021

Videos

See all

Related articles

See all