SRE - Observability

The Site Reliability Engineer will deploy, automate, and support a production-grade observability platform used across facility endpoints. This role will work closely with the observability product owner, application teams, system owners, and platform engineers to deploy Grafana Alloy agents, build telemetry configuration pipelines, and operate the Grafana observability stack. The SRE will also contribute to Kubernetes, infrastructure-as-code, CI/CD, and field-deployment automation in an environment supporting facility and operational technology systems., Project Description & Tech Stack: Deploy and manage Grafana Alloy agents across facility endpoints and build the configuration pipelines used to deliver agent and telemetry settings. Partner with application and system owners to define required metrics, logs, and traces. Operate and extend Grafana, Loki, Mimir, and Tempo while supporting Kubernetes clusters running on bare metal and managed through SUSE Rancher. The environment is transitioning from VMware to Harvester and includes telemetry from facility and operational technology systems over local networks. Tools and technologies include Grafana Alloy, Grafana, Loki, Mimir, Tempo, Prometheus, OpenTelemetry, Kubernetes, SUSE Rancher, Harvester, VMware, Terraform, Ansible, Helm, GitOps, CI/CD, Python, Go, and Bash.

Project Goal / Current Phase: Move the observability platform from staging into production by deploying Grafana Alloy across facility endpoints, establishing repeatable configuration delivery, defining telemetry requirements, and improving the reliability, scalability, and operational readiness of the platform. Project Type: Observability platform implementation, telemetry-agent deployment, configuration automation, on-premises Kubernetes support, infrastructure as code, CI/CD, field-deployment automation, and production support. Must Haves

• 5+ years of experience in SRE, DevOps, platform engineering, or infrastructure engineering
• Hands-on experience deploying and managing telemetry or collection agents at scale, including Grafana Alloy, Grafana Agent, OpenTelemetry Collector, Prometheus exporters, or similar technologies
• Experience operating Kubernetes on premises, including bare-metal or VMware-based environments
• Strong infrastructure-as-code and automation experience using Terraform, Ansible, Helm, GitOps, or similar tools
• Experience developing automation using Python, Go, Bash, or another scripting language
• Experience building and maintaining configuration pipelines for agent, infrastructure, or application deployments
• Experience implementing and supporting metrics, logs, traces, dashboards, and alerting
• Experience building or supporting CI/CD pipelines and automated deployment workflows
• Demonstrated ability to take ownership of an incomplete or stalled project and move it into production with minimal direction
• Strong production troubleshooting and problem-solving skills
• Experience collaborating with application owners, system owners, and platform teams to define monitoring and telemetry requirements
• Strong communication and cross-functional collaboration skills

Desired Skills

• Direct experience with Grafana Alloy or Grafana Agent
• Experience operating Grafana, Loki, Mimir, and Tempo
• Experience with SUSE Rancher, RKE, or RKE2
• Experience with Harvester, KubeVirt, VMware migrations, or Kubernetes-based virtualization
• Experience collecting telemetry from SNMP devices, Modbus systems, PLCs, BMS, DCIM, power systems, or environmental systems
• Experience in data center, utility, manufacturing, industrial, or other facility-heavy environments
• Experience supporting hybrid Azure and/or AWS environments
• Experience defining SLIs, SLOs, alerting standards, on-call procedures, and platform reliability practices

Experience Matters. Let your experience be driven by our experience. For more than 40 years, Matlen Silver has delivered solutions for complex talent and technology needs to Fortune 500 companies and industry leaders. Led by hard work, honesty, and a trusted team of experts, we can say that Matlen Silver technology has created a solutions experience and legacy of success that is the difference in the way the world works.