Data Observability Engineer

OpenKyber LLC
Atlanta, GA, United States
6 days ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Amazon Web Services Amazon Elastic Compute Cloud Amazon S3 Noise Reduction Log Shipping Online Transaction Processing Open Source Technology Prometheus DataOps Grafana Amazon Virtual Private Cloud (VPC) Kubernetes
+3 more
Cloudwatch Terraform Splunk

Job description

Sourcing Rationale: Observability pipeline design and implementation (OTel, Prometheus, Grafana, Splunk integration). The work involves deploying and configuring open-source and third-party tools on AWS infrastructure. Strong OTel and Kubernetes observability experience. Key Responsibilities

  • Design unified observability pipeline
  • Design cross-account log aggregation and noise reduction strategy
  • Implement OTel Collector, Prometheus, Grafana on Golden Cluster
  • Configure Splunk HEC integration and CloudTrail centralization
  • Enable VPC Flow Logs across all VPCs
  • Design and implement alerting framework
  • Build operational dashboards (Grafana and CloudWatch)
  • Design log retention strategy with S3 lifecycle policies
  • Deploy EC2 infrastructure for Splunk and Abbyy

Requirements

  • OpenTelemetry - Collector deployment, OTLP, processors, exporters
  • Prometheus - deployment, PromQL, ServiceMonitors
  • Grafana - dashboard development, data sources, SSO
  • CloudWatch - Logs, Metrics, Alarms, cross-account
  • CloudTrail - multi-account, organization trail
  • Splunk - HEC integration, log shipping
  • Alertmanager - routing, receivers
  • Terraform - observability stack modules
  • Log management at scale (TB/day) preferred

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Loading talks and stories from around this role…