Data Observability Engineer

OpenKyber LLC
Atlanta, GA, United States
5 days ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours

Tech stack

Big Data C Sharp (Programming Language) Information Engineering Data Infrastructure Data Systems Distributed Systems Python (Programming Language) Linux System Administration Enterprise Messaging Systems RabbitMQ DataOps Software Engineering
+12 more
Data Logging Snowflake Backend Containerization Kubernetes Google Bigquery Apache Kafka Terraform Data Pipelines Docker Elk Stack Confluent

Job description

About the role: Looking for a Data Operations Engineer to support and optimize data infrastructure and pipeline operations across high-volume, distributed systems. This role focuses on ensuring reliability, scalability, and performance of data workflows while collaborating with engineering teams to maintain production-grade systems. Key Responsibilities

  • Build, maintain, and optimize scalable data pipelines for high-throughput applications
  • Support operational health of data systems, ensuring reliability and uptime
  • Develop and enhance backend services using C# and Python
  • Manage and query large datasets in Snowflake and Google BigQuery environments
  • Deploy and maintain containerized applications using Docker in Linux-based systems
  • Integrate and manage streaming/data messaging systems such as Kafka (Confluent) and RabbitMQ
  • Monitor pipeline performance, troubleshoot issues, and implement improvements
  • Collaborate with cross-functional teams to ensure smooth data operations and deployments, * Reliable, efficient data pipeline operations with minimal downtime
  • Improved observability and monitoring of data systems
  • Timely resolution of production issues and performance bottlenecks
  • Well-documented systems and processes for maintainability

Work Environment Fast-paced, engineering-driven culture Opportunity to work on modern data platforms and distributed systems For applications and inquiries, contact:hirings@openkyber.com

Requirements

  • 5+ years of experience in infrastructure and software engineering with exposure to data engineering and pipelines
  • Proficiency in C# and Python
  • Hands-on experience with Snowflake and/or Google BigQuery
  • Strong experience working in Linux/Unix environments and Docker
  • Experience building and maintaining data pipelines
  • Familiarity with distributed messaging systems such as Confluent Kafka or RabbitMQ
  • Ability to work independently in a remote environment while communicating effectively, * Experience with Elastic/ELK stack for logging and monitoring
  • Familiarity with Terraform for infrastructure as code
  • Experience with Kubernetes for container orchestration

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Loading talks and stories from around this role…