Data Platform Engineer

Computer Enterprises, Inc.
Farmers Branch, United States of America
20 days ago

Role details

Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 156K

Job location

Farmers Branch, United States of America

Tech stack

Airflow
Apache HTTP Server
Big Data
Continuous Integration
Data Infrastructure
Data Systems
DevOps
Python
Open Source Technology
Openshift
Standard Sql
Spark
Kubernetes
Presto
Data Pipelines
Docker

Job description

We are seeking a Senior Data Platform Engineer to design, build, deploy, and operate containerized data workloads supporting Apache Iceberg-based lakehouse architectures. This role focuses on engineering and operating data platform runtimes (Spark, Trino, Airflow) deployed on Red Hat OpenShift, partnering closely with platform, security, and infrastructure teams while remaining primarily focused on data workload enablement, not OpenShift administration. This is a hands-on senior role for an engineer comfortable owning production-grade data pipelines, query engines, and orchestration platforms in containerized enterprise environments., * Design, build, deploy, and operate containerized data workloads supporting Apache Iceberg-based lakehouse architectures

  • Focus on engineering and operating data platform runtimes (Spark, Trino, Airflow) deployed on Red Hat OpenShift
  • Partner closely with platform, security, and infrastructure teams
  • Own production-grade data pipelines, query engines, and orchestration platforms
  • Maintain and optimize data workloads in containerized enterprise environments, This position offers the opportunity to work on cutting-edge lakehouse architectures with Apache Iceberg, supporting large-scale data environments. You will be a key contributor in a dynamic team, driving innovative data solutions in a containerized enterprise setting.

Requirements

Do you have experience in Spark implementation?, * Apache Iceberg (at least 5 yrs)

  • CI/CD Pipeline Integration
  • Image Creation of open-source tools
  • Apache Spark
  • Trino/Presto
  • Apache Airflow
  • Docker
  • Helm
  • OpenShift/Kubernetes
  • Python
  • SQL
  • Soft Skills: Provide updates, follow-up, provide feedback, written and verbal communication, leader, self-starter, driven, * Experience with DevOps engineering and CI/CD pipelines
  • Strong collaboration skills within team environments
  • Ability to troubleshoot and optimize data workloads
  • Familiarity with enterprise security standards

Benefits & conditions

Pulled from the full job description

  • Health insurance
  • 401(k) matching
  • Vision insurance
  • Dental insurance, * Contract: W2 only, 6-12 month contract with potential for extension or conversion to full time with either the client or CEI
  • Pay: $75/hour + optional medical, dental, vision, 401(k) match

Apply for this position