Data Platform Engineer

Computer Enterprises, Inc.

Farmers Branch, TX, United States

3 months ago

Role details

Contract type

Temporary to permanent

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

5 years minimum

Compensation

$156,000.0

Working hours

Regular working hours

Job source

indeed.com

Tech stack

Airflow Apache HTTP Server Big Data Continuous Integration Data Infrastructure Data Systems DevOps Python (Programming Language) Open Source Technology OpenShift Standard Sql Apache Spark

+4 more

Kubernetes Presto Data Pipelines Docker

Job description

We are seeking a Senior Data Platform Engineer to design, build, deploy, and operate containerized data workloads supporting Apache Iceberg-based lakehouse architectures. This role focuses on engineering and operating data platform runtimes (Spark, Trino, Airflow) deployed on Red Hat OpenShift, partnering closely with platform, security, and infrastructure teams while remaining primarily focused on data workload enablement, not OpenShift administration. This is a hands-on senior role for an engineer comfortable owning production-grade data pipelines, query engines, and orchestration platforms in containerized enterprise environments., * Design, build, deploy, and operate containerized data workloads supporting Apache Iceberg-based lakehouse architectures

Focus on engineering and operating data platform runtimes (Spark, Trino, Airflow) deployed on Red Hat OpenShift
Partner closely with platform, security, and infrastructure teams
Own production-grade data pipelines, query engines, and orchestration platforms
Maintain and optimize data workloads in containerized enterprise environments, This position offers the opportunity to work on cutting-edge lakehouse architectures with Apache Iceberg, supporting large-scale data environments. You will be a key contributor in a dynamic team, driving innovative data solutions in a containerized enterprise setting.

Requirements

Do you have experience in Spark implementation?, * Apache Iceberg (at least 5 yrs)

CI/CD Pipeline Integration
Image Creation of open-source tools
Apache Spark
Trino/Presto
Apache Airflow
Docker
Helm
OpenShift/Kubernetes
Python
SQL
Soft Skills: Provide updates, follow-up, provide feedback, written and verbal communication, leader, self-starter, driven, * Experience with DevOps engineering and CI/CD pipelines
Strong collaboration skills within team environments
Ability to troubleshoot and optimize data workloads
Familiarity with enterprise security standards

Benefits & conditions

Pulled from the full job description

Health insurance
401(k) matching
Vision insurance
Dental insurance, * Contract: W2 only, 6-12 month contract with potential for extension or conversion to full time with either the client or CEI
Pay: $75/hour + optional medical, dental, vision, 401(k) match