Data Platform Engineer

Insight Global
Austin, TX, United States
about 1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
2 years minimum
Compensation
$85,280.0 - $106,080.0
Working hours
Regular working hours

Tech stack

Java (Programming Language) Airflow Amazon Web Services Big Data Cloud Computing Continuous Integration Data Infrastructure Distributed Data Store Hadoop Distributed File System Python (Programming Language) Cloud Services Jupyter Notebook
+15 more
Datadog Cloud Monitoring Grafana Apache Spark HybridCloud Gitlab Kubernetes Infrastructure Automation Frameworks Apache Flink Data Management Terraform Splunk Api Management Docker Programming Languages

Job description

We are seeking a highly skilled Data Platform Engineer to design, build, automate, and support enterprise-scale data platforms across hybrid cloud environments. This role will focus on platform engineering, infrastructure automation, observability, and the operational excellence of modern analytics ecosystems supporting large-scale data products., The ideal candidate will have deep experience managing distributed data platforms, cloud infrastructure, and big data technologies, while leveraging automation and engineering best practices to enhance reliability, scalability, and performance.

Requirements

  • 5+ years of professional experience with large-scale data platform, data product development, and platform operations
  • 2+ years of experience developing and operating infrastructure, data platforms, and cloud services in hybrid environments (On-prem, AWS, or GCP)
  • Hands-on experience with operations automation and observability on HDFS and Objectstores
  • Experience with Jupyter Notebook environment automation and operations
  • Proficient in one or more programming languages (Python, Java, or Scala) for automation, API integrations, and Spark job development
  • Proficient with analytics stack including Apache Spark/Flink, Iceberg, Airflow, and Kubernetes

Nice to Have Skills & Experience

  • Knowledge of CI/CD technologies including GitLab, Terraform, Docker/Kubernetes, and cloud monitoring tools (Splunk, Grafana, Datadog)
  • Experience implementing security controls, governance processes, compliance validation, infrastructure cost analysis, and optimization

Benefits & conditions

Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on jobs.insightglobal.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:38 min

Establishing comprehensive monitoring and log management

Michael Eder +1 · LIVE

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · WWC 2025

6:14 min

Structuring CI/CD pipelines with integrated security and quality checks

Christoph Ruggenthaler · LIVE

3:10 min

Correlating dispersed logs using structured request tracing

Michael Eder +1 · LIVE

2:34 min

Docker sandbox architecture and microVM environment integration

Manuel de la Peña Manuel de la Peña · WWC Europe 2026

Videos

See all

Related articles

See all