Data Platform Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+15 more
Job description
We are seeking a highly skilled Data Platform Engineer to design, build, automate, and support enterprise-scale data platforms across hybrid cloud environments. This role will focus on platform engineering, infrastructure automation, observability, and the operational excellence of modern analytics ecosystems supporting large-scale data products., The ideal candidate will have deep experience managing distributed data platforms, cloud infrastructure, and big data technologies, while leveraging automation and engineering best practices to enhance reliability, scalability, and performance.
Requirements
- 5+ years of professional experience with large-scale data platform, data product development, and platform operations
- 2+ years of experience developing and operating infrastructure, data platforms, and cloud services in hybrid environments (On-prem, AWS, or GCP)
- Hands-on experience with operations automation and observability on HDFS and Objectstores
- Experience with Jupyter Notebook environment automation and operations
- Proficient in one or more programming languages (Python, Java, or Scala) for automation, API integrations, and Spark job development
- Proficient with analytics stack including Apache Spark/Flink, Iceberg, Airflow, and Kubernetes
Nice to Have Skills & Experience
- Knowledge of CI/CD technologies including GitLab, Terraform, Docker/Kubernetes, and cloud monitoring tools (Splunk, Grafana, Datadog)
- Experience implementing security controls, governance processes, compliance validation, infrastructure cost analysis, and optimization
Benefits & conditions
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on jobs.insightglobal.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Highest Paying Tech Companies for Developers
Data Engineer Salary UK
Making Data Warehouses Fast: A Developer’s Story
Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production