Data Platform Engineer

CME Group
Chicago, IL, United States
3 months ago
Apply on dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
$132,100.0 - $220,100.0
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) Airflow Big Data BigQuery Cloud Storage Computer Programming Continuous Integration Data as a Services Information Engineering Data Infrastructure Data Warehousing Distributed Computing Environment
+19 more
Identity and Access Management Python (Programming Language) Key Management Performance Tuning Cloud Services Software Engineering Data Streaming Workflow Management Systems Data Processing Google Cloud Apache Spark Infrastructure as Code (IaC) Containerization Kubernetes Apache Flink Google Bigquery Hashicorp Terraform Devsecops

Job description

As a Data Platform Engineer, you will be responsible for building and maintaining the self-service platforms and frameworks used by our Data Scientists and Engineers. Your work will directly accelerate the development and deployment of batch and streaming data pipelines built with Spark and Flink, and enable seamless, governed access to data in BigQuery. You will be a key contributor to our automation strategy, utilizing tools like Terraform for infrastructure provisioning and Argo Workflows for orchestrating complex data jobs on Google Kubernetes Engine (GKE).If you are passionate about building robust infrastructure for large-scale data processing, cloud-native data architectures, and empowering data practitioners, this job is for you!, * Develop self-service tools and automation to improve the productivity of Data Engineering and Data Science teams.

  • Partner with application teams to ensure data services are well-architected, secure, and optimized for performance and cost.
  • Serve as a Subject Matter Expert (SME) for core platform components, including our Kubernetes environment (GKE), data processing engines (Spark, Flink), and data warehousing (BigQuery).
  • Mentor junior team members and lead technical initiatives to define the future of our data infrastructure toolset.

Requirements

  • Google Cloud Platform Mastery: Expert-level experience architecting and operating resilient infrastructure on Google Cloud Platform (Google Cloud Platform), specifically leveraging GKE, BigQuery, and Cloud Storage.
  • Kubernetes as a Platform: Deep hands-on expertise with Google Kubernetes Engine (GKE), including designing for multi-tenancy, custom resource definitions (CRDs), and automated scaling for high-throughput data workloads.
  • Infrastructure as Code (IaC): Advanced proficiency with Terraform is required
  1. Data Engineering at Scale * Distributed Processing: Proven track record of tuning and scaling Apache Spark and Apache Flink within containerized environments. * Modern Data Stack: Strong hands-on experience with Google BigQuery, focusing on performance tuning, partitioning strategies, and governing secure access for hundreds of users. * Workflow Orchestration: Expert proficiency in Argo Workflows and/or Airflow to automate complex, dependent data lifecycles.

  2. Software Engineering & Security * Advanced Programming: Strong proficiency in Python, Go, or Java. * DevSecOps Mindset: Experience integrating security into the platform “by design”-specifically managing IAM roles, secrets management (e.g., HashiCorp Vault), and CI/CD security scanning.

Benefits & conditions

CME Group is committed to offering a competitive total rewards package for our employees that recognizes their contributions to the business and reflects our long-term investment in their future. The pay range for this role is $132,100-$220,100. Actual salary offered will be dependent on a wide array of factors including but not limited to: relevant experience, skills, education and comparison to internal employees (where relevant). Our compensation program also includes an annual target bonus opportunity for all employees, as well as the opportunity to become an owner in the company through our broad-based equity program. Through our benefits program, we strive to offer flexibility, value and choice. From comprehensive health coverage, to a retirement package that includes both a 401(k) and an active pension plan, to highly competitive education reimbursement provisions, paid time off and a mental health benefit, CME Group offers a holistic benefits package for our team and their dependents.

CME Group: Where Futures are Made

CME Group is the world’s leading derivatives marketplace. But who we are goes deeper than that. Here, you can impact markets worldwide. Transform industries. And build a career by shaping tomorrow. We invest in your success and you own it - all while working alongside a team of leading experts who inspire you in ways big and small. Problem solvers, difference makers, trailblazers. Those are our people. And we’re looking for more.

At CME Group, we embrace our employees’ unique experiences and skills to ensure that everyone’s perspectives are acknowledged and valued. As an equal-opportunity employer, we consider all potential employees without regard to any protected characteristic.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dice.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

2:30 min

Leveraging BigQuery ML for scalable SQL-based segmentation experiments

Julian Joseph · LIVE

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · World Congress 2024

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

Videos

See all

Related articles

See all