Data Engineer - Master Data & DataOps (EDW)

Insight Global
Atlanta, GA, United States
1 day ago
Apply on www.atlantacareerpath.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
$104,000.0 - $124,800.0
Working hours
Regular working hours

Tech stack

Airflow BigQuery Continuous Integration Data Validation Information Engineering Extract Transform Load (ETL) Data Warehousing DevOps Data Flow Control Github Python (Programming Language) Online Analytical Processing
+14 more
Open Data Protocol DataOps SQL*Plus Google Cloud Sql Optimization Delivery Pipeline Large Language Models Data Layers Containerization Kubernetes Data Management Terraform Data Pipelines Jenkins

Job description

*Build, maintain, and optimize scalable data pipelines on Google Cloud Platform using BigQuery, Dataform or DBT, Dataflow, GCS, Pub/Sub, and Cloud Composer (Airflow).

*Write advanced SQL for large-scale transformations, along with Python for automation, orchestration, and pipeline development.

*Support the master data layer that governs thousands of tables and their metadata, ensuring accuracy, lineage, and consistency at enterprise scale.

*Contribute to the DataOps and DevOps side of the platform through CI/CD pipelines (Jenkins, GitHub), infrastructure-as-code with Terraform, and GitOps-style deployment workflows.

*Implement change management, access controls, and self-service tooling that reduce friction for downstream data builders.

*Apply strong defensive engineering habits such as data validation, monitoring, schema checks, and alerting so pipelines run as reliably on day 100 as they do on day 1.

Requirements

*Hands-on data engineering experience with a strong foundation in ETL/ELT, data modeling, orchestration, and cloud data ecosystems.

*Expert-level SQL plus solid Python in a data engineering context.

*Real GCP and BigQuery depth, including partitioning, clustering, and performance and cost optimization.

*Experience with Dataform or DBT for modeling and transformation.

*Exposure to CI/CD and infrastructure-as-code, ideally Jenkins, GitHub, and Terraform, for governed, repeatable deployments.

*A systemic thinker who can explain the trade-offs behind engineering decisions and improve on prior work.

Strong communication skills, since you will partner directly with product, engineering, and business stakeholders to gather requirements and validate outcomes. *Familiarity with master data management or metadata governance frameworks such as data contracts and open data standards.

*Experience with AtScale, semantic layers, or OLAP modeling.

*Exposure to Kubernetes, containerized workloads, or internal developer platforms.

*Comfort integrating LLM-based agents or modern AI tooling into data workflows to accelerate automation and improve data quality.

*Retail or e-commerce domain experience, or a background at high-velocity data companies such as Chewy, Amazon, Wayfair, or Netflix

Benefits & conditions

$50/hr to $60/hr. - Exact compensation may vary based on several factors, including skills, experience, and education.

Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.

About the company

You will join the Enterprise Data Warehouse organization at a Fortune 100 retailer that runs one of the largest data ecosystems in the world. This centralized data org supports all 12 business units, operates as Google’s largest customer, and manages well over 170 petabytes inside BigQuery. This specific team owns the master data that the rest of the company trusts, so your work becomes the single source of truth that powers reporting, analytics, and AI across the business.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.atlantacareerpath.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters · World Congress 2023

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · World Congress 2026 Europe

1:02 min

Applying an ETL methodology to infrastructure configuration management

Axel Barbier · World Congress 2023

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:40 min

Using GitHub primitives for internal documentation and corporate operations

Kyle Daigle · Coffee With Developers

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

Videos

See all

Related articles

See all