Lead Data Engineer

Georgia-Pacific
Atlanta, GA, United States
17 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours

Tech stack

Agile Methodology Airflow Amazon Web Services Continuous Integration Information Engineering Data Governance Data Infrastructure Software Design Patterns Distributed Systems Python (Programming Language) Peachtree (Accounting Software) SQL Databases
+13 more
Systems Integration Enterprise Data Management Apache Spark State Machines Git Data Lakes Infrastructure Automation Frameworks Performance Monitor Apache Kafka Data Management Data Delivery Terraform Databricks

Job description

As a Lead Data Platform Engineer on the Georgia Pacific Data Platform team, you will help deliver trusted, high-quality data across hundreds of systems and thousands of data assets. You will own, deliver, operate, and help architect the Enterprise Data Lake, Ingestion Framework, and Databricks Platform while partnering with Data Governance, Data Delivery, Product Owners, and Solution Architects to keep the platform reliable, scalable, governed, and aligned with business needs.

This role is based in our Atlanta, GA HQ office located on Peachtree St. This role is a hybrid-based role.

Our Team

The Georgia Pacific Data Platform team builds, manages, & operates centralized products that support Georgia Pacific’s Business Units and IT. These products enable data to be ingested, stored, processed, governed, managed, presented, and consumed consistently across the enterprise.

What You Will Do

  • Lead and optimize the GP data platform (Enterprise Data Lake, Ingestion Framework, Databricks), ensuring reliability, integrity, and cost efficiency data and data infrastructure
  • Collaborate with cross-functional teams to deliver features, maintain a healthy agile process, and enhance platform accessibility for customers
  • Drive automation, operational excellence, and continuous improvement through performance monitoring, issue resolution, and development of self-service tools, * Delivered innovative, scalable data solutions using Python, SQL, Spark, and Delta Lake, while optimizing data accessibility with open table formats (Delta, Hudi, Iceberg)
  • Enhanced system efficiency and reliability by leveraging Terraform, Git/CI-CD workflows, and DAG tools (Airflow, Step Functions, Databricks Declarative Pipelines)
  • Implemented and optimized the Databricks Data Platform and AWS services (Lambda, Glue, EventBridge, ECS, Kafka, etc.) to support business objectives

Requirements

Enterprise Architecture, Data Quality, Data Lake, Centralized Operations/Management, Product Support, Cross-Functional, Agile Programming Methodologies, Health Maintenance, Automation, Continuous Improvement, * Experience designing, building, and maintaining large-scale distributed systems

  • Experience serving as a senior technical leader overseeing multiple data engineering teams
  • Experience in architectural design and systems integration for multi-stakeholder, enterprise-grade platforms
  • Experience leading operations for highly available data platforms and data lakes
  • Demonstrated experience in data infrastructure, including proficiency with Infrastructure as Code practices and skilled in GIT and CI/CD design patterns

About the company

All Koch companies value diversity of thought, perspectives, aptitudes, experiences, and backgrounds. We are Military Ready and Second Chance employers. Learn more about our hiring philosophy here., As a Koch company and a leading manufacturer of bath tissue, paper towels, paper-based packaging, cellulose, specialty fibers, building products and much more, Georgia-Pacific works to meet evolving needs of customers worldwide with quality products. In addition to the products we make, we operate one of the largest recycling businesses. Our more than 30,000 employees in over 150 locations are empowered to innovate every day - to make everyday products even better.

At Koch, employees are empowered to do what they do best to make life better. Learn how our business philosophy helps employees unleash their potential while creating value for themselves and the company.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…