Lead Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+13 more
Job description
As a Lead Data Platform Engineer on the Georgia Pacific Data Platform team, you will help deliver trusted, high-quality data across hundreds of systems and thousands of data assets. You will own, deliver, operate, and help architect the Enterprise Data Lake, Ingestion Framework, and Databricks Platform while partnering with Data Governance, Data Delivery, Product Owners, and Solution Architects to keep the platform reliable, scalable, governed, and aligned with business needs.
This role is based in our Atlanta, GA HQ office located on Peachtree St. This role is a hybrid-based role.
Our Team
The Georgia Pacific Data Platform team builds, manages, & operates centralized products that support Georgia Pacific’s Business Units and IT. These products enable data to be ingested, stored, processed, governed, managed, presented, and consumed consistently across the enterprise.
What You Will Do
- Lead and optimize the GP data platform (Enterprise Data Lake, Ingestion Framework, Databricks), ensuring reliability, integrity, and cost efficiency data and data infrastructure
- Collaborate with cross-functional teams to deliver features, maintain a healthy agile process, and enhance platform accessibility for customers
- Drive automation, operational excellence, and continuous improvement through performance monitoring, issue resolution, and development of self-service tools, * Delivered innovative, scalable data solutions using Python, SQL, Spark, and Delta Lake, while optimizing data accessibility with open table formats (Delta, Hudi, Iceberg)
- Enhanced system efficiency and reliability by leveraging Terraform, Git/CI-CD workflows, and DAG tools (Airflow, Step Functions, Databricks Declarative Pipelines)
- Implemented and optimized the Databricks Data Platform and AWS services (Lambda, Glue, EventBridge, ECS, Kafka, etc.) to support business objectives
Requirements
Enterprise Architecture, Data Quality, Data Lake, Centralized Operations/Management, Product Support, Cross-Functional, Agile Programming Methodologies, Health Maintenance, Automation, Continuous Improvement, * Experience designing, building, and maintaining large-scale distributed systems
- Experience serving as a senior technical leader overseeing multiple data engineering teams
- Experience in architectural design and systems integration for multi-stakeholder, enterprise-grade platforms
- Experience leading operations for highly available data platforms and data lakes
- Demonstrated experience in data infrastructure, including proficiency with Infrastructure as Code practices and skilled in GIT and CI/CD design patterns
About the company
All Koch companies value diversity of thought, perspectives, aptitudes, experiences, and backgrounds. We are Military Ready and Second Chance employers. Learn more about our hiring philosophy here., As a Koch company and a leading manufacturer of bath tissue, paper towels, paper-based packaging, cellulose, specialty fibers, building products and much more, Georgia-Pacific works to meet evolving needs of customers worldwide with quality products. In addition to the products we make, we operate one of the largest recycling businesses. Our more than 30,000 employees in over 150 locations are empowered to innovate every day - to make everyday products even better.
At Koch, employees are empowered to do what they do best to make life better. Learn how our business philosophy helps employees unleash their potential while creating value for themselves and the company.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…