Lead Data Engineer

AIR Communities
Dupont, CO, United States
15 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Compensation
$135,000.0 - $160,000.0
Working hours
Regular working hours
Job source

Tech stack

Big Data Cloud Engineering Continuous Integration Information Engineering Data Governance Data Infrastructure Extract Transform Load (ETL) Data Security Dataspaces Digital Assets Distributed Computing Environment Python (Programming Language)
+16 more
Machine Learning Meta-Data Management Performance Tuning Query Optimization SQL Databases Data Streaming Unstructured Data Workflow Management Systems Parquet Cloud Platform System Information Technology Integration Frameworks Data Management Dynamic Data Software Version Control Data Pipelines

Job description

We are seeking a highly skilled Lead Data Engineer to join our dynamic data team. The ideal candidate has extensive experience designing, building, and optimizing modern data pipelines and cloud-based data platforms. In this role, you will help shape scalable data infrastructure that supports analytics, machine learning, and business-critical applications across the organization.

What you will do:

  • Design, develop, and maintain scalable data pipelines to ingest, transform, and deliver large and diverse datasets.
  • Write efficient, reusable SQL and/or Python for data ingestion, transformation, and integration.
  • Optimize data workflows for performance, reliability, security, and cost-efficiency in cloud environments.
  • Collaborate with data scientists, analysts, application teams, and business stakeholders to understand data requirements and deliver technical solutions.
  • Implement data governance and security practices across pipeline components and data assets.
  • Monitor data flows, troubleshoot issues, and ensure data quality, availability, and integrity.
  • Integrate data from various internal and external sources into centralized data platforms.
  • Provide technical leadership, mentor junior engineers, and support knowledge-sharing within the team.
  • Evaluate emerging tools and architectures, recommending improvements to existing systems and processes.
  • Conduct performance tuning and optimization across ingestion, transformation, and storage layers.

Requirements

  • Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent experience.
  • 12-14+ years of experience in data or related engineering roles, with 8+ years focused on data engineering.
  • Advanced proficiency in SQL and/or Python for data processing, transformation, and automation.
  • Hands-on experience building and optimizing data pipelines and integration workflows.
  • Strong understanding of data modeling, performance optimization, and query tuning.
  • Experience working with cloud platforms and their data ecosystem.
  • Knowledge of ETL/ELT concepts, orchestration patterns, and automated data workflows.
  • Understanding of data governance, data security, and handling sensitive or regulated data (e.g., PII).
  • Experience with version control and CI/CD practices.
  • Strong problem-solving abilities with experience in complex or unstructured data environments.
  • Strong analytical and troubleshooting skills, including root-cause analysis., * Experience with distributed data processing or declarative pipeline frameworks.
  • Familiarity with cloud-native functions and workflow orchestration tools.
  • Experience with data governance frameworks, metadata management, or cataloging solutions.
  • Knowledge of columnar storage and big-data file formats.
  • Familiarity with modern table formats such as Parquet, Delta, or Iceberg.

Required Soft Skills:

  • Strong leadership and mentorship abilities, with a focus on elevating team capability and fostering knowledge sharing.
  • Strategic thinking and the ability to align engineering work with broader business objectives.
  • Effective communication skills, including the ability to translate technical concepts for non-technical audiences.
  • Collaboration-oriented mindset, thriving in cross-functional environments with product, analytics, and engineering partners.
  • Adaptability and resilience in navigating ambiguity, shifting priorities, or evolving technical landscapes.
  • Proactive initiative, consistently identifying opportunities for improvement and driving solutions forward.
  • Commitment to quality and craft, with a strong sense of ownership over system performance and reliability.
  • Growth mindset, continuously seeking new knowledge, tools, and approaches to improve team outcomes.

Benefits & conditions

3.73.7 out of 5 stars Dupont, CO 80024 $135,000 - $160,000 a year - Full-time, Pulled from the full job description

  • Tuition reimbursement
  • Paid parental leave
  • Parental leave
  • 401(k)
  • Health insurance
  • Vision insurance
  • Health savings account, AIR offers attractive total compensation packages designed to recognize and reward performance at the individual, team and company levels. We start with a competitive base salary and add bonus opportunities and benefit choices topped off with:
  • Expected pay rate of $$135,000 - $160,000 plus annual bonus. You will be provided a pay rate that is in line with your skills and experience as they relate to the requirements of the job.
  • 25% Discounted Rent at AIR communities (certain exclusions apply, and an application is required).
  • Medical, dental, vision, and life insurance options available. HSA with company sponsored contributions, FSA (traditional and dependent care FSA).
  • Short and long-term disability paid by the company.
  • 401(K) plus company contributions.
  • Paid Vacation, 14 Paid Holidays, and Paid Sick Time.
  • Tuition Assistance Program.
  • Commuter Benefits and Pet-Insurance.
  • Up to 100% Reimbursement on Professional Certification/Licensing for Job Related Curriculums.
  • Paid parental leave of up to 16 weeks, following the birth or adoption of a child.
  • Consumer discounts from various products and services including travel planning, wireless phones, health and fitness, home appliances, and more.
  • 15 hours of paid time annually to give-back to your community.
  • Opportunities for professional development and career growth including realistic job previews, in person and virtual leadership training, and performance improvement courses.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

2:50 min

How Parquet metadata enables efficient data reading

Matthias Niehoff Matthias Niehoff · WWC Europe 2026

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

2:03 min

Introduction to open table formats built on Parquet

Matthias Niehoff Matthias Niehoff · WWC Europe 2026

Videos

See all

Related articles

See all