> Markdown version of [/jobs/ext/1466191-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/1466191-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Data Engineer - **Company:** AIR Communities - **Location:** Dupont, CO, United States - **Experience:** Expert - **Salary:** $135,000.0 - $160,000.0 - **Contract:** Permanent contract - **Skills:** Big Data, Cloud Engineering, Continuous Integration, Information Engineering, Data Governance, Data Infrastructure, Extract Transform Load (ETL), Data Security, Dataspaces, Digital Assets, Distributed Computing Environment, Python (Programming Language), Machine Learning, Meta-Data Management, Performance Tuning, Query Optimization, SQL Databases, Data Streaming, Unstructured Data, Workflow Management Systems, Parquet, Cloud Platform System, Information Technology, Integration Frameworks, Data Management, Dynamic Data, Software Version Control, Data Pipelines - **Published:** July 28, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=d66b1bbd62ad85e6 ## About the Role * Bachelor's degree in Computer Science, Engineering, or related field, or equivalent experience. * 12-14+ years of experience in data or related engineering roles, with 8+ years focused on data engineering. * Advanced proficiency in SQL and/or Python for data processing, transformation, and automation. * Hands-on experience building and optimizing data pipelines and integration workflows. * Strong understanding of data modeling, performance optimization, and query tuning. * Experience working with cloud platforms and their data ecosystem. * Knowledge of ETL/ELT concepts, orchestration patterns, and automated data workflows. * Understanding of data governance, data security, and handling sensitive or regulated data (e.g., PII). * Experience with version control and CI/CD practices. * Strong problem-solving abilities with experience in complex or unstructured data environments. * Strong analytical and troubleshooting skills, including root-cause analysis., * Experience with distributed data processing or declarative pipeline frameworks. * Familiarity with cloud-native functions and workflow orchestration tools. * Experience with data governance frameworks, metadata management, or cataloging solutions. * Knowledge of columnar storage and big-data file formats. * Familiarity with modern table formats such as Parquet, Delta, or Iceberg. Required Soft Skills: * Strong leadership and mentorship abilities, with a focus on elevating team capability and fostering knowledge sharing. * Strategic thinking and the ability to align engineering work with broader business objectives. * Effective communication skills, including the ability to translate technical concepts for non-technical audiences. * Collaboration-oriented mindset, thriving in cross-functional environments with product, analytics, and engineering partners. * Adaptability and resilience in navigating ambiguity, shifting priorities, or evolving technical landscapes. * Proactive initiative, consistently identifying opportunities for improvement and driving solutions forward. * Commitment to quality and craft, with a strong sense of ownership over system performance and reliability. * Growth mindset, continuously seeking new knowledge, tools, and approaches to improve team outcomes. ## Description We are seeking a highly skilled Lead Data Engineer to join our dynamic data team. The ideal candidate has extensive experience designing, building, and optimizing modern data pipelines and cloud-based data platforms. In this role, you will help shape scalable data infrastructure that supports analytics, machine learning, and business-critical applications across the organization. What you will do: * Design, develop, and maintain scalable data pipelines to ingest, transform, and deliver large and diverse datasets. * Write efficient, reusable SQL and/or Python for data ingestion, transformation, and integration. * Optimize data workflows for performance, reliability, security, and cost-efficiency in cloud environments. * Collaborate with data scientists, analysts, application teams, and business stakeholders to understand data requirements and deliver technical solutions. * Implement data governance and security practices across pipeline components and data assets. * Monitor data flows, troubleshoot issues, and ensure data quality, availability, and integrity. * Integrate data from various internal and external sources into centralized data platforms. * Provide technical leadership, mentor junior engineers, and support knowledge-sharing within the team. * Evaluate emerging tools and architectures, recommending improvements to existing systems and processes. * Conduct performance tuning and optimization across ingestion, transformation, and storage layers. ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Parquet, Delta, Iceberg & Ducklake - An introduction for developers](https://www.wearedevelopers.com/videos/100075-parquet-delta-iceberg-ducklake-an-introduction-for-developers) - [Harnessing the Power of Open Source's Newest Technologies](https://www.wearedevelopers.com/videos/1448-harnessing-the-power-of-open-source-s-newest-technologies) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [OLAP for AI Applications and why you should care](https://www.wearedevelopers.com/videos/100212-olap-for-ai-applications-and-why-you-should-care) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)