> Markdown version of [/jobs/ext/2715386-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/2715386-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Lead Data Engineer

- **Company:** Conch Technologies
- **Location:** Madison, WI, United States
- **Experience:** Expert
- **Contract:** Temporary to permanent
- **Skills:** Agile Methodology, Artificial Intelligence, Airflow, BigQuery, Cloud Storage, Information Systems, Continuous Integration, Information Engineering, Data Governance, Extract Transform Load (ETL), DevOps, Data Flow Control, Performance Tuning, Cloudera, Data Processing, Google Cloud, Feature Engineering, Snowflake, Git, Pyspark, Information Technology, Deployment Automation, Data Pipelines, Databricks
- **Published:** September 4, 2026
- **Apply:** https://www.dice.com/job-detail/4d35c10b-3c6f-40e4-a3f8-2c28cb37e2df

## About the Role

* Bachelor's Degree in Computer Science, Engineering, Information Systems, or related field.
 * 8-10+ years of Data Engineering experience.
 * 3+ years in a Lead, Principal, or Senior Data Engineering capacity.
 * Expert-level proficiency with Python for data engineering and data processing.
 * Strong hands-on experience with Google Cloud Platform (Google Cloud Platform).
 * Extensive experience with:
 + BigQuery
 + Dataflow
 + Dataproc / PySpark
 + Cloud Composer (Airflow)
 + Pub/Sub
 + Cloud Storage
 * Strong SQL development and data modeling experience.
 * Experience building enterprise-scale ETL/ELT pipelines.
 * Experience working with large-volume datasets and performance optimization.
 * Knowledge of CI/CD, Git, DevOps practices, and automated deployment frameworks.
 * Strong communication and stakeholder management skills.
 * Ability to work independently and lead technical initiatives from concept through production.

Preferred Qualifications

 * Experience with Snowflake, Databricks, or modern lakehouse architectures.
 * Experience enabling AI/ML workloads and feature engineering pipelines.
 * Knowledge of data governance, data quality frameworks, and regulatory compliance requirements.
 * Experience working within large enterprise Agile environments.



## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment)
- [DevOps Maturity Check – a way to balance autonomy and alignment](https://www.wearedevelopers.com/videos/58-devops-maturity-check-a-way-to-balance-autonomy-and-alignment)

## Related Articles

- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)
- [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence)