Lead Data Engineer

Conch Technologies

Madison, WI, United States

5 days ago

Apply on www.dice.com

Prepare application

Role details

Contract type

Temporary to permanent

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

3 years minimum

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Agile Methodology Artificial Intelligence Airflow BigQuery Cloud Storage Information Systems Continuous Integration Information Engineering Data Governance Extract Transform Load (ETL) DevOps Data Flow Control

+12 more

Performance Tuning Cloudera Data Processing Google Cloud Feature Engineering Snowflake Git Pyspark Information Technology Deployment Automation Data Pipelines Databricks

Requirements

Bachelor’s Degree in Computer Science, Engineering, Information Systems, or related field.
8-10+ years of Data Engineering experience.
3+ years in a Lead, Principal, or Senior Data Engineering capacity.
Expert-level proficiency with Python for data engineering and data processing.
Strong hands-on experience with Google Cloud Platform (Google Cloud Platform).
Extensive experience with:
BigQuery
Dataflow
Dataproc / PySpark
Cloud Composer (Airflow)
Pub/Sub
Cloud Storage
Strong SQL development and data modeling experience.
Experience building enterprise-scale ETL/ELT pipelines.
Experience working with large-volume datasets and performance optimization.
Knowledge of CI/CD, Git, DevOps practices, and automated deployment frameworks.
Strong communication and stakeholder management skills.
Ability to work independently and lead technical initiatives from concept through production.

Preferred Qualifications

Experience with Snowflake, Databricks, or modern lakehouse architectures.
Experience enabling AI/ML workloads and feature engineering pipelines.
Knowledge of data governance, data quality frameworks, and regulatory compliance requirements.
Experience working within large enterprise Agile environments.