> Markdown version of [/jobs/ext/4689638-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/4689638-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Lead Data Engineer

- **Company:** The Judge Group
- **Location:** Columbus, OH, United States
- **Experience:** Expert
- **Salary:** $145,600 - $166,400
- **Contract:** Contract
- **Skills:** Sql Data Warehouse, Java (Programming Language), Artificial Intelligence, Airflow, Amazon Web Services, Apache HTTP Server, Automation of Tests, Big Data, Cloud Computing, Cloud Engineering, Code Review, Computer Programming, Continuous Integration, Data Architecture, Information Engineering, Data Governance, Extract Transform Load (ETL), Distributed Computing Environment, Distributed Systems, Python (Programming Language), Cloud Services, Secure Coding, Software Engineering, Parquet, Snowflake, Apache Spark, Generative AI, Change Data Capture, AI Coding Agents, Agentic-AI, Data Lakes, Storage Technologies, Information Technology, Data Lineage, Avro, Apache Kafka, Spark Streaming, Video Streaming, Cloud Optimization, Restful APIs, Programming Languages, Control M
- **Published:** November 12, 2026
- **Apply:** https://www.dice.com/job-detail/7e2302d9-601c-406c-97df-81464c419131

## About the Role

* Bachelor's degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
 * 10+ years of experience in software engineering with significant focus on data engineering and distributed systems.
 * Strong programming expertise in Java and Python.
 * Experience designing and building enterprise-scale ETL/ELT platforms.
 * Deep understanding of Apache Spark and distributed data processing concepts.
 * Experience with AWS cloud services and cloud-native architectures.
 * Proven experience with data lakes, lakehouse architectures, and large-scale data platforms.
 * Experience working with Parquet, Avro, and related storage technologies.
 * Experience leading technical initiatives and mentoring engineering teams.
 * Demonstrated experience leveraging AI-assisted development tools within software engineering workflows.

Preferred Qualifications

 * Experience with workflow orchestration platforms such as Airflow, Dagster, or Control-M.
 * Experience with streaming technologies including Kafka and Spark Structured Streaming.
 * Knowledge of Change Data Capture (CDC), upsert strategies, and incremental processing frameworks.
 * Experience with Delta Lake, Apache Iceberg, or Apache Hudi.
 * Experience working with Snowflake or other cloud data warehouse technologies.
 * Familiarity with FinOps and cloud cost optimization practices.
 * Experience operating mission-critical systems in regulated environments.
 * Understanding of compliance, audit, privacy, and PII governance requirements.
 * Experience building or supporting Generative AI and Agentic AI solutions.

Required Technical Skills

Programming Languages

 * Java
 * Python

Cloud & Platform

 * AWS
 * Data Lake / Lakehouse Architecture

## Description

* Apache Spark
 * Parquet
 * Avro

Data Engineering

 * ETL / ELT Development
 * Data Modeling
 * Data Quality
 * Data Governance
 * Data Lineage

Software Engineering

 * REST APIs
 * CI/CD
 * Automated Testing
 * Observability
 * Secure Coding

AI & Automation

 * AI-Assisted Software Development Tools
 * AI Code Review and Test Automation
 * Responsible AI Practices