> Markdown version of [/jobs/ext/4626774-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/4626774-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Lead Data Engineer

- **Company:** Progressive Corporation
- **Location:** Cleveland, OH, United States (Remote available)
- **Experience:** Expert
- **Salary:** $148,300 - $164,800
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, Amazon Elastic Compute Cloud, Amazon S3, Application Integration Architecture, Automation of Tests, Cloud Computing, Cloud Engineering, Code Review, Information Systems, Computer Programming, Continuous Integration, Information Engineering, Data Governance, Data Integration, Extract Transform Load (ETL), Data Transformation, Data Security, DevOps, Github, Identity and Access Management, IT Management, Python (Programming Language), Key Management, Machine Learning, Marketing Information Systems, Performance Tuning, Software Deployment, Software Engineering, SQL Databases, Unstructured Data, Enterprise Software Applications, Cloud Platform System, Data Ingestion, Retrieval-Augmented Generation, Snowflake, Generative AI, Infrastructure as Code (IaC), Agentic-AI, Containerization, Information Technology, Deployment Automation, Enterprise Integration, Data Management, Terraform, Data Pipelines, Docker
- **Published:** November 7, 2026
- **Apply:** https://www.careerbuilder.com/job-details/lead-data-engineer-cleveland-oh--eef5b068-b2f7-4f27-94bf-fed493dca9d5

## About the Role

Cloud Computing, Data Science, Technical Leadership, Mentoring, Data Management, Software Engineering, Machine Learning, Artificial Intelligence (AI), Marketing, Information Technology & Information Systems, * Bachelor's Degree or higher in an Information Technology discipline or related field of study and minimum of five years of work experience designing, programming, and supporting software programs or applications.

 * In lieu of degree, minimum of six years related work experience designing, programming, and supporting software programs or applications may be accepted.

Preferred skills

 * Strong expertise in AWS cloud infrastructure and Infrastructure as Code (IaC), including Terraform, EC2, IAM, S3, ECR, networking, security configurations, secrets management, and independently provisioning, managing, and troubleshooting scalable cloud environments.
 * Strong hands-on experience in data engineering and architecture, with advanced proficiency in Python, SQL, Snowflake, Snowpipe, and designing scalable ETL/ELT pipelines integrating structured and unstructured data from internal systems, external vendors, APIs, and cloud platforms.
 * Experience with data transformation, orchestration, and pipeline management, including dbt, Prefect, data modeling, workflow scheduling, incremental processing, automated testing, data quality, pipeline monitoring, troubleshooting, and performance optimization.
 * Hands-on experience with DevOps, CI/CD, and production deployment, including GitHub Actions, Docker, containerization, automated deployment pipelines, application integration, monitoring, and production support for machine learning, generative AI, RAG, and agentic AI applications. Experience with secure integration across Snowflake, AWS, and enterprise application hosting environments.
 * Ability to provide technical leadership and establish engineering best practices, including solution architecture, code reviews, reusable engineering frameworks, data security and governance controls, cloud cost optimization, production reliability, documentation, mentoring engineers, and collaborating across data science, enterprise IT, governance, and marketing teams., Applicants must be authorized to work for any employer in the U.S. without the need or potential need, of current or future sponsorship for employment. Progressive does not hire candidates with (e.g., F-1 CPT, OPT, or STEM OPT, H-1B, O-1, E-3, TN) statuses for this role.

## Description

As a lead data engineer on the Marketing Data Science and Engineering team, you'll lead the design, development, and implementation of scalable data pipelines, cloud infrastructure, and engineering solutions that support marketing analytics, machine learning, and AI applications. In this role, you'll focus on building reliable data integration frameworks, managing cloud infrastructure, and establishing production-ready engineering practices across the team. You'll work across the full data engineering lifecycle, from data ingestion and transformation to infrastructure provisioning, deployment, monitoring, and maintenance, while partnering closely with data scientists, data governance teams, enterprise technology teams, and marketing business partners. You'll provide technical leadership, establish engineering standards, and mentor other engineers to ensure scalable, secure, and maintainable solutions.