> Markdown version of [/jobs/ext/560133-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/560133-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Lead Data Engineer

- **Company:** American Family Insurance
- **Location:** Madison, WI, United States
- **Experience:** Expert
- **Salary:** $76,000.0 - $125,000.0
- **Contract:** Permanent contract
- **Skills:** Amazon Web Services, Applications Architecture, Microsoft Azure, Big Data, Cloud Computing, Code Reuse, Databases, Continuous Integration, Information Engineering, Extract Transform Load (ETL), Data Stores, Data Warehousing, Relational Databases, Software Design Patterns, Dimensional Modeling, Distributed Computing Environment, Apache Hadoop, Python (Programming Language), Machine Learning, NoSQL, Open Source Technology, Standard Sql, Software Engineering, Web Services, Data Logging, Google Cloud, Apache Spark, Git, Cloudformation, Scikit Learn, Data Analytics, Terraform, Docker, Jenkins
- **Published:** June 5, 2026
- **Apply:** https://www.careerjet.com/jobad/us7792ed638e61bb3054713600e7c238c8

## About the Role

* Demonstrated experience providing customer-driven solutions, support or service.
 * In-depth knowledge of SQL or NoSQL and experience using a variety of data stores (e.g. RDBMS, analytic database, scalable document stores)
 * Extensive hands-on Python programming experience, with an emphasis towards building ETL workflows and data-driven solutions.
 * Able to employ design patterns and generalize code to address common use cases.
 * Capable of authoring robust, high quality, reusable code and contributing to the division's inventory of libraries.
 * Expertise in big data batch computing tools (e.g. Hadoop or Spark), with demonstrated experience developing distributed data processing solutions.
 * Applied knowledge of cloud computing (AWS, GCP, Azure).
 * Knowledge of open source machine learning toolkits, such as sklearn, SparkML, or H2O.
 * Solid data understanding and business acumen in the data rich industries like insurance or financial
 * Applied knowledge of data modeling principles (e.g. dimensional modeling and star schemas).
 * Strong understanding of database internals, such as indexes, binary logging, and transactions.
 * Experience using tools for infrastructure-as-code (e.g. Docker, CloudFormation, Terraform, etc.)
 * Experience with software engineering tools and workflows (i.e. Jenkins, CI/CD, git).
 * Practical experience authoring and consuming web services.

## Description

This position has approval to transfer a valid H1 visa.
Primary Accountabilities

 * Leads an engineering team to meet project deadlines and priorities.
 * Supervises assigned data engineering team members & activities.
 * Ensures the quality, completeness, security, privacy, and integrity of data throughout the data lifecycle.
 * Documents critical workflows and operational support aspects of team's responsibilities
 * Develops deep understanding of data sources, granularity, availability, and limitations.
 * Provides proactive technical oversight and advice to application architecture and development teams fostering re-use, design for scale, stability, and operational efficiency of data/analytical solutions.
 * Creates maintainable, scalable code to load and manipulate data in the data warehouse.
 * Facilitates communication upward and across project teams and business stakeholders.


## Related Videos

- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis)
- [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews)
- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)

## Related Articles

- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)