Lead Data Engineer

American Family Insurance
Madison, WI, United States
2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
$76,000.0 - $125,000.0
Working hours
Regular working hours
Job source

Tech stack

Amazon Web Services Applications Architecture Microsoft Azure Big Data Cloud Computing Code Reuse Databases Continuous Integration Information Engineering Extract Transform Load (ETL) Data Stores Data Warehousing
+22 more
Relational Databases Software Design Patterns Dimensional Modeling Distributed Computing Environment Apache Hadoop Python (Programming Language) Machine Learning NoSQL Open Source Technology Standard Sql Software Engineering Web Services Data Logging Google Cloud Apache Spark Git Cloudformation Scikit Learn Data Analytics Terraform Docker Jenkins

Job description

This position has approval to transfer a valid H1 visa. Primary Accountabilities

  • Leads an engineering team to meet project deadlines and priorities.
  • Supervises assigned data engineering team members & activities.
  • Ensures the quality, completeness, security, privacy, and integrity of data throughout the data lifecycle.
  • Documents critical workflows and operational support aspects of team’s responsibilities
  • Develops deep understanding of data sources, granularity, availability, and limitations.
  • Provides proactive technical oversight and advice to application architecture and development teams fostering re-use, design for scale, stability, and operational efficiency of data/analytical solutions.
  • Creates maintainable, scalable code to load and manipulate data in the data warehouse.
  • Facilitates communication upward and across project teams and business stakeholders.

Requirements

  • Demonstrated experience providing customer-driven solutions, support or service.
  • In-depth knowledge of SQL or NoSQL and experience using a variety of data stores (e.g. RDBMS, analytic database, scalable document stores)
  • Extensive hands-on Python programming experience, with an emphasis towards building ETL workflows and data-driven solutions.
  • Able to employ design patterns and generalize code to address common use cases.
  • Capable of authoring robust, high quality, reusable code and contributing to the division’s inventory of libraries.
  • Expertise in big data batch computing tools (e.g. Hadoop or Spark), with demonstrated experience developing distributed data processing solutions.
  • Applied knowledge of cloud computing (AWS, GCP, Azure).
  • Knowledge of open source machine learning toolkits, such as sklearn, SparkML, or H2O.
  • Solid data understanding and business acumen in the data rich industries like insurance or financial
  • Applied knowledge of data modeling principles (e.g. dimensional modeling and star schemas).
  • Strong understanding of database internals, such as indexes, binary logging, and transactions.
  • Experience using tools for infrastructure-as-code (e.g. Docker, CloudFormation, Terraform, etc.)
  • Experience with software engineering tools and workflows (i.e. Jenkins, CI/CD, git).
  • Practical experience authoring and consuming web services.

Benefits & conditions

Pay Rate Type: Salary, * Offer to selected candidate will be made contingent on the results of applicable background checks

  • Offer to selected candidate is contingent on signing a non-disclosure agreement for proprietary information, trade secrets, and inventions
  • Sponsorship will not be considered for this position unless specified in the posting

We provide benefits that support your physical, emotional, and financial wellbeing. You will have access to comprehensive medical, dental, vision and wellbeing benefits that enable you to take care of your health. We also offer a competitive 401(k) contribution, a pension plan, an annual incentive, 9 paid holidays and a paid time off program (23 days accrued annually for full-time employees). In addition, our student loan repayment program and paid-family leave are available to support our employees and their families. Interns and contingent workers are not eligible for American Family Insurance Group benefits. We are an equal opportunity employer. It is our policy to comply with all applicable federal, state and local laws pertaining to non-discrimination, non-harassment and equal opportunity. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. American Family Insurance is committed to the full inclusion of all qualified individuals. If a reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and/or to receive other benefits and privileges of employment, please email to request a reasonable accommodation. #LI-BC2, + $76,000-125,000 per year Help us change lives At Exact Sciences, we’re helping change how the world prevents, detects and guides treatment for cancer. We give patients and clinicians the clarity needed t…

  • 2 days ago + *, + $101,000-172,000 per year Help us change lives At Exact Sciences, we’re helping change how the world prevents, detects and guides treatment for cancer. We give patients and clinicians the clarity needed t…

  • 13 days ago + *, + $101,000-172,000 per year Help us change lives At Exact Sciences, we’re helping change how the world prevents, detects and guides treatment for cancer. We give patients and clinicians the clarity needed t…

  • 25 days ago + *

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on careerjet.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

2:37 min

Comparing traditional SQL tables versus NoSQL non-tabular databases

Stanimira Vlaeva · JS Congress

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · WWC 2025

1:34 min

Bringing diverse skills to industrial data science roles

Katja Träumner

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

Videos

See all

Related articles

See all