Senior Data Engineer

Mgic Investment Corporation
Milwaukee, WI, United States
5 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Agile Methodology Artificial Intelligence Airflow Amazon Web Services Amazon S3 Data Analysis ARM Architecture Automation of Tests Code Review Information Systems Databases
+17 more
Continuous Integration Directed Acyclic Graph (Directed Graphs) Information Engineering Data Infrastructure Data Integration Extract Transform Load (ETL) Dimensional Modeling Identity and Access Management Python (Programming Language) Shell Script SQL Databases Macros Snowflake Git Flow Information Technology Data Analytics Functional Programming

Job description

Experteer Overview Join MGIC to help build the next generation data platform as part of the Data & Analytics team. You will design and deliver a Snowflake-centered data platform with automated ingestion, analytics-ready transformations, and robust orchestration. This role combines engineering excellence with governance and observability to deliver trusted data for stakeholders. You’ll shape the platform roadmap and collaborate across business, security, and engineering teams to drive a data-driven transformation. Compensation / Benefits * Define and evolve data integration frameworks and governance for a modern cloud data platform * Design scalable Snowflake architectures (databases, schemas, warehouses, access controls) and optimize cost/performance * Build and operate batch and incremental ingestion with Fivetran; manage schema changes and monitoring * Develop modular dbt models with tests, documentation, lineage, and incremental strategies * Author, schedule, deploy, and monitor Airflow workflows on Astronomer; manage dependencies, retries, alerts, and backfills * Implement observability and data-quality controls across ingestion, orchestration, and transformation layers * Partner with business, analytics, architecture, security, and engineering teams to translate requirements into durable data products and a long-term platform roadmap * Deliver changes via Git workflows, automated tests, code reviews, and CI/CD across dbt and Airflow * Troubleshoot data and pipeline issues across source systems, Fivetran, Astronomer, dbt, Snowflake, and downstream layers * Evaluate Cortex Code capabilities and plan AI-assisted engineering adoption with governance and security guardrails * Lead design and code reviews, share best practices, and mentor junior data engineers Tasks * Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field, or relevant experience * 5+ years data engineering experience with cloud data warehousing, dimensional modeling, ETL/ELT, analytics enablement, and production pipeline support * Hands-on Snowflake experience with SQL, data loading/transformation, and cost-conscious operation * Production-grade dbt projects with modular models, tests, docs, lineage, incremental models, macros, packages, and CI/CD * Experience building Airflow DAGs and familiarity with Astronomer or managed Airflow platforms * Experience implementing managed ELT with Fivetran, including connectors and schema evolution * Strong Python and SQL; API, data formats, shell scripting, and Git workflows * Experience with AWS services (S3, Lambda, IAM) and Agile / end-to-end automation * Knowledge of Cortex Code or willingness to adopt AI-assisted development with governance and security * Strong communication, problem-solving, and collaboration skills and ability to mentor others Key requirements * Competitive Salary & pay-for-performance bonus * 401k with company match, profit sharing, HSA, wellness program * On-site Fitness Center and classes * Paid-time off and paid holidays * Business casual dress

Requirements

Airflow workflows on Astronomer; manage dependencies, retries, alerts, and backfills * Implement observability and data-quality controls across ingestion, orchestration, and transformation layers * Partner with business, analytics, architecture, security, and engineering teams to translate requirements into durable data products and a long-term platform roadmap * Deliver changes via Git workflows, automated tests, code reviews, and CI/CD across dbt and Airflow * Troubleshoot data and pipeline issues across source systems, Fivetran, Astronomer, dbt, Snowflake, and downstream layers * Evaluate Cortex Code capabilities and plan AI-assisted engineering adoption with governance and security guardrails * Lead design and code reviews, share best practices, and mentor junior data engineers Tasks * Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field, or relevant experience * 5+ years data engineering experience with cloud data warehousing, dimensional aaaaaa and ETL/ELT, analytics enablement, and production pipeline support * Hands-on Snowflake experience with SQL, data loading/transformation, and cost-conscious operation * Production-grade dbt projects with modular models, tests, docs, lineage, incremental models, macros, packages, and CI/CD * Experience building Airflow DAGs and familiarity with Astronomer or managed Airflow platforms * Experience implementing managed ELT with Fivetran, including connectors and schema evolution * Strong Python and SQL; API, data formats, shell scripting, and Git workflows * Experience with AWS services (S3, Lambda, IAM) and Agile / end-to-end automation * Knowledge of Cortex Code or willingness to adopt AI-assisted development with governance and security * Strong communication, problem-solving, and collaboration skills and ability to mentor others Key requirements * Competitive Salary & pay-for-performance bonus * 401k with company match, profit sharing, HSA, wellness program * On-site Fitness Center and classes * Paid-time off and paid holidays * Business casual dress

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on us.experteer.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · WWC Europe 2026

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:03 min

Exploring declarative and procedural macro subtypes in Rust environments

Mykhailo Maidan · LIVE

5:02 min

Mapping Git flow branches to application tester segments

Majid Hajian · LIVE

1:59 min

Navigating the disadvantages and maintenance costs of procedural macros

Mykhailo Maidan · LIVE

3:53 min

Introduction to git flow and clean feature branches

Johannes Haux · WWC 2022

Videos

See all

Related articles

See all