Senior Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+17 more
Job description
Experteer Overview Join MGIC to help build the next generation data platform as part of the Data & Analytics team. You will design and deliver a Snowflake-centered data platform with automated ingestion, analytics-ready transformations, and robust orchestration. This role combines engineering excellence with governance and observability to deliver trusted data for stakeholders. You’ll shape the platform roadmap and collaborate across business, security, and engineering teams to drive a data-driven transformation. Compensation / Benefits * Define and evolve data integration frameworks and governance for a modern cloud data platform * Design scalable Snowflake architectures (databases, schemas, warehouses, access controls) and optimize cost/performance * Build and operate batch and incremental ingestion with Fivetran; manage schema changes and monitoring * Develop modular dbt models with tests, documentation, lineage, and incremental strategies * Author, schedule, deploy, and monitor Airflow workflows on Astronomer; manage dependencies, retries, alerts, and backfills * Implement observability and data-quality controls across ingestion, orchestration, and transformation layers * Partner with business, analytics, architecture, security, and engineering teams to translate requirements into durable data products and a long-term platform roadmap * Deliver changes via Git workflows, automated tests, code reviews, and CI/CD across dbt and Airflow * Troubleshoot data and pipeline issues across source systems, Fivetran, Astronomer, dbt, Snowflake, and downstream layers * Evaluate Cortex Code capabilities and plan AI-assisted engineering adoption with governance and security guardrails * Lead design and code reviews, share best practices, and mentor junior data engineers Tasks * Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field, or relevant experience * 5+ years data engineering experience with cloud data warehousing, dimensional modeling, ETL/ELT, analytics enablement, and production pipeline support * Hands-on Snowflake experience with SQL, data loading/transformation, and cost-conscious operation * Production-grade dbt projects with modular models, tests, docs, lineage, incremental models, macros, packages, and CI/CD * Experience building Airflow DAGs and familiarity with Astronomer or managed Airflow platforms * Experience implementing managed ELT with Fivetran, including connectors and schema evolution * Strong Python and SQL; API, data formats, shell scripting, and Git workflows * Experience with AWS services (S3, Lambda, IAM) and Agile / end-to-end automation * Knowledge of Cortex Code or willingness to adopt AI-assisted development with governance and security * Strong communication, problem-solving, and collaboration skills and ability to mentor others Key requirements * Competitive Salary & pay-for-performance bonus * 401k with company match, profit sharing, HSA, wellness program * On-site Fitness Center and classes * Paid-time off and paid holidays * Business casual dress
Requirements
Airflow workflows on Astronomer; manage dependencies, retries, alerts, and backfills * Implement observability and data-quality controls across ingestion, orchestration, and transformation layers * Partner with business, analytics, architecture, security, and engineering teams to translate requirements into durable data products and a long-term platform roadmap * Deliver changes via Git workflows, automated tests, code reviews, and CI/CD across dbt and Airflow * Troubleshoot data and pipeline issues across source systems, Fivetran, Astronomer, dbt, Snowflake, and downstream layers * Evaluate Cortex Code capabilities and plan AI-assisted engineering adoption with governance and security guardrails * Lead design and code reviews, share best practices, and mentor junior data engineers Tasks * Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field, or relevant experience * 5+ years data engineering experience with cloud data warehousing, dimensional aaaaaa and ETL/ELT, analytics enablement, and production pipeline support * Hands-on Snowflake experience with SQL, data loading/transformation, and cost-conscious operation * Production-grade dbt projects with modular models, tests, docs, lineage, incremental models, macros, packages, and CI/CD * Experience building Airflow DAGs and familiarity with Astronomer or managed Airflow platforms * Experience implementing managed ELT with Fivetran, including connectors and schema evolution * Strong Python and SQL; API, data formats, shell scripting, and Git workflows * Experience with AWS services (S3, Lambda, IAM) and Agile / end-to-end automation * Knowledge of Cortex Code or willingness to adopt AI-assisted development with governance and security * Strong communication, problem-solving, and collaboration skills and ability to mentor others Key requirements * Competitive Salary & pay-for-performance bonus * 401k with company match, profit sharing, HSA, wellness program * On-site Fitness Center and classes * Paid-time off and paid holidays * Business casual dress
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on us.experteer.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Dev Digest 120 - Apple and peers
Dev Digest 132 - Binging WADFlix?
Making Data Warehouses Fast: A Developer’s Story
Dev Digest 121 - AI goes offline