Sr. Data Engineer

Optum, Inc
Eden Prairie, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 164K

Job location

Remote
Eden Prairie, United States of America

Tech stack

Artificial Intelligence
Data analysis
Unit Testing
Azure
Bash
Code Review
Continuous Integration
Data Systems
Data Vault Modeling
Data Warehousing
DevOps
Hive
Key Management
Log Analysis
Microsoft SQL Server
SQL Azure
Oracle Applications
Performance Tuning
Powershell
Query Optimization
Role-Based Access Control
Release Management
Azure
Kusto Query Language
Azure
SQL Databases
SQL Server Integration Services
Data Streaming
Teradata
T-SQL
YAML
Parquet
Data Logging
Scripting (Bash/Python/Go/Ruby)
Azure
Sql Optimization
Cloud Monitoring
Informatica Powercenter
Snowflake
Spark
Change Data Capture
Pandas
Build Management
Microsoft Fabric
Pytest
Data Lake
PySpark
Git Flow
Bicep
Software Coding
REST
Terraform
Azure
Virtual Private Clouds
Data Pipelines
Serverless Computing
Databricks

Job description

We are seeking a Senior Azure Data Engineer to help design, build, and operate our next-generation enterprise data platform on Microsoft Azure. You will own end-to-end delivery of data pipelines and data products that power analytics, regulatory reporting, operational dashboards, and emerging AI/ML use cases. You will partner closely with data architects, analytics engineers, data scientists, business stakeholders, and platform engineering teams to deliver reliable, performance, secure, and cost-efficient data solutions.

This role is ideal for an engineer with strong hands-on depth in Azure Data Factory, Azure Synapse Analytics and/or Databricks, and modern Lakehouse patterns, who is comfortable leading migration programs (e.g., Informatica-to-ADF, on-prem warehouse-to-cloud), mentoring mid-level engineers, and shaping engineering standards across the team.

You'll enjoy the flexibility to work remotely* from anywhere within the U.S. as you take on some tough challenges. For all hires in the Minneapolis or Washington, D.C. area, you will be required to work in the office a minimum of four days per week., * Design and build robust, reusable, parameter-driven ingestion and transformation pipelines using Azure Data Factory, Synapse Pipelines, Data Bricks and/or Microsoft Fabric Data Factory

  • Implement medallion architecture (Bronze / Silver / Gold) on Azure Data Lake Storage Gen2 using Delta Lake, Parquet, and structured streaming patterns
  • Build performant ELT workflows that leverage pushdown to source systems (Synapse Dedicated SQL Pool, Azure SQL, Teradata) where appropriate
  • Develop and optimize PySpark notebooks and jobs on Azure Databricks or Synapse Spark

Data Modeling & Warehousing

  • Design dimensional models (Kimball star/snowflake) and data vault patterns for analytics consumption
  • Implement Slowly Changing Dimensions (Type 1/2/3), Change Data Capture, and late-arriving data patterns
  • Tune distributed SQL workloads in Synapse Dedicated SQL Pool / Fabric Warehouse, including distribution keys, partitioning, and clustered column store indexes

Platform Engineering & DevOps

  • Implement CI/CD for data pipelines using Azure DevOps (YAML pipelines, ARM/Bicep/Terraform) across Dev / SIT / UAT / Prod environments
  • Instrument pipelines with robust logging, auditing, and monitoring using Azure Monitor, Log Analytics, and KQL
  • Define and enforce coding standards, code review practices, branching strategies, and release management

Migration & Modernization

  • Lead or contribute to legacy-to-cloud migrations - e.g., Informatica PowerCenter to Azure Data Factory, on-premises Teradata / Oracle / SQL Server to Synapse or Fabric
  • Perform workload assessment, capacity planning, and cost modeling for target-state architectures
  • Production incident response for critical pipelines

You'll be rewarded and recognized for your performance in an environment that will challenge you and give you clear direction on what it takes to succeed in your role as well as provide development for other roles you may be interested in.

Requirements

Do you have experience in Virtual Private Clouds?, * Deep hands-on expertise with Azure Data Factory: pipelines, datasets, linked services, triggers, parameterization, mapping data flows, and all three Integration Runtime types (Azure, Self-hosted, SSIS)

  • Demonstrated Experience in Data Bricks and PySpark

  • Production experience with one or more of: Azure Synapse Analytics (Dedicated and Serverless SQL Pools, Spark Pools) OR Azure Databricks (Delta Lake, Unity Catalog) OR Microsoft Fabric (Warehouse, Lakehouse, OneLake)

  • Demonstred working knowledge of Azure Data Lake Storage Gen2 (hierarchical namespace, RBAC + ACLs, lifecycle management, security)

  • Experience with Azure Key Vault, Azure AD / Entra ID (including managed identities and service principals), and private networking (VNet integration, private endpoints)

  • Monitoring and troubleshooting with Azure Monitor, Log Analytics, and KQL

  • Advanced SQL - window functions, CTEs, query optimization, execution plan analysis, performance tuning

  • Demonstrated Python for data engineering - pandas, PySpark, REST API integration, unit testing (pytest)

  • Proficient in T-SQL; familiarity with Spark SQL, KQL, PowerShell, and Bash shell scripting

  • Must be willing/able to travel approximately 10% of the time as business needs dictate (occasional travel to Springfield, IL two to three times per year), * 5+ years of data warehouse development experience

  • 5+ years of data modeling experience using ERWIN or similar tools

  • 2+ years of experience with Azure Data Factory and Snowflake

  • Medicaid Domain Knowledge

All employees working remotely will be required to adhere to UnitedHealth Group's Telecommuter Policy

Benefits & conditions

Pay is based on several factors including but not limited to local labor markets, education, work experience, certifications, etc. In addition to your salary, we offer benefits such as, a comprehensive benefits package, incentive and recognition programs, equity stock purchase and 401k contribution (all benefits are subject to eligibility requirements). No matter where or when you begin a career with us, you'll find a far-reaching choice of benefits and incentives. The salary for this role will range from $91,700 to $163,700 annually based on full-time employment. We comply with all minimum wage laws as applicable.

About the company

At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission. UnitedHealth Group is an Equal Employment Opportunity employer under applicable law and qualified applicants will receive consideration for employment without regard to race, national origin, religion, age, color, sex, sexual orientation, gender identity, disability, or protected veteran status, or any other characteristic protected by local, state, or federal laws, rules, or regulations. UnitedHealth Group is a drug - free workplace. Candidates are required to pass a drug test before beginning employment.   You must create an Indeed account before continuing to the company website to apply

Apply for this position