Senior Data Engineer

Experteer Overview In this role you will drive the migration of legacy data assets to a modern cloud lakehouse, enabling faster, secure data access for downstream consumers. You’ll collaborate with cross-functional teams to design robust ingestion pipelines and scalable data-sharing solutions, using AI-assisted tooling to boost productivity. The position sits in the Magnus Lake House team within Optum Insight, with hybrid work options in Eden Prairie, MN or Raleigh, NC. You will shape data architectures and impact health outcomes by improving data availability and performance. Compensation / Benefits * Design and implement robust data ingestion patterns to migrate legacy data warehouse assets into the Magnus Lake House * Develop and deploy scalable data-sharing solutions for efficient data access by consumers * Build and manage automated data pipelines using Azure Data Factory (ADF) to ingest and process files within Databricks * Utilize the dbt framework to perform complex data transformations following Medallion Architecture (Bronze, Silver, Gold) * Interpret, maintain, and enhance codebases in Java and Python to support project needs * Collaborate with cross-functional teams to ensure security, scalability, and performance of data pipelines * Leverage enterprise AI tooling to streamline development workflows and improve code quality Tasks * Bachelor’s degree in Computer Science, Mathematics, or related field, or 4+ years of equivalent experience * 5+ years in data engineering or software development * 3+ years of professional programming in Python or Java (read/modify both) * 2+ years building data pipelines in Azure (ADF, Databricks) * 1+ year experience using AI-assisted development tools (e.g., GitHub Copilot, Codex) Key requirements * comprehensive benefits package * equity stock purchase * 401k contribution * incentive and recognition programs

FULL_TIME following Medallion Architecture (Bronze, Silver, Gold) * Interpret, maintain, and enhance codebases in Java and Python to support project needs * Collaborate with cross-functional teams to ensure security, scalability, and performance of data pipelines * Leverage enterprise AI tooling to streamline development workflows and improve code quality Tasks * Bachelor’s degree in Computer Science, Mathematics, or related field, or 4+ years of equivalent experience * 5+ years in data engineering or software development * 3+ years of professional programming in Python or Java (read/modify both) * 2+ years building data pipelines in Azure (ADF, Databricks) * 1+ year experience using AI-assisted development tools (e.g., GitHub Copilot, Codex) Key requirements * comprehensive benefits package * equity stock purchase * 401k contribution * incentive and recognition programs