Data Engineer
Role details
Job location
Tech stack
Job description
As a Senior Data Engineer on the UHC Core Data KTLO team, you will join our dynamic technology organization in Eden Prairie, MN, dedicated to building and optimizing robust data pipelines and systems that power critical healthcare platforms. In this role, you will design and deliver modern data and AI-powered solutions, platforms, and automations for enterprise scale. You will work with state-of-the-art technologies such as Python, Spark, Scala, and Kafka to build scalable, high-performance data processing pipelines and apply data warehousing and modeling best practices. You will play a key role in driving innovation by identifying opportunities to streamline workflows, automate tasks, and leverage advanced tools to address complex business challenges. Focus on KTLO activities, including vulnerability remediation, tool and version upgrades, data security, and platform stability. Additionally, support Azure Data Factory pipelines, Databricks workloads, and cloud components such as Blob Storage and AzCopy., * Design, develop, and deploy AI-powered solutions to address complex business challenges with emphasis on responsible use of AI
- Evaluate emerging trends to inform solution design and strategic innovation
- Use enterprise-approved AI tools to streamline workflows, automate tasks, and drive continuous improvement
- Build, optimize, and maintain robust, scalable data pipelines and processes using Python, Spark, and Scala
- Support and enhance real-time streaming data applications and messaging systems using Kafka
- Apply and promote data warehousing, data modeling, and database design best practices
- Collaborate with cross-functional teams to understand data requirements and translate them into high-performing technical solutions
- Identify and implement performance tuning and query optimization across large-scale datasets
You'll be rewarded and recognized for your performance in an environment that will challenge you and give you clear direction on what it takes to succeed in your role as well as provide development for other roles you may be interested in.
Requirements
- 5+ years of experience in data engineering, software engineering, or related field
- 3+ years of experience building and optimizing data processes and pipelines using Python, SQL,Spark, and Scala
- 3+ years of experience with data warehousing, dimensional data modeling, and database design
- 2+ years of experience supporting streaming data architectures and messaging platforms with Apache Kafka
- 2+ years of experience designing and deploying scalable automated solutions, platforms, or workflows (including integration of automation tools)
- 1+ years of experience with Apache Airflow for workflow orchestration, scheduling, and monitoring of data pipelines
Preferred Qualifications
- Bachelor's degree in Computer Science, Data Science, Information Technology, or a related field
- Experience working with cloud data platforms (e.g., AWS, Azure, or Snowflake)
- Experience with CI/CD pipelines, containerization (e.g., Docker, Kubernetes), and version control (Git)
- Experience evaluating emerging technology trends and applying modern automation tools to streamline engineering workflows
- Experience with relational and NoSQL databases
- Strong analytical and problem-solving skills, with a track record of applying responsible design standards
- Familiarity with IBM DataStage for legacy ETL development and integration with enterprise data platforms
- Experience working with healthcare data and understanding of compliance, regulatory, and data privacy standards
- Hands-on experience with Teradata for large-scale data warehousing, query optimization, and performance tuning
- Proficiency in Unix/Linux environments with scripting capabilities for automation and operational support
Benefits & conditions
Pay is based on several factors including but not limited to local labor markets, education, work experience, certifications, etc. In addition to your salary, we offer benefits such as, a comprehensive benefits package, incentive and recognition programs, equity stock purchase and 401k contribution (all benefits are subject to eligibility requirements). No matter where or when you begin a career with us, you'll find a far-reaching choice of benefits and incentives. The salary for this role will range from $91,700 to $163,700 annually based on full-time employment. We comply with all minimum wage laws as applicable.