Data Engineer
Role details
Job location
Tech stack
Job description
- Design and develop scalabledata pipelinesusingDatabricks, Apache Spark, and Pythonon Azure
- Build cloud-native solutions leveragingAzure Data Lake, Azure Data Factory, and Delta Lake
- Collaborate withData Science and AI teamsto operationalize ML models and embed them into production workflows
- Develop and maintainfeature stores, model input pipelines, and real-time/streaming frameworks
- Ensuredata quality, governance, and securityacross the full data lifecycle
- Build reusable frameworks, accelerators, and automation scripts to improve engineering efficiency
- Optimize performance, scalability, and reliability of data workflows and batch/streaming pipelines
- Participate inAgile developmentprocesses, including sprint planning, code reviews, and CI/CD pipelines
- Provideproduction support and on-call coverage, ensuring system stability and rapid issue resolution
- Design, develop, and deploy AI-powered solutions to address complex business challenges with emphasis on responsible use of AI
You'll be rewarded and recognized for your performance in an environment that will challenge you and give you clear directions on what it takes to succeed in your role as well as provide development for other roles you may be interested in.
Requirements
- Bachelor's degree in Computer Science, Engineering, or IT related field
- 6+ yearsof experience in Data Engineering withPython/PySpark
- 6+ yearsof experience in building ETL/ELT pipelines using Databricks
- 6+ years of experience working inAgile environments
- 5+ years of strong experience inSQL / PL-SQL
- 4+ years of experience with Azure Databricks and Delta Lake architecture
- 4+ years of hands-on experience withCI/CD (GitHub Actions, Azure DevOps)
- 3+ years of hands-on experience withAzure cloud services(ADF, ADLS, Databricks)
- 2+ yearsof experience withDatabricks Delta Live Tables (DLT)
- 2+ years of experience withunit testing, validation, and pipeline testing frameworks
Preferred Qualifications:
- Familiarity withmedallion architecture and SCD2 implementations
- AI builder: Design, develop, and deploy AI-powered solutions to address complex business challenges with emphasis on responsible use of AI
- Experience buildingenterprise-scale data platforms
- Strong skills inperformance tuning and debugging large-scale pipelines
- Experience withreal-time/streaming frameworks (Structured Streaming)
- Ability to work indistributed, cross-functional global teams
- Exposure toGenAI tools(e.g., GitHub Copilot) for engineering productivity
- Strong understanding ofsecure coding practices and vulnerability remediation
- Proven ability toanalyze logs, troubleshoot production issues, and optimize performance
- Demonstrated capability todesign and deploy AI-powered solutions responsibly
*All Telecommuters will be required to adhere to UnitedHealth Group's Telecommuter Policy.
Benefits & conditions
Pay is based on several factors including but not limited to local labor markets, education, work experience, certifications, etc. In addition to your salary, we offer benefits such as, a comprehensive benefits package, incentive and recognition programs, equity stock purchase and 401k contribution (all benefits are subject to eligibility requirements). No matter where or when you begin a career with us, you'll find a far-reaching choice of benefits and incentives. The salary for this role will range from $72,800 to $130,000 annually based on full-time employment. We comply with all minimum wage laws as applicable.
Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.