> Markdown version of [/jobs/ext/2570342-data-engineer-ii](https://www.wearedevelopers.com/jobs/ext/2570342-data-engineer-ii). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer II

- **Company:** Metropolitan Life Insurance Company
- **Location:** Cary, NC, United States
- **Experience:** Experienced
- **Contract:** Permanent contract
- **Skills:** Microsoft Azure, Cloud Database, Profiling, Information Systems, Data Validation, Information Engineering, Extract Transform Load (ETL), Apache Hive, Python (Programming Language), Standard Sql, SQL Databases, Data Processing, Azure Data Factory, Data Lakes, Pyspark, Information Technology, Data Analytics, Data Pipelines, Databricks
- **Published:** August 9, 2026
- **Apply:** https://us.experteer.com/career/view-jobs/data-engineer-ii-cary-nc-usa-58896335

## About the Role

comply analyze root causes, document findings, and collaborate with Business/Tech/Operations/Data & Analytics teams to resolve defects * Design, develop, and optimize scalable data processing and validation solutions for reporting, analytics, and operational decision-making * Implement and support Delta Lake and Lakehouse architectures for reliable, scalable data processing * Ensure data processing/validation solutions comply with security, quality, and operational standards * Contribute to reusable validation frameworks, engineering standards, playbooks, and platform improvements Tasks * Bachelor's or Master's degree in computer science, engineering, information systems, mathematics, statistics, operations research, or related quantitative field, or equivalent experience * 3-5 years of experience in data engineering, analytics engineering, data validation engineering, or related disciplines * Strong hands-on experience with Python, PySpark, Spark SQL, and/or SQL * Experience building, aaaa
plan validating, and supporting ETL/ELT pipelines using Azure Data Factory, Databricks, and Delta Lake architectures * Experience developing, troubleshooting, and optimizing scalable cloud-based data solutions in Azure, including data quality, reconciliation, and validation activities Key requirements * Comprehensive health plan (medical, vision, dental) * Disability and life insurance * 401(k) with employer matching * Tuition assistance * Parental leave * Paid time off and holidays

## Description

Experteer Overview In this Data Engineer II role, you will build and validate data pipelines for enterprise assets within MetLife's Data Office. You'll focus on data quality, validation, and scalable processing in Azure Data Factory and Databricks, partnering across engineering, analytics, and operations. The position offers hands-on engineering with growth into broader pipeline improvement and platform care. You'll contribute to a data-driven culture that powers analytics and informed decision-making, in a hybrid Cary, NC setting. Compensation / Benefits * Perform data validation for enterprise assets including source-to-target validation, profiling, anomaly detection, and defect analysis * Develop automated validation, testing, and data quality controls using Python, PySpark, Spark SQL, SQL, and related frameworks * Build, enhance, and support ETL/ELT pipelines using Azure Data Factory, Databricks, Python, PySpark, and Spark SQL with focus on validation/quality * Troubleshoot data issues, analyze root causes, document findings, and collaborate with Business/Tech/Operations/Data & Analytics teams to resolve defects * Design, develop, and optimize scalable data processing and validation solutions for reporting, analytics, and operational decision-making * Implement and support Delta Lake and Lakehouse architectures for reliable, scalable data processing * Ensure data processing/validation solutions comply with security, quality, and operational standards * Contribute to reusable validation frameworks, engineering standards, playbooks, and platform improvements Tasks * Bachelor's or Master's degree in computer science, engineering, information systems, mathematics, statistics, operations research, or related quantitative field, or equivalent experience * 3-5 years of experience in data engineering, analytics engineering, data validation engineering, or related disciplines * Strong hands-on experience with Python, PySpark, Spark SQL, and/or SQL * Experience building, testing, validating, and supporting ETL/ELT pipelines using Azure Data Factory, Databricks, and Delta Lake architectures * Experience developing, troubleshooting, and optimizing scalable cloud-based data solutions in Azure, including data quality, reconciliation, and validation activities Key requirements * Comprehensive health plan (medical, vision, dental) * Disability and life insurance * 401(k) with employer matching * Tuition assistance * Parental leave * Paid time off and holidays


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Profiling Symfony & PHP apps with Blackfire](https://www.wearedevelopers.com/videos/265-profiling-symfony-php-apps-with-blackfire)
- [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads)

## Related Articles

- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)
- [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)