> Markdown version of [/jobs/ext/4273205-data-engineer-ii](https://www.wearedevelopers.com/jobs/ext/4273205-data-engineer-ii). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer II

- **Company:** Essentia Health
- **Location:** Duluth, MN, United States (Remote available)
- **Experience:** Experienced
- **Salary:** $89,523.0 - $134,285.0
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Artificial Intelligence, Airflow, Automation of Tests, Batch Processing, Big Data, Computer Programming, Databases, Information Engineering, Data Transformation, Data Systems, Python (Programming Language), Meta-Data Management, Metadata Repositories, SQL Databases, Data Streaming, Workflow Management Systems, Data Processing, Freeform SQL, Data Ingestion, Apache Spark, Microsoft Fabric, Data Lakes, Information Technology, AWS Glue, Data Analytics, Data Management, Stream Analytics, Data Pipelines
- **Published:** October 18, 2026
- **Apply:** https://essentiahealth.wd1.myworkdayjobs.com/Essentia_Health/job/Duluth-MN/Data-Engineer-II_R084146

## About the Role

* Bachelor's degree in computer science, data analytics, statistics, or related field, * 2-5 years of experience in data engineering or a related role
 * Proficiency in SQL and experience with database management systems
 * Strong programming skills in languages such as Python, Java, or Scala
 * Experience with pipelines using orchestration tools such as Apache Airflow or AWS Glue for seamless data ingestion and delivery
 * Experience with modern data management technologies (e.g., data lake, lakehouse, data catalogs)
 * Experience supporting both batch and streaming data, enabling near real-time analytics and reporting

Preferred Qualifications:

 * Familiarity with applying AI and machine learning techniques to data use cases
 * Experience creating robust data transformation workflows, including metadata management, dependency tracking, and workload orchestration
 * Experience with DBT
 * Experience with Microsoft Fabric
 * Excellent problem-solving skills and attention to detail
 * Strong communication and collaboration skills

## Description

The Data Engineer II is responsible for designing and optimizing scalable and complex data pipelines and workflows to handle large datasets. They are expected to implement advanced data processing and scheduling techniques using frameworks like Apache spark, ADF and airflow. Ensures data quality, governance, and security through automated testing and monitoring solutions. Collaborate with cross-functional teams to support data-driven decision-making and ensure the scalability and efficiency of data systems., * Designs and optimizes scalable and robust data pipelines and workflows to handle large datasets to meet functional and non-functional business requirement

 * Implements advanced data processing and scheduling techniques using frameworks like Apache Spark, ADF and Airflow
 * Write and optimize advanced SQL queries for reporting and applications
 * Ensures data quality, governance, and security through automated testing and monitoring solutions
 * Work closely with data scientists, analysts, and other stakeholders to understand data requirements
 * Provide technical guidance and mentorship to junior data engineers
 * Develop infrastructure to support real-time and batch processing workflows
 * Deliver actionable data products and insights for business-critical tools