> Markdown version of [/jobs/ext/157420-enterprise-data-warehouse-edw-etl-data-engineer](https://www.wearedevelopers.com/jobs/ext/157420-enterprise-data-warehouse-edw-etl-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Enterprise Data Warehouse (EDW) ETL/Data Engineer - **Company:** Critical Skills, Inc. - **Location:** United States (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Query Performance, Artificial Intelligence, Data Analysis, Unit Testing, Microsoft Azure, Bash Shell, Code Review, Computer Networks, Continuous Integration, Information Engineering, Extract Transform Load (ETL), Data Systems, Data Vault Modeling, Data Warehousing, DevOps, Distributed Computing Environment, Apache Hive, Python (Programming Language), Key Management, Log Analysis, Microsoft SQL Server, SQL Azure, Oracle (Applications), Performance Tuning, Windows PowerShell, Query Optimization, Role-Based Access Control, Release Management, Software Tools, Azure Active Directory, Kusto Query Language, Azure Data Lake, SQL Databases, SQL Server Integration Services, Data Streaming, Teradata SQL, Transact-SQL, YAML, Parquet, Data Logging, Cloud Platform System, Azure Data Factory, Sql Optimization, Cloud Monitoring, Informatica Powercenter, Snowflake, Apache Spark, Change Data Capture, Indexer, Pandas, Microsoft Fabric, Pytest, Data Lakes, Pyspark, Git Flow, Bicep, Cloud Optimization, Restful APIs, Terraform, Azure Synapse Analytics, Data Pipelines, Serverless Computing, Databricks - **Published:** May 29, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=2655650a85cb9fcd ## About the Role Do you have experience in Unit testing?, * Deep hands-on expertise with Azure Data Factory, including pipelines, datasets, linked services, triggers, parameterization, mapping data flows, and Integration Runtime types (Azure, Self-hosted, and SSIS) * Strong experience with Azure Databricks and PySpark * Production experience with one or more of the following: + Azure Synapse Analytics (Dedicated SQL Pools, Serverless SQL Pools, Spark Pools) + Azure Databricks (Delta Lake, Unity Catalog) + Microsoft Fabric (Warehouse, Lakehouse, OneLake) * Strong understanding of Azure Data Lake Storage Gen2, including hierarchical namespace, RBAC/ACL security, lifecycle management, and governance * Experience with Azure Key Vault, Azure AD / Entra ID, managed identities, service principals, and private networking concepts * Experience monitoring and troubleshooting data solutions using Azure Monitor, Log Analytics, and KQL * Advanced SQL skills including window functions, CTEs, query optimization, execution plan analysis, and performance tuning * Strong Python skills for data engineering, including pandas, PySpark, REST API integration, and unit testing with pytest * Proficiency with T-SQL and familiarity with Spark SQL, KQL, PowerShell, and Bash scripting, * 5+ years of enterprise data warehouse or data engineering experience * 5+ years of data modeling experience using ERWIN or similar modeling tools * 2+ years of experience with Azure Data Factory and Snowflake * Experience working in healthcare or Medicaid environments ## Description We are seeking a Senior Azure Data Engineer to help design, build, and support a next-generation enterprise data platform on Microsoft Azure. In this role, you will lead the development of scalable data pipelines and data products that power analytics, operational reporting, dashboards, and emerging AI/ML use cases. You'll work closely with data architects, analytics engineers, data scientists, platform teams, and business stakeholders to deliver secure, high-performing, and cost-effective cloud data solutions. This role is ideal for someone with deep hands-on experience in Azure data technologies, modern Lakehouse architectures, and enterprise-scale data migrations. What You'll Do Data Pipeline Engineering * Design and develop reusable, parameter-driven ingestion and transformation pipelines using Azure Data Factory, Synapse Pipelines, Databricks, and/or Microsoft Fabric Data Factory * Build and maintain medallion architecture (Bronze / Silver / Gold) solutions using Azure Data Lake Storage Gen2, Delta Lake, Parquet, and structured streaming patterns * Develop performant ELT workflows leveraging pushdown processing to platforms such as Synapse Dedicated SQL Pool, Azure SQL, and Teradata * Create and optimize PySpark notebooks and distributed processing jobs in Azure Databricks or Synapse Spark Data Warehousing & Modeling * Design dimensional data models using Kimball star and snowflake methodologies * Implement data vault patterns, Slowly Changing Dimensions (Type 1/2/3), Change Data Capture, and late-arriving data strategies * Optimize distributed SQL workloads in Synapse Dedicated SQL Pool and/or Fabric Warehouse environments * Tune partitioning, indexing, and query performance for enterprise-scale datasets Cloud Platform Engineering & DevOps * Implement CI/CD processes for data pipelines using Azure DevOps, YAML pipelines, ARM templates, Bicep, and/or Terraform * Build monitoring, logging, and auditing solutions using Azure Monitor, Log Analytics, and KQL * Support code reviews, branching strategies, release management, and engineering standards across environments * Participate in troubleshooting and production incident response for critical data pipelines Migration & Modernization * Lead or contribute to cloud modernization initiatives, including Informatica PowerCenter to Azure Data Factory migrations * Support migration efforts from on-premises Teradata, Oracle, or SQL Server environments to Azure Synapse or Microsoft Fabric * Assist with workload assessments, capacity planning, and cloud cost optimization initiatives ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [pytest: Simple, rapid and fun testing with Python](https://www.wearedevelopers.com/videos/213-pytest-simple-rapid-and-fun-testing-with-python) - [Back(end) to the Future: Embracing the continuous Evolution of Infrastructure and Code](https://www.wearedevelopers.com/videos/440-back-end-to-the-future-embracing-the-continuous-evolution-of-infrastructure-and-code) - [CI/CD with Github Actions](https://www.wearedevelopers.com/videos/856-ci-cd-with-github-actions) - [Automagic Configuration in Python](https://www.wearedevelopers.com/videos/363-automagic-configuration-in-python) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)