> Markdown version of [/jobs/ext/2978144-data-engineer](https://www.wearedevelopers.com/jobs/ext/2978144-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Empower Professionals - **Location:** United States (Remote available) - **Contract:** Temporary contract - **Skills:** Business Logic, Cloud Computing, Data Architecture, Data Infrastructure, Data Integrity, Data Transformation, Data Structures, Apache Hive, Metadata, Query Optimization, SQL Stored Procedures, SQL Databases, Data Streaming, Transact-SQL, Enterprise Data Management, Build Management, Microsoft Fabric, Pyspark, Data Management, Data Pipelines - **Published:** September 18, 2026 - **Apply:** https://www.dice.com/job-detail/a7753328-32bf-4306-869e-405e0bdb9d90 ## About the Role 5-7+ years of experience as a Data Engineer or similar role. 1-2+ years of hands-on experience with Microsoft Fabric. Strong expertise in SQL and T-SQL, including: Stored procedures Query optimization Data transformations SQL-based business logic Experience migrating or translating SQL-based processing into modern cloud-based data platforms. Strong hands-on experience with: PySpark Spark SQL Microsoft Fabric Notebooks Experience developing and managing data pipelines and orchestration workflows. Deep understanding of: Lakehouse architecture Microsoft Fabric data flows Data Pipelines Medallion Architecture concepts Experience building automated data quality, reconciliation, and validation frameworks. Strong technical documentation and communication skills. Preferred Qualifications Experience working with metadata-driven frameworks. Experience implementing orchestration and scheduling strategies within Microsoft Fabric. Familiarity with enterprise data migration initiatives. Experience supporting cloud-based analytics and modern data platform solutions. Technical Environment Microsoft Fabric Fabric Notebooks Fabric Data Pipelines Lakehouse Architecture Medallion Architecture (Silver Layer Focus) SQL / T-SQL ## Description We are seeking a Data Engineer to support a Microsoft Fabric modernization initiative focused on migrating existing on-premises SQL Stored Procedures workloads into a Fabric Lakehouse environment. This role will be responsible for converting SQL/T-SQL stored procedures into Fabric notebooks, building and orchestrating data pipelines, validating migrated datasets, and creating technical documentation to support ongoing operations. This position will primarily support the Silver Layer within a Medallion Architecture and will play a critical role in ensuring data accuracy, consistency, and scalability throughout the migration effort. Team structure is small, must be highly motivated and self-motivated. Will have access to some SMEs but this role is primarily responsible for the vast majority of the work here. Must be comfortable working in a small team with one other to deliver fast and quick with great quality., Convert existing SQL/T-SQL stored procedures into Microsoft Fabric Notebooks using PySpark and Spark SQL. Design and build the Silver Layer of a medallion architecture in Fabric using Lakehouse, ensuring parity between Fabric data structures and existing on-premises SQL environments. Develop and maintain orchestration frameworks using Microsoft Fabric Data Pipelines. Build automated validation and reconciliation processes to ensure migrated data matches source systems on a 1:1 basis. Create reusable testing frameworks and validation artifacts to continuously verify data integrity and accuracy. Support data pipeline monitoring, scheduling, and orchestration activities within Microsoft Fabric. Partner with architects, engineers, and business stakeholders to ensure successful migration outcomes. Develop and maintain technical documentation detailing solution design, implementation approaches, validation procedures, and operational support processes. Analyze and troubleshoot data issues across Fabric notebooks, pipelines, and Lakehouse objects. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [A Data Mesh needs Open Metadata](https://www.wearedevelopers.com/videos/505-a-data-mesh-needs-open-metadata) - [Data Analytics with Microsoft Fabric: End-to-End Use Case with Data Agents](https://www.wearedevelopers.com/videos/1547-data-analytics-with-microsoft-fabric-end-to-end-use-case-with-data-agents) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Crafting Custom Frameworks with Rust: A Deep Dive into Procedural Macros](https://www.wearedevelopers.com/videos/849-crafting-custom-frameworks-with-rust-a-deep-dive-into-procedural-macros) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)