Microsoft Fabric Data Engineer

The Microsoft Fabric Core Lead Engineer is responsible for leading the design, development, implementation, and support of enterprise-scale data and analytics solutions using Microsoft Fabric. The role provides technical leadership, drives architecture decisions, mentors engineering teams, and ensures successful delivery of scalable, secure, and high-performing data platforms., * Lead the end-to-end implementation of Microsoft Fabric solutions across enterprise programs.

• Define technical architecture, engineering standards, and best practices for Microsoft Fabric adoption.
• Provide technical leadership to a team of data engineers and developers.
• Review solution designs, code, and deployment strategies to ensure quality and scalability.

Microsoft Fabric Architecture

• Design and implement enterprise data platforms using Microsoft Fabric components including OneLake, Lakehouse, Data Warehouse, Data Factory, Real-Time Intelligence, Data Engineering, and Power BI.
• Architect scalable, cloud-native data solutions supporting analytics, AI, and business intelligence workloads.
• Establish reusable design patterns and reference architectures.

Data Engineering & Integration

• Design and develop robust ETL/ELT pipelines using Microsoft Fabric Data Factory and Spark Notebooks.
• Integrate structured, semi-structured, and unstructured data from cloud and on-premises systems.
• Implement data transformation, cleansing, validation, and orchestration processes.
• Optimize data ingestion strategies for performance and reliability.

Data Modeling & Analytics

• Design dimensional models, Lakehouse architectures, and enterprise data warehouses.
• Develop semantic models and datasets for Power BI reporting and self-service analytics.
• Collaborate with business teams to translate analytical requirements into scalable data solutions.

Performance Optimization

• Optimize Spark workloads, SQL Warehouse performance, and OneLake storage utilization.
• Implement partitioning, indexing, caching, and workload optimization strategies.
• Monitor platform performance and proactively resolve bottlenecks.

Security & Governance

• Implement enterprise security using Microsoft Entra ID, RBAC, and Fabric workspace security.
• Define governance policies for data quality, lineage, cataloging, auditing, and compliance.
• Ensure adherence to enterprise security, privacy, and regulatory standards.

DevOps & Automation

• Implement CI/CD pipelines using Azure DevOps or GitHub.
• Automate deployment of Microsoft Fabric artifacts across Development, QA, UAT, and Production environments.
• Manage source control, release management, and deployment automation.

AI & Advanced Analytics

• Enable AI, Machine Learning, and Copilot capabilities within Microsoft Fabric.
• Support Data Science workloads using Spark, notebooks, and ML models.
• Collaborate with AI teams to operationalize predictive analytics and intelligent data solutions.

Production Support & Operations

• Lead production deployments and post-production support activities.
• Monitor platform health, troubleshoot incidents, and ensure SLA compliance.
• Implement disaster recovery, backup, and business continuity strategies.

Stakeholder Management

• Collaborate with enterprise architects, product owners, business stakeholders, and cross-functional teams.
• Participate in architecture review boards and technical governance meetings.
• Communicate technical solutions and project status to senior leadership.

Team Leadership & Mentoring

• Mentor junior and senior engineers on Microsoft Fabric technologies and engineering best practices.
• Conduct code reviews, design reviews, and technical knowledge-sharing sessions.
• Drive continuous improvement initiatives and foster engineering excellence.

• Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.
• 10+ years of experience in Data Engineering, Data Warehousing, or Cloud Data Platform development.
• 4+ years of hands-on experience with Microsoft Azure Data Platform technologies.
• 2+ years of hands-on experience with Microsoft Fabric in enterprise implementations.
• Strong expertise in SQL, PySpark, Python, and Spark optimization.
• Experience with Microsoft Fabric components including OneLake, Lakehouse, Data Warehouse, Data Factory, Power BI, and Real-Time Intelligence.
• Experience with Azure Data Lake Storage (ADLS), Azure DevOps, GitHub, and CI/CD pipelines.
• Strong knowledge of dimensional data modeling, ETL/ELT architecture, and data governance.
• Experience leading technical teams and delivering large-scale enterprise data modernization programs.

Preferred Skills

• Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)
• Microsoft Azure Data Engineer Associate (DP-203)
• Experience with Databricks, Synapse Analytics, Azure AI Services, or Microsoft Purview.
• Knowledge of Agile/Scrum delivery methodologies.
• Strong communication, stakeholder management, and problem-solving skills.

Derex Technologies Inc specializes in providing IT consulting, staffing solutions and software services. Globally headquartered in Harrison New Jersey since 1996 Derex delivers the highest quality technology professionals and an array of customized IT talent solutions designed to improve productivity and drive results to global clients throughout North America.

With over two decades of unparalleled experience, Derex provides supports to its clientele, across such industries as Systems Integration, Banking and Finance, Telecommunications, Pharmaceutical and Life Sciences, Energy, Healthcare, Technology, Transportation, and local and federal Government agencies.