Data Engineer + Microsoft Fabric

ATINFO TECHNOLOGY INC

United States

14 days ago

Apply on www.dice.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

5 years minimum

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Application Programming Interfaces (APIs) Business Analytics Applications Microsoft Azure Big Data Cloud Computing Information Systems Databases Continuous Integration Information Engineering Data Governance Data Integration Extract Transform Load (ETL)

+18 more

Data Security Data Systems Data Warehousing Python (Programming Language) SQL Azure Performance Tuning Power BI Azure Data Lake Data Storage Technologies Data Ingestion Azure Data Factory Apache Spark Microsoft Fabric Data Lakes Pyspark Information Technology Azure Synapse Analytics Data Pipelines

Job description

We are seeking a highly skilled Data Engineer with strong experience in Microsoft Fabric and Azure Data Lake to design, develop, and maintain enterprise-scale data solutions. The ideal candidate will have expertise in building data pipelines, data integration, data warehousing, and analytics platforms within the Microsoft Azure ecosystem., * Design, develop, and optimize scalable data pipelines using Microsoft Fabric.

Build and maintain Lakehouse and Data Warehouse solutions within the Fabric platform.
Develop data ingestion, transformation, and orchestration processes from various data sources.
Manage and optimize data storage within Azure Data Lake.
Collaborate with business stakeholders, architects, and analytics teams to gather requirements and deliver data solutions.
Ensure data security, compliance, and governance standards are met.
Monitor, troubleshoot, and improve data pipeline performance and reliability.
Support cloud data migration and modernization initiatives.

Requirements

5+ years of experience as a Data Engineer.
Hands-on experience with Microsoft Fabric, including Data Factory, Lakehouse, Data Warehouse, and Pipelines.
Strong experience working with Azure Data Lake Storage (ADLS Gen2).
Expertise in designing and implementing ETL/ELT data pipelines.
Strong SQL development and performance tuning skills.
Experience with Python, PySpark, or Spark for large-scale data processing.
Knowledge of data modeling, data governance, and data quality frameworks.
Experience integrating data from multiple sources including APIs, databases, and cloud platforms.
Familiarity with Azure services such as Azure Data Factory, Synapse Analytics, Azure SQL Database, and Azure DevOps.
Experience supporting reporting and analytics solutions using Power BI., * Experience with Delta Lake and Medallion Architecture.
Microsoft Azure or Microsoft Fabric certifications.
Experience working in Agile/Scrum environments.
Knowledge of CI/CD implementation for data engineering projects.