Sr Data Engineer

The Senior Data Engineer is responsible for developing and maintaining scalable data pipelines, data transformation processes, and enterprise data warehouse solutions using Microsoft Fabric. The ideal candidate should possess strong technical expertise in cloud-based data engineering and be capable of independently delivering high-quality data integration and analytics solutions., * Develop and maintain data ingestion, transformation, and integration pipelines using Microsoft Fabric.

• Build, optimize, and maintain Pyspark notebooks for large-scale data processing.
• Implement metadata-driven ETL/ELT frameworks.
• Develop and maintain Fabric Data Warehouse objects.
• Work with One Lake for enterprise-scale data storage and management.
• Ensure high-quality, secure, and reliable data processing while adhering to PII handling and data governance standards.
• Collaborate with business analysts, architects, and reporting teams to deliver data solutions supporting analytics and Power BI reporting.
• Optimize existing data pipelines for performance, scalability, and reliability.
• Troubleshoot production issues and provide timely resolution.
• Follow coding standards, documentation practices, version control, and deployment processes.

• Bachelor’s degree in computer science, Information Technology, Engineering, or a related discipline.
• 5+ years of experience in Data Engineering with hands-on experience in Microsoft Fabric or similar cloud-based data platforms.
• Experience developing and maintaining cloud-based data engineering solutions.
• Strong understanding of ETL/ELT concepts, data modeling, and data warehousing.
• Good analytical, troubleshooting, and problem-solving skills.
• Excellent communication and collaboration skills.

Technical Skills

• Microsoft Fabric
• Fabric Data Pipelines
• PySpark Notebooks
• Metadata-Driven Design
• OneLake
• Fabric Data Warehouse
• ETL/ELT Development
• Data Modeling
• SQL
• Python
• Power BI
• PII Handling and Data Governance
• Git
• Performance Optimization and Data Pipeline Monitoring, * Data engineering: 5 years (Required)
• Microsoft Fabric: 4 years (Required)

$115,000 - $140,000 a year - Full-time, Contract, Job Types: Full-time, Contract Contract length: 12 months

Pay: $115,000.00 - $140,000.00 per year