Senior Data Engineer

Insight Global
Pittsburgh, United States of America
5 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Pittsburgh, United States of America

Tech stack

Artificial Intelligence
Azure
Continuous Integration
Information Engineering
Data Warehousing
DevOps
Data Flow Control
Github
Python
Power BI
Standard Sql
SQL Databases
Azure
Spark
Powerquery
Microsoft Fabric
Stream Analytics

Job description

  • Design and maintain data pipelines using Fabric Data Factory, Dataflow Gen2, and Notebooks (Python, Spark, SQL)
  • Architect Data Warehouses and Lakehouse using Medallion Architecture (Bronze, Silver, Gold)

  • Build Power BI semantic models and datasets using DAX and Power Query

  • Deploy and monitor pipelines with CI/CD in Azure DevOps or GitHub Actions

  • Partner with teams across Finance, HR, Client Growth, and Operations

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com.To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/.

Requirements

  • 2 years of hands-on experience in Microsoft Fabric

? Ex: Data Factory, Dataflow Gen2, Notebooks, Warehouse, Lakehouse

  • Strong SQL, Python, DAX, and Power Query skills

  • Data Mesh and Medallion Architecture experience

? Understanding of the bronze, silver, and gold layers

? Azure cloud base

  • Experience in a migration TO Microsoft Fabric

  • DevOps / Agile mindset with CI/CD pipeline experience

  • Bachelor's in CS, IS, Data Engineering

? Or 10 equivalent yrs experience - PowerBI - dashboarding

  • Pipelining experience

  • Microsoft Fabric or Azure Data Engineer certifications

  • Real-time analytics

  • AI/ML data prep experience

Apply for this position