Sr. Data Engineer

Insight Global
Carmel, United States of America
6 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 185K

Job location

Carmel, United States of America

Tech stack

Azure
Information Engineering
Data Governance
ETL
Data Mining
Python
Performance Tuning
Power BI
SQL Databases
Cloud Platform System
Data Ingestion
Azure
Microsoft Fabric
PySpark
Github Enterprise
Data Analytics
Azure

Job description

  • Design, develop, and maintain data pipelines using Azure Data Factory and Synapse Data Analytics.
  • Develop and optimize SQL queries for data extraction, transformation, and loading (ETL).
  • Collaborate with cross-functional teams to understand data requirements and deliver solutions.
  • Manage and optimize cloud-based data infrastructure.
  • Implement data governance and ensure data quality and security.
  • Create and maintain data models and mappings.
  • Perform performance tuning and optimization in Azure.
  • Develop Power BI visualizations to support business decision-making.

Requirements

  • 8+ years of experience in a Data Engineering role, with Azure as the primary cloud platform preferred
  • Strong experience designing and developing data ingestion, transformation, curation, and provisioning solutions using Azure data services
  • Deep expertise with Azure Data Factory and Azure Synapse notebooks
  • Recent, hands-on experience utilizing PySpark within Azure Synapse notebooks
  • Extensive experience developing in Python
  • Strong verbal and written communication skills

Nice to Have Skills & Experience

  • GitHub Enterprise for deployment strength
  • Azure Monitor Service
  • Microsoft Fabric experience
  • Masters degree or PHD
  • Utility or Energy Experience

Benefits & conditions

Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.

Apply for this position