Sr. Data Engineer
Insight Global
Carmel, United States of America
6 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Senior Compensation
$ 185KJob location
Carmel, United States of America
Tech stack
Azure
Information Engineering
Data Governance
ETL
Data Mining
Python
Performance Tuning
Power BI
SQL Databases
Cloud Platform System
Data Ingestion
Azure
Microsoft Fabric
PySpark
Github Enterprise
Data Analytics
Azure
Job description
- Design, develop, and maintain data pipelines using Azure Data Factory and Synapse Data Analytics.
- Develop and optimize SQL queries for data extraction, transformation, and loading (ETL).
- Collaborate with cross-functional teams to understand data requirements and deliver solutions.
- Manage and optimize cloud-based data infrastructure.
- Implement data governance and ensure data quality and security.
- Create and maintain data models and mappings.
- Perform performance tuning and optimization in Azure.
- Develop Power BI visualizations to support business decision-making.
Requirements
- 8+ years of experience in a Data Engineering role, with Azure as the primary cloud platform preferred
- Strong experience designing and developing data ingestion, transformation, curation, and provisioning solutions using Azure data services
- Deep expertise with Azure Data Factory and Azure Synapse notebooks
- Recent, hands-on experience utilizing PySpark within Azure Synapse notebooks
- Extensive experience developing in Python
- Strong verbal and written communication skills
Nice to Have Skills & Experience
- GitHub Enterprise for deployment strength
- Azure Monitor Service
- Microsoft Fabric experience
- Masters degree or PHD
- Utility or Energy Experience
Benefits & conditions
Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.