INTL India - Lead Data Engineer

Insight Global
Bristol, United States of America
1 month ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Bristol, United States of America

Tech stack

Query Performance
JIRA
Azure
System Configuration
Information Engineering
Relational Databases
Enterprise Messaging Systems
Microsoft SQL Server
Power BI
SQL Stored Procedures
SQL Databases
T-SQL
Azure
Data Pipelines

Requirements

Evergreen is looking for a strong Lead Data Engineer to lead a challenging effort to replace an in-house proprietary billing process with one based on Azure Data Factory, SQL Server, and T-SQL, supported with reporting in Power BI. This role will require a highly skilled individual capable of effectively balancing hands-on development responsibilities with leadership and support of the development team. Must possess a high degree of personal initiative and superior problem-solving capabilities. If you like challenging work in a fast-moving team-oriented environment this is the opportunity for you!, 10+ years of experience with Microsoft SQL Server with at least 5 years of that time being with SQL Server on Azure. Must possess a high degree of mastery in the following:

Relational Database Design principles related to transaction processing systems

TSQL Stored Procedures & Functions

Table and View Design including Common Table Expressions

Temporary Table and Table Variable use and management

Query Performance tuning including demonstrable ability to generate and read a Query Plan

Deep understanding of the design factors and practices associated with efficient use of large (> 2 million) row tables

Comprehensive knowledge of Structured Query Language, especially Joins and Derived Tables

5+ years of experience with Azure Data Factory, including data copy operations, executing and capturing stored procedures outputs, variables, and data pipeline creation. Must also show clear understanding of scheduling and running pipelines based on events. Must be able to integrate pipeline notifications with messaging systems like email.

Must have a deep understanding and practical experience building Medallion-style ELT processes and pipelines

Must be able to formulate and execute detail plans from high-level designs with minimal oversight or handholding

Must be comfortable with and willing to write stories and tasks in JIRA

5+ years of experience as a technical lead of a Data Engineering team or similar 3+ years of hands-on experience designing and building Power BI reports

Azure Architect Certification with 2+ years of hands-on experience creating and configuring Azure services

Apply for this position