Data Engineer

Insight Global
Atlanta, United States of America
15 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate
Compensation
$ 126K

Job location

Atlanta, United States of America

Tech stack

Azure
Big Data
Computer Programming
Data Cleansing
Information Engineering
Data Integration
ETL
Data Transformation
Linux
Python
Linux System Administration
Microsoft SQL Server
SQL Databases
SQL Server Integration Services
SQL Server Analysis Services
Microsoft Fabric
Core Data
Software Coding
Data Pipelines
Databricks

Job description

In this role, the Data Engineer supports and builds end-to-end data pipelines across both on-premise environments (roughly 65% of the time) and the Azure cloud (about 35%), working as part of a small, collaborative team that includes two other Data Engineers and a Data Scientist. On a daily basis, they are designing, developing, and maintaining ETL workflows using SSIS-extracting data from various sources, performing data cleansing and validation, and integrating it into downstream systems to ensure accuracy and reliability. They also serve as an administrator within SSAS, building and maintaining data models, supporting analytical structures, and ensuring data is optimized and accessible for reporting and business intelligence. In close collaboration with the other engineers, they help troubleshoot pipeline issues, optimize performance, and share best practices across the data ecosystem, while partnering with the Data Scientist to ensure datasets are properly structured and readily available for advanced analytics and modeling.

Additionally, they leverage Databricks to process and manage large-scale datasets, supporting more complex data transformations and analytics use cases. The role involves hands-on coding in Python and SQL to automate workflows, enhance pipeline efficiency, and manage operational tasks. While the majority of the work focuses on core data engineering responsibilities, there is also exposure to emerging tools like Microsoft Fabric and occasional work within Linux environments, contributing to a modern, evolving data platform.

Requirements

  • 3-5 years in a Data Engineering role o Supporting and building data pipelines on prem (65% of the time) and Azure cloud (35% of the time)

  • SSIS (SQL Server Integration Services) for ETL, data cleansing and validation, data integration

  • SSAS (SQL Serve Analysis Services) - serving as an admin for data building data models

  • Experience with Databricks for large scale data

  • Coding experience with python and SQL

Nice to Have Skills & Experience

  • Experience with Fabric
  • Familiarity with Linux
  • Experience building data pipelines in an GCP environment

Benefits & conditions

$110,000 to $126,000 - Exact compensation may vary based on several factors, including skills, experience, and education., Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.

Apply for this position