Data Engineer

Insight Global
Nashville, TN, United States
about 2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$81,120.0 - $101,920.0
Working hours
Regular working hours

Tech stack

Agile Methodology Artificial Intelligence Airflow Microsoft Azure Databases Database Development Hadoop Distributed File System Python (Programming Language) Software Deployment Software Systems Unstructured Data

Job description

This role is hybrid. Required 2 days/wk onsite.

Responsible for building and supporting a GCP based ecosystem designed for enterprise-wide analysis of structured, semi-structured, and unstructured data.

Support regular requests to move data from one cluster to another.

Manage production support teams to make sure service levels are maintained and any interruption is resolved in a timely fashion.

Analyze requirements, design AI/ML based solutions, and integrate those solutions for customer environments.

Closely collaborates with team members to successfully execute development initiatives using Agile practices and principles.

Leads efforts to design, development, deploy, and support software systems.

Collaborates with business analysts, project lead, management and customers on requirements.

Participates in the deployment, change, configuration, management, administration and maintenance of deployment process and systems.

Gather requirements, designs, constructs and delivers solutions with minimal team interaction.

Bring new data sources into GCP/HDFS, transform and load to databases.

Requirements

5 years of data engineer experience Python development SQL Development Cloud experience - Azure preferred

Nice to Have Skills & Experience

Microsoft Synapse experience Dagster experience

Benefits & conditions

Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on insightglobal.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · WWC Europe 2026

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:04 min

Database evolution and the funding behind vector databases

Erik Bamberg · LIVE

1:06 min

Outline of free tools for Microsoft Azure

Radu Vunvulea Radu Vunvulea · WWC 2022

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · WWC 2024

4:01 min

Managing application isolation via pluggable database models

Wei Hu Wei Hu · WWC 2022

Videos

See all

Related articles

See all