Data Engineer

Insight Global
Schaumburg, IL, United States
about 2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Compensation
$130,000.0 - $140,000.0
Working hours
Regular working hours
Job source

Tech stack

Automation of Tests Big Data Information Engineering Data Warehousing Python (Programming Language) Object-Oriented Software Development Apache Spark Data Lakes Information Technology Star Schema Data Lakehouse Data Pipelines

Job description

A client is seeking a Data Engineer to support their data pipeline with the below responsibilities:

  • Design and develop scalable data pipelines to collect, process, and store large volumes of data.

  • Collaborate with data scientists and analysts to drive scope & requirements as well as deliver strong technical design of data analytics solutions.

  • Ensure data quality and integrity through cleansing processes, validation, and automated testing.

Requirements

  • Bachelor’s degree in Computer Science or related field

  • 5 years’ experience in data engineering, usinmg Python and Spark, and OO programming

  • 3 years’ experience building and supporting data lakehouse architectures using delta lake and change data feeds.

  • 3 years’ experience designing data warehouse table architecture (Ex: star schema or Kimball method)

  • Experience creating CI/CD pipelines

  • MS Fabric

Benefits & conditions

$130,000 to $140,000 - Exact compensation may vary based on several factors, including skills, experience, and education.

Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on juju.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou ¡ Coffee With Developers

3:24 min

The governance failures of centralized data lakes

Mario Meir-Huber ¡ LIVE

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy ¡ LIVE

6:24 min

Distributed data lakes and containerized computing clusters

Ulrich Wurstbauer +1 ¡ LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt ¡ LIVE

2:10 min

Why organizations combine big data and machine learning

Ayon Roy ¡ LIVE

Videos

See all

Related articles

See all