GT Data Engineer II

Consolidated Electrical Distributors
Omaha, United States of America
2 days ago

Role details

Contract type
Permanent contract
Employment type
Part-time / full-time
Working hours
Regular working hours
Languages
English
Experience level
Intermediate
Compensation
$ 120K

Job location

Remote
Omaha, United States of America

Tech stack

Airflow
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Cloud Database
Databases
Data as a Services
Directed Acyclic Graph (Directed Graphs)
Information Engineering
Data Governance
ETL
Data Transformation
Data Security
Database Connection
Python
Meta-Data Management
Operational Databases
SQL Databases
T-SQL
Data Processing
Data Storage Technologies
Sql Optimization
Database Optimization
Pandas
Semi-structured Data
Data Lineage
Data Analytics
Data Management
Database Replication
Data Pipelines

Job description

We are seeking a talented Mid-Level Data Engineer to join our team and play a critical role in designing, building, and maintaining scalable data pipelines and infrastructure. In this position, you will be responsible for ensuring that enterprise data is secure, accessible, reliable, and governed effectively to support data-driven decision-making across the organization.

As a Data Engineer, you will work closely with data scientists, analysts, and business stakeholders to understand data requirements and translate them into robust technical solutions. Your primary focus will be building and maintaining the underlying infrastructure that supports data-driven initiatives, including data modeling, warehousing, transformation, and delivery. This role directly impacts company objectives by promoting data quality, integrity, and accessibility across various departments.

Reports to: Director of Data & Analytics, * Design, build, and maintain scalable data pipelines for optimal extraction, transformation, and loading of data from various sources.

  • Develop and implement data governance frameworks including data cataloging, metadata management, lineage tracking, and quality monitoring to ensure data accuracy, security, and compliance with regulatory requirements.
  • Build and maintain data stores and indexing infrastructure while implementing data quality, validation, and lineage controls to ensure accuracy and trustworthiness of data.
  • Orchestrate complex data workflows and automate manual processes using Apache Airflow, ensuring reliable task scheduling, dependency management, and workflow monitoring.
  • Collaborate with cross-functional teams including data stewards, architects, and business stakeholders to establish data quality standards and ensure data management practices align with overall business strategy.
  • Implement robust security measures, monitor data access, and develop governance policies that maintain company standards and safeguard data privacy.

Requirements

  • Apache Airflow: Proven experience orchestrating data pipelines, creating DAGs (Directed Acyclic Graphs), scheduling workflows, and managing task dependencies for production data systems.
  • AWS: Strong hands-on experience with AWS data services including Amazon S3 for data storage and Amazon DMS for data replication, and other core AWS technologies for building cloud-based data infrastructure.
  • Python: Proficiency in Python for data processing, pipeline development, and automation, including experience with libraries such as pandas for data transformation and database connectivity.
  • SQL: Advanced SQL skills for querying, optimizing database performance, data modeling, and working with both structured and semi-structured data across various database systems. Familiarity with T-SQL preferred.
  • Additional requirements include:
  • 4+ years of experience in data engineering or database management
  • Understanding of data governance principles and frameworks
  • Ability to implement ETL/ELT pipelines with diverse data sources., * Strong problem-solving skills
  • Attention to detail
  • Excellent communication abilities for both technical and non-technical audiences are essential.

Benefits & conditions

The compensation range for this position is $110000 to $120000 annually., * 401(k) (18 or older)

  • Paid Sick Leave (Full-Time)
  • Paid Sick Leave (Part-Time) - per your State's requirements
  • Insurance (Full-Time) - Medical, Dental, Vision Care
  • Insurance (Part-Time) - Medical only (30+ hours/week)
  • Disability Insurance
  • Life Insurance
  • Paid Holidays
  • Paid Vacation
  • Paid Pregnancy & New Parent Leave
  • Health Savings Account (HSA) and matching
  • Dependent Care Flexible Spending Account (FSA)
  • Teledoc

Apply for this position