Data Engineer

Agile Resources
St. Louis, MO, United States
1 day ago
Apply on jobs.gotoagile.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Compensation
$122,346.0
Working hours
Regular working hours

Tech stack

Agile Methodology Airflow Databases Continuous Integration Directed Acyclic Graph (Directed Graphs) Data Architecture Information Engineering Data Integration Extract Transform Load (ETL) Data Transformation Data Warehousing Python (Programming Language)
+12 more
Operational Databases Query Optimization Cloud Services SQL Databases Cloud Platform System Delivery Pipeline Containerization Data Lakes Kubernetes Data Delivery Data Pipelines Docker

Job description

We are seeking an experienced Data Engineer to join our client in St. Louis, MO on a 6-month contract. This role is ideal for a hands-on Data Engineer with strong Python, advanced SQL, and Apache Airflow experience who enjoys building, optimizing, and supporting production data pipelines.

The successful candidate will play an important role in developing and maintaining reliable data pipelines, improving data delivery, troubleshooting production issues, and supporting modern cloud-based data infrastructure. What You’ll Do

  • Author, debug, and optimize complex data engineering scripts using Python and advanced SQL.
  • Design, develop, schedule, and monitor complex Apache Airflow DAGs and data pipelines.
  • Build and maintain ETL/ELT processes, data transformations, and data integration workflows.
  • Design and manage SQL-based databases, including schema development, query performance tuning, and data warehousing.
  • Improve existing pipelines by resolving recurring failures, eliminating bottlenecks, and optimizing resource utilization.
  • Install, configure, and maintain data pipeline utilities, custom Airflow providers, and database connectors.
  • Support cloud-based data platform infrastructure and data lake/data warehouse integration efforts.
  • Work with containerization technologies such as Docker and Kubernetes.
  • Identify opportunities to automate, innovate, and scale data delivery across the organization.
  • Perform root cause analysis and incident management for data quality issues, pipeline/DAG failures, and database outages.
  • Create and maintain technical documentation covering data architecture, DAG workflows, and operational troubleshooting procedures.
  • Collaborate with engineering and technical teams using Agile development methodologies.
  • Support CI/CD deployment pipelines for data engineering code and workflows.

Requirements

  • 4–7 years of professional Data Engineering experience.
  • Strong proficiency with Python and advanced SQL.
  • Hands-on experience with Apache Airflow, including development, scheduling, monitoring, and troubleshooting of DAGs.
  • Experience with SQL-based database management systems, including schema design and query optimization.
  • Strong understanding of ETL/ELT, data transformation, data integration, and data pipeline development.
  • Experience working with cloud-based data platforms and data lake/data warehouse environments.
  • Experience with Docker and/or Kubernetes.
  • Experience with CI/CD and version-controlled development workflows.
  • Understanding of Agile software development methodologies.
  • Strong production troubleshooting, root cause analysis, and incident-management skills.
  • Ability to work effectively in a fast-paced, sense-of-urgency environment.

Ideal Background The strongest candidates will have experience owning production data pipelines from development through deployment and ongoing support, with particular strength in Apache Airflow, Python, SQL, and cloud data platforms.

This is a hands-on engineering role for someone who enjoys solving complex pipeline and data infrastructure problems—not a primarily reporting, analytics, or dashboard-focused position.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on jobs.gotoagile.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · World Congress 2025

3:04 min

Database evolution and the funding behind vector databases

Erik Bamberg · LIVE

1:19 min

The true role and evolution of data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

4:01 min

Managing application isolation via pluggable database models

Wei Hu Wei Hu · World Congress 2022

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

Videos

See all

Related articles

See all