Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+12 more
Job description
We are seeking an experienced Data Engineer to join our client in St. Louis, MO on a 6-month contract. This role is ideal for a hands-on Data Engineer with strong Python, advanced SQL, and Apache Airflow experience who enjoys building, optimizing, and supporting production data pipelines.
The successful candidate will play an important role in developing and maintaining reliable data pipelines, improving data delivery, troubleshooting production issues, and supporting modern cloud-based data infrastructure. What You’ll Do
- Author, debug, and optimize complex data engineering scripts using Python and advanced SQL.
- Design, develop, schedule, and monitor complex Apache Airflow DAGs and data pipelines.
- Build and maintain ETL/ELT processes, data transformations, and data integration workflows.
- Design and manage SQL-based databases, including schema development, query performance tuning, and data warehousing.
- Improve existing pipelines by resolving recurring failures, eliminating bottlenecks, and optimizing resource utilization.
- Install, configure, and maintain data pipeline utilities, custom Airflow providers, and database connectors.
- Support cloud-based data platform infrastructure and data lake/data warehouse integration efforts.
- Work with containerization technologies such as Docker and Kubernetes.
- Identify opportunities to automate, innovate, and scale data delivery across the organization.
- Perform root cause analysis and incident management for data quality issues, pipeline/DAG failures, and database outages.
- Create and maintain technical documentation covering data architecture, DAG workflows, and operational troubleshooting procedures.
- Collaborate with engineering and technical teams using Agile development methodologies.
- Support CI/CD deployment pipelines for data engineering code and workflows.
Requirements
- 4–7 years of professional Data Engineering experience.
- Strong proficiency with Python and advanced SQL.
- Hands-on experience with Apache Airflow, including development, scheduling, monitoring, and troubleshooting of DAGs.
- Experience with SQL-based database management systems, including schema design and query optimization.
- Strong understanding of ETL/ELT, data transformation, data integration, and data pipeline development.
- Experience working with cloud-based data platforms and data lake/data warehouse environments.
- Experience with Docker and/or Kubernetes.
- Experience with CI/CD and version-controlled development workflows.
- Understanding of Agile software development methodologies.
- Strong production troubleshooting, root cause analysis, and incident-management skills.
- Ability to work effectively in a fast-paced, sense-of-urgency environment.
Ideal Background The strongest candidates will have experience owning production data pipelines from development through deployment and ongoing support, with particular strength in Apache Airflow, Python, SQL, and cloud data platforms.
This is a hands-on engineering role for someone who enjoys solving complex pipeline and data infrastructure problems—not a primarily reporting, analytics, or dashboard-focused position.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Highest Paying Tech Companies for Developers
Making Data Warehouses Fast: A Developer’s Story
Fully Remote Software Engineer Jobs
The Most Popular IT Jobs on the Market