Data Engineer

• Author, schedule, and maintain modular ETL/ELT workflows and DAGs using Apache Airflow and custom providers, ensuring seamless data integration across distributed storage and modern cloud data lakes/warehouses.
• Develop and tune complex SQL scripts and database schemas, continually resolving performance bottlenecks, optimizing cloud resource utilization, and maintaining efficient data warehousing structures.
• Configure, deploy, and manage data infrastructure using Docker or Kubernetes, integrating custom connectors and CI/CD deployment pipelines under strict operational and security guidelines.
• Monitor pipeline health to perform root cause analysis during DAG failures or database outages, proactively reducing recurring errors and establishing high data quality standards.
• Collaborate in an Agile environment to document data architectures and troubleshooting workflows while continuously identifying opportunities to automate and scale data delivery systems.

• 4+ years of dedicated data engineering experience with a focus on scaling data delivery, automation, and optimizing system resources
• Advanced expertise in authoring, scheduling, and optimizing complex ETL/ELT pipelines and DAGs using Python, SQL, and Apache Airflow.
• Demonstrated experience in schema design, query performance tuning, and integrating modern cloud data lakes and data warehousing solutions.
• Hands-on experience with cloud platform infrastructure, Docker, Kubernetes, and automated CI/CD deployment pipelines.
• Proven ability to perform root cause analysis, resolve pipeline failures/outages, and maintain comprehensive technical documentation in an Agile environment.

Must be authorized to work in the US. Sponsorships are not available. Pay range: $55-58/hour W2

This is a 4 month contract opportunity. Candidates must be located in St. Louis, MO and work 4 days a week in office and 1 day remotely (Friday)! Visionaire Partners offers all full-time W2 contractors a comprehensive benefits package for the contractor, their spouses/domestic partners, and dependents. Options include 401k with up to 4% match, medical, dental, vision, life insurance, short and long term disability, critical illness, hospital indemnity, accident coverage, and both Medical and Dependent Care Flexible Spending Accounts.