Data Engineer

Horizontal Talent
Minneapolis, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English

Job location

Minneapolis, United States of America

Tech stack

Query Performance
Airflow
Big Data
Google BigQuery
Cloud Computing
Cloud Storage
Continuous Integration
Information Engineering
ETL
Data Flow Control
Information Lifecycle Management
Python
PostgreSQL
SQL Databases
Google Cloud Platform
Integration Frameworks
Data Pipelines

Job description

Join a collaborative data engineering team building scalable measurement and reporting solutions that help power business insights across a fast-paced digital environment. This hybrid role offers the opportunity to work with modern cloud technologies, partner closely with cross-functional teams, and contribute to high-impact data products in a production setting. Responsibilities

  • Design, build, and maintain reliable batch and near real-time data pipelines using Apache Airflow and Cloud Composer.
  • Develop and support ELT/ETL workflows on Google Cloud Platform, including BigQuery, Dataflow, Pub/Sub, and Cloud Storage.
  • Write and optimize complex SQL for data modeling, transformation, window functions, and query performance.
  • Create Python-based data components, including operators, hooks, and transformations, and support packaging and CI/CD deployment practices.
  • Work with large-scale data platforms and warehouse environments, including ingestion, schema evolution, partitioning, and clustering strategies.
  • Integrate Postgres data sources and targets as part of broader pipeline workflows.
  • Partner with product, analytics, engineering, and other stakeholders to solve data problems efficiently and deliver reliable solutions.
  • Support data quality, observability, security, documentation, and ongoing optimization efforts across the data lifecycle.

Requirements

  • Strong experience with SQL and the ability to write efficient, production-ready queries.
  • Hands-on experience with Apache Airflow, preferably Cloud Composer.
  • Experience with Google Cloud Platform services such as BigQuery, Dataflow, Pub/Sub, and Cloud Storage.
  • Advanced Python skills for data engineering, automation, and workflow support.
  • Background in big data concepts, including warehouse performance, scalability, and processing patterns.
  • Experience working with Postgres in data engineering or integration workflows.
  • Ability to collaborate effectively, communicate clearly, and manage multiple priorities.
  • Commitment to data quality, reliability, and thoughtful problem-solving.

Preferred Skills

  • Experience working in advertising, media, or related data-rich environments.
  • Familiarity with measurement, reporting, or insights platforms.
  • Exposure to production monitoring, testing, and observability practices.
  • Experience partnering with stakeholders to translate business needs into technical solutions.
  • Comfort working in a fast-moving environment with multiple requests and evolving priorities.

Horizontal is committed to fostering a diverse, equitable, and inclusive workplace where every team member feels respected, supported, and empowered to contribute. We welcome candidates from all backgrounds and encourage applications from individuals who bring unique perspectives and experiences.

Apply for this position