Data Engineer

Horizontal Talent
Minneapolis, MN, United States
28 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Query Performance Airflow Big Data BigQuery Cloud Computing Cloud Storage Continuous Integration Information Engineering Extract Transform Load (ETL) Data Flow Control Information Lifecycle Management Python (Programming Language)
+5 more
PostgreSQL SQL Databases Google Cloud Integration Frameworks Data Pipelines

Job description

Join a collaborative data engineering team building scalable measurement and reporting solutions that help power business insights across a fast-paced digital environment. This hybrid role offers the opportunity to work with modern cloud technologies, partner closely with cross-functional teams, and contribute to high-impact data products in a production setting. Responsibilities

  • Design, build, and maintain reliable batch and near real-time data pipelines using Apache Airflow and Cloud Composer.
  • Develop and support ELT/ETL workflows on Google Cloud Platform, including BigQuery, Dataflow, Pub/Sub, and Cloud Storage.
  • Write and optimize complex SQL for data modeling, transformation, window functions, and query performance.
  • Create Python-based data components, including operators, hooks, and transformations, and support packaging and CI/CD deployment practices.
  • Work with large-scale data platforms and warehouse environments, including ingestion, schema evolution, partitioning, and clustering strategies.
  • Integrate Postgres data sources and targets as part of broader pipeline workflows.
  • Partner with product, analytics, engineering, and other stakeholders to solve data problems efficiently and deliver reliable solutions.
  • Support data quality, observability, security, documentation, and ongoing optimization efforts across the data lifecycle.

Requirements

  • Strong experience with SQL and the ability to write efficient, production-ready queries.
  • Hands-on experience with Apache Airflow, preferably Cloud Composer.
  • Experience with Google Cloud Platform services such as BigQuery, Dataflow, Pub/Sub, and Cloud Storage.
  • Advanced Python skills for data engineering, automation, and workflow support.
  • Background in big data concepts, including warehouse performance, scalability, and processing patterns.
  • Experience working with Postgres in data engineering or integration workflows.
  • Ability to collaborate effectively, communicate clearly, and manage multiple priorities.
  • Commitment to data quality, reliability, and thoughtful problem-solving.

Preferred Skills

  • Experience working in advertising, media, or related data-rich environments.
  • Familiarity with measurement, reporting, or insights platforms.
  • Exposure to production monitoring, testing, and observability practices.
  • Experience partnering with stakeholders to translate business needs into technical solutions.
  • Comfort working in a fast-moving environment with multiple requests and evolving priorities.

Horizontal is committed to fostering a diverse, equitable, and inclusive workplace where every team member feels respected, supported, and empowered to contribute. We welcome candidates from all backgrounds and encourage applications from individuals who bring unique perspectives and experiences.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.disabledperson.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · WWC Europe 2026

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

3:27 min

Explaining query execution overhead and caching limitations in BigQuery

Adnan Rahic · JS Congress

2:30 min

Leveraging BigQuery ML for scalable SQL-based segmentation experiments

Julian Joseph · LIVE

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · WWC 2024

Videos

See all

Related articles

See all