Data Engineer

Stellar IT Solutions
Minneapolis, United States of America
3 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate
Compensation
$ 114K

Job location

Minneapolis, United States of America

Tech stack

API
Airflow
Data analysis
Big Data
Google BigQuery
Cloud Storage
Software Documentation
Continuous Integration
Directed Acyclic Graph (Directed Graphs)
ETL
Data Systems
Data Flow Control
Python
PostgreSQL
Performance Tuning
Cloud Services
Standard Sql
Software Engineering
SQL Databases
Google Cloud Platform
Data Ingestion
Data Pipelines

Job description

You will be part of the Myads reporting team responsible for building the measurement, reporting, and insights platform that powers Ads and the broader Retail Media Network. In this role, you will design, develop, and maintain scalable, reliable, and high-performance data solutions that enable advertisers, merchants, and internal teams to measure campaign performance and business impact., As a Developer, you will build and enhance data pipelines, APIs, and cloud-based services on Google Cloud Platform (GCP) while contributing to the architecture and implementation of measurement platforms. You will collaborate closely with Product Management, Ads Engineering, Analytics, Data Science, and other cross-functional teams to deliver high-quality solutions that meet business needs and support growth objectives. You will participate in the full software development lifecycle, including design, implementation, testing, deployment, and ongoing optimization of data and measurement systems. This role is hybrid, which means you will work some days on site at the client//'s location and some days virtually from home., Hire an experienced Data Engineer to design, build, and maintain scalable batch/streaming data pipelines on Google Cloud. The role requires deep SQL expertise, production grade orchestration with Apache Airflow (Cloud Composer), and strong Python for ELT/ETL, with exposure to Postgres.

Requirements

  • SQL (5+ years)
  • Apache Airflow (Cloud Composer) (3+ years)
  • GCP (BigQuery, Dataflow, Pub/Sub, GCS, Composer) (3+ years)
  • Python (5+ years)
  • Big Data (warehousing/processing concepts, performance)(5+ years)
  • Postgres (3+), * Design, develop, and operate reliable data pipelines and DAGs using Apache Airflow/Cloud Composer for batch and near real time workflows.
  • Build ELT/ETL on GCP services (e.g., BigQuery, Dataflow, Pub/Sub, Cloud Storage; Composer for orchestration); enforce coding, testing, and observability standards.
  • Write expert level SQL for modeling, complex transformations, windowing functions, and performance tuning; own query efficiency and cost optimization.
  • Develop Python data components (operators, hooks, transforms), packaging and CI/CD for deployment to Composer/Dataflow.
  • Work with Big Data ecosystems and MPP warehouses; support data ingestion, schema evolution, and partitioning/clustering strategies.
  • Integrate Postgres sources/targets
  • Partner with product, analytics, and platform teams; uphold security, compliance, data quality (DQ checks, SLAs), and documentation standards.

What are some preferred/nice to have skills the manager is looking for?

  • Who has worked in ads domain.
  • Should be able to talk to stakeholders and understand the problem and solve it efficiently
  • Preventing data quality issues before they impact users.
  • Prioritizing projects and handling multiple requests.

Apply for this position