Sr GCP Data Engineer

EITAcies, Inc.

Austin, United States of America

1 month ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Languages

English

Experience level

Senior

Job location

Austin, United States of America

Tech stack

API

Airflow

Google BigQuery

Cloud Storage

Data as a Services

Directed Acyclic Graph (Directed Graphs)

Information Engineering

Python

Operational Databases

SQL Databases

Google Cloud Platform

Spark

FastAPI

PySpark

REST

Data Pipelines

Job description

We are hiring a Senior Data Platform Engineer for an onsite role in Phoenix, AZ. This role requires strong hands-on experience building and operating data pipelines on Google Cloud Platform., Design and maintain Airflow DAGs for production data workflows Develop and optimize Spark / PySpark jobs on Dataproc Build and optimize complex SQL transformations Develop REST APIs using FastAPI Python to support data services Implement robust data quality and validation frameworks Monitor pipeline performance, retries, and SLA compliance

Requirements

6+ years of data engineering experience Strong Python programming skills Production experience with Apache Spark PySpark Experience with Airflow DAG development Hands-on experience with GCP (Dataproc, BigQuery, Cloud Storage preferred) Experience building APIs using FastAPI Strong SQL and data modeling knowledge Experience implementing data quality checks (schema validation, row count checks, anomaly detection)