Senior Data Platform Engineer

C B Partnership
Phoenix, AZ, United States
4 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Part-time (≀ 32 hours)
Experience level
Expert
Experience required
6 years minimum
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Airflow BigQuery Cloud Storage Computer Programming Data as a Services Directed Acyclic Graph (Directed Graphs) Data Validation Information Engineering Data Infrastructure Python (Programming Language) Operational Databases
+11 more
Standard Sql Cloudera SQL Databases Scripting Google Cloud Apache Spark Fastapi Pyspark Api Design Restful APIs Data Pipelines

Job description

Replies within 24 hours, We are hiring a Senior Data Platform Engineer for an onsite role in Phoenix, AZ. This role requires strong hands-on experience building and operating data pipelines on Google Cloud Platform., * Design and maintain Airflow DAGs for production data workflows

  • Develop and optimize Spark / PySpark jobs on Dataproc
  • Build and optimize complex SQL transformations
  • Develop REST APIs using FastAPI Python to support data services
  • Implement robust data quality and validation frameworks
  • Monitor pipeline performance, retries, and SLA compliance

Requirements

SQL (Structured Query Language), REST (Representational State Transfer), Application Programming Interface (API), Python Programming/Scripting Language, Data Quality, Service Level Agreement (SLA), Performance Analysis, Engineering, Computer Programming, Apache Spark, * 6+ years of data engineering experience

  • Strong Python programming skills
  • Production experience with Apache Spark PySpark
  • Experience with Airflow DAG development
  • Hands-on experience with GCP (Dataproc, BigQuery, Cloud Storage preferred)
  • Experience building APIs using FastAPI
  • Strong SQL and data modeling knowledge
  • Experience implementing data quality checks (schema validation, row count checks, anomaly detection)

Benefits & conditions

  • 401(k)

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…