Pyspark Google Cloud Platform data engineer

EdgeAll Inc

Sleepy Hollow, United States

15 days ago

Apply on www.dice.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Experienced

Experience required

2 years minimum

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Airflow BigQuery Cloud Storage Information Systems Information Engineering Extract Transform Load (ETL) Data Warehousing Data Flow Control Fraud Prevention and Detection Python (Programming Language) PCI Data Security Standards SQL Databases

+9 more

Google Cloud Google Data Studio Apache Spark Data Lakes Information Technology Integration Frameworks Machine Learning Operations Looker Analytics Data Pipelines

Requirements

Bachelor s or master s degree in computer science, Information Systems, or a related field.
8+ years of data engineering experience (at least 2 years in financial services or regulated environments).
Expert knowledge of BigQuery, Cloud Storage, Dataflow, and Pub/Sub on Google Cloud Platform.
Strong experience with SQL, Spark, Python, PySparkand data orchestration tools (Airflow, Cloud Composer, Dagster).
Demonstrated success designing modular, reusable data frameworks and libraries.
Deep understanding of data lake and warehousing concepts, ELT/ETL patterns, and financial data modeling.
Familiarity with security standards and compliance frameworks (e.g., PCI DSS, GDPR, SOC 2, ISO 27001).
Experience with real-time financial data streams (trading, payments, or fraud detection).
Familiarity with risk and regulatory reporting systems (Basel II/III, MiFID II, CCAR, IFRS).
Exposure to data science enablement, ML Ops/Data Ops. Example: building feature pipelines for credit risk, fraud, or customer analytics.
Experience with dbt, Looker, or Looker Studio for semantic modeling and reporting