Google Cloud Platform Data Engineer
Ascii Group, LLC
Johns Creek, United States of America
17 days ago
Role details
Contract type
Temporary contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Senior Compensation
$ 125KJob location
Johns Creek, United States of America
Tech stack
Java
Airflow
Google BigQuery
Cloud Storage
Computer Programming
Continuous Integration
Directed Acyclic Graph (Directed Graphs)
Information Engineering
Data Governance
ETL
Data Warehousing
DevOps
Data Flow Control
Github
Python
Cloudera
Data Streaming
Workflow Management Systems
Privacy Controls
Freeform SQL
Google Cloud Platform
Data Ingestion
Google BigQuery
Data Pipelines
Serverless Computing
Jenkins
Job description
Seeking an Enterprise Google Cloud Platform Data Engineer with 10+ years of comprehensive experience to design, construct, and optimize high-throughput data pipelines and warehousing environments. This role focuses on scaling modern ELT/ETL pipelines, structuring complex multi-tier data models, and orchestrating serverless workflows using the Google Cloud Platform (Google Cloud Platform) ecosystem., * Data Pipeline Architecture: Design, implement, and maintain highly scalable, secure, and cost-optimized batch and real-time streaming data pipelines using Google Cloud Platform Dataflow and Dataproc.
- Data Warehousing & Modeling: Author enterprise-grade data warehouse schemas, partition tables, and optimize complex analytical query paths within Google BigQuery.
- Workflow Orchestration: Code, schedule, and monitor robust Directed Acyclic Graphs (DAGs) using Apache Airflow managed inside Google Cloud Composer.
- Event Streaming & Ingestion: Engineer event-driven data ingestion fabrics and asynchronous processing layers using Google Cloud Pub/Sub and Cloud Storage.
- Data Quality & Governance: Enforce data quality frameworks, structural privacy controls, and security standards to properly safeguard downstream analytics and data science workloads.
- CI/CD Automation: Establish continuous integration and automated pipeline delivery models using GitHub and Jenkins build structures.
- Cross-Functional Collaboration: Partner actively across distributed onsite and offshore business teams to translate data science requirements into functional, low-latency target models.
Requirements
- Experience: 10+ years of total professional data engineering and warehousing experience, featuring 8+ years focused in ETL/ELT environments, and 5+ years building production-live pipelines.
- Google Cloud Platform Infrastructure Mastery: Advanced hands-on implementation experience using Google Cloud data technologies: BigQuery, Dataflow, Dataproc, Pub/Sub, and Cloud Storage.
- Orchestration Tooling: Solid background developing and scheduling workflows using Apache Airflow or Cloud Composer DAG configurations.
- Programming & Querying: Exceptional command writing advanced SQL queries paired with strong programming proficiency in Python or Java.
- DevOps Engineering: Practical familiarity working with CI/CD automation tools, specifically GitHub repositories and Jenkins pipelines.
- Nice to Have: Prior functional exposure or project history working within the Retail domain.