Google Cloud Platform Data Architect

Lorven Technologies Inc
Dallas, TX, United States
3 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Clean Code Principles Airflow Build Automation Big Data BigQuery Cloud Computing Cloud Storage Cluster Analysis Data Compression Computer Programming Continuous Integration Data Architecture
+43 more
Data Deduplication Information Engineering Data Governance Extract Transform Load (ETL) Data Transformation Data Warehousing DevOps Distributed Computing Environment Data Flow Control Apache Hadoop MapReduce Apache Hive Metadata Meta-Data Management Metadata Repositories OpenShift Performance Tuning Scrum Methodology Query Optimization Cloudera Runbook SQL Databases Sqoop Data Streaming Management of Software Versions Parquet Data Logging Data Processing Google Cloud Data Ingestion Apache Spark Git Event Driven Architecture Data Lakes Pyspark Data Lineage Deployment Automation Avro Data Analytics Data Management Software Version Control Data Pipelines Apache Beam

Requirements

  • Bachelor’s degree in related field Big Data & Processing

  • Hands on experience with PySpark for ETL/ELT, data transformation, and performance optimization
  • Solid understanding of distributed data processing concepts Data & Cloud Architecture

  • Strong experience designing data platforms on Google Cloud Platform (Google Cloud Platform)
  • Experience with Data Lakes, data warehousing, and large scale migration programs Data Lake Architecture & Storage

  • Proven experience designing and implementing data lake architectures (e.g., Bronze/Silver/Gold or layered models).
  • Strong knowledge of Cloud Storage (GCS) design, including bucket layout, naming conventions, lifecycle policies, and access controls
  • Hands-on experience with columnar data formats (Parquet, Avro, ORC) and compression techniques
  • Expertise in partitioning strategies, backfills, and large-scale data organization Data Ingestion & Orchestration

  • Experience building batch and streaming ingestion pipelines using Google Cloud Platform-native services
  • Knowledge of Pub/Sub-based streaming architectures, event schema design, and versioning
  • Strong understanding of incremental ingestion and CDC patterns, including idempotency and deduplication
  • Hands-on experience with workflow orchestration tools (Cloud Composer / Airflow)
  • Ability to design robust error handling, replay, and backfill mechanisms Data Processing & Transformation

  • Experience developing scalable batch and streaming pipelines using Dataflow (Apache Beam) and/or Spark (Dataproc)
  • Strong proficiency in BigQuery SQL, including query optimization, partitioning, clustering, and cost control.
  • Hands-on experience with Hadoop MapReduce and ecosystem tools (Hive, Pig, Sqoop)
  • Advanced Python programming skills for data engineering, including testing and maintainable code design
  • Experience managing schema evolution while minimizing downstream impact DevOps / CI CD

  • Experience implementing CI/CD pipelines for data and analytics workloads
  • Familiarity with Git based source control, build automation, and deployment strategies Containers & Platform

  • Experience with OpenShift Container Platform (OCP) for deploying data workloads and services
  • Understanding of containerized architecture, scaling, and environment management
  • Proven ability to build CI/CD pipelines for data and infrastructure workloads
  • Experience managing secrets securely using Google Cloud Platform Secret Manager
  • Ownership of observability, SLOs, dashboards, alerts, and runbooks
  • Proficiency in logging, monitoring, and alerting for data pipelines and platform reliability Data Governance, Quality & Metadata

  • Experience implementing data catalogs, metadata management, and ownership models
  • Understanding of data lineage for auditability and troubleshooting
  • Strong focus on data quality frameworks, including validation, freshness checks, and alerting
  • Experience defining and enforcing data contracts, schemas, and SLAs

Good to have Security, Privacy & Compliance

  • Hands-on experience implementing fine-grained access controls for BigQuery and GCS
  • Experience with Sprint planning and helping team technically.
  • Strong stakeholder communication and solution architecture skills

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…