Google Cloud Platform Data Architect
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+43 more
Requirements
-
Bachelorβs degree in related field Big Data & Processing
- Hands on experience with PySpark for ETL/ELT, data transformation, and performance optimization
-
Solid understanding of distributed data processing concepts Data & Cloud Architecture
- Strong experience designing data platforms on Google Cloud Platform (Google Cloud Platform)
-
Experience with Data Lakes, data warehousing, and large scale migration programs Data Lake Architecture & Storage
- Proven experience designing and implementing data lake architectures (e.g., Bronze/Silver/Gold or layered models).
- Strong knowledge of Cloud Storage (GCS) design, including bucket layout, naming conventions, lifecycle policies, and access controls
- Hands-on experience with columnar data formats (Parquet, Avro, ORC) and compression techniques
-
Expertise in partitioning strategies, backfills, and large-scale data organization Data Ingestion & Orchestration
- Experience building batch and streaming ingestion pipelines using Google Cloud Platform-native services
- Knowledge of Pub/Sub-based streaming architectures, event schema design, and versioning
- Strong understanding of incremental ingestion and CDC patterns, including idempotency and deduplication
- Hands-on experience with workflow orchestration tools (Cloud Composer / Airflow)
-
Ability to design robust error handling, replay, and backfill mechanisms Data Processing & Transformation
- Experience developing scalable batch and streaming pipelines using Dataflow (Apache Beam) and/or Spark (Dataproc)
- Strong proficiency in BigQuery SQL, including query optimization, partitioning, clustering, and cost control.
- Hands-on experience with Hadoop MapReduce and ecosystem tools (Hive, Pig, Sqoop)
- Advanced Python programming skills for data engineering, including testing and maintainable code design
-
Experience managing schema evolution while minimizing downstream impact DevOps / CI CD
- Experience implementing CI/CD pipelines for data and analytics workloads
-
Familiarity with Git based source control, build automation, and deployment strategies Containers & Platform
- Experience with OpenShift Container Platform (OCP) for deploying data workloads and services
- Understanding of containerized architecture, scaling, and environment management
- Proven ability to build CI/CD pipelines for data and infrastructure workloads
- Experience managing secrets securely using Google Cloud Platform Secret Manager
- Ownership of observability, SLOs, dashboards, alerts, and runbooks
-
Proficiency in logging, monitoring, and alerting for data pipelines and platform reliability Data Governance, Quality & Metadata
- Experience implementing data catalogs, metadata management, and ownership models
- Understanding of data lineage for auditability and troubleshooting
- Strong focus on data quality frameworks, including validation, freshness checks, and alerting
- Experience defining and enforcing data contracts, schemas, and SLAs
Good to have Security, Privacy & Compliance
- Hands-on experience implementing fine-grained access controls for BigQuery and GCS
- Experience with Sprint planning and helping team technically.
- Strong stakeholder communication and solution architecture skills
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦