Google Cloud Data Architect & IAM Data Modernization

RETAIL INDUSTRIES, INC.
Prosper, TX, United States
13 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours

Tech stack

Clean Code Principles Sql Data Warehouse Application Programming Interfaces (APIs) Airflow Data Analysis Build Automation Big Data BigQuery Cloud Computing Cloud Engineering Cloud Storage Cluster Analysis
+55 more
Data Compression Information Systems Continuous Delivery Continuous Integration Data Architecture Data Deduplication Information Engineering Data Governance Extract Transform Load (ETL) Data Transformation Data Systems Data Warehousing DevOps Distributed File Systems Distributed Computing Environment Data Flow Control Apache Hadoop Hadoop Distributed File System MapReduce Apache Hive Identity and Access Management Metadata Meta-Data Management OpenShift Performance Tuning Scrum Methodology Query Optimization Cloudera Runbook SQL Databases Sqoop Management of Software Versions Parquet Data Logging Data Processing Google Cloud Data Ingestion System Availability Apache Spark Git Data Layers Event Driven Architecture Containerization Data Lakes Pyspark Information Technology Data Lineage Deployment Automation Avro Data Analytics Data Management Natural Language Understanding Software Version Control Data Pipelines Apache Beam

Requirements

DataArchitect Data Modeling Tool, Cloud Architecture, United States Citizen, DevOps, Data Lake, Metrics, Trend Analysis, SQL (Structured Query Language), GCP (Good Clinical Practices), Use Cases, Identity & Access Management (IAM) Data Modernization - migration of an on-premises SQL data warehouse to a target-state Data Lake on Google Cloud (GCP), enabling metrics & reporting, advanced analytics, and GenAI use cases (natural language querying, accelerated summarization, cross-domain trend analysis) leveraging PySpark-based processing, cloud-native DevOps CI/CD pipelines, and containerized deployments on OpenShift (OCP) to deliver scalable, secure, and high-performance data solutions. What You’ll Do: DevOps / CI-CD

  • Experience implementing CI/CD pipelines for data and analytics workloads
  • Familiarity with Git-based source control, build automation, and deployment strategies

Containers & Platform

  • Experience with OpenShift Container Platform (OCP) for deploying data workloads and services
  • Understanding of containerized architecture, scaling, and environment management
  • Proven ability to build CI/CD pipelines for data and infrastructure workloads
  • Experience managing secrets securely using GCP Secret Manager
  • Ownership of observability, SLOs, dashboards, alerts, and runbooks
  • Proficiency in logging, monitoring, and alerting for data pipelines and platform reliability

Big Data & Processing

  • Hands-on experience with PySpark for ETL/ELT, data transformation, and performance optimization
  • Solid understanding of distributed data processing concepts

Data & Cloud Architecture

  • Strong experience designing data platforms on Google Cloud Platform (GCP)
  • Experience with Data Lakes, data warehousing, and large-scale migration programs

Data Lake Architecture & Storage

  • Proven experience designing and implementing data lake architectures (e.g., Bronze/Silver/Gold or layered models).
  • Strong knowledge of Cloud Storage (GCS) design, including bucket layout, naming conventions, lifecycle policies, and access controls

Β· Experience with Hadoop/HDFS architecture, distributed file systems, and data locality principles

  • Hands-on experience with columnar data formats (Parquet, Avro, ORC) and compression techniques
  • Expertise in partitioning strategies, backfills, and large-scale data organization
  • Ability to design data models optimized for analytics and BI consumption

Data Ingestion & Orchestration Β· Experience building batch and streaming ingestion pipelines using GCP-native services Β· Knowledge of Pub/Sub-based streaming architectures, event schema design, and versioning Β· Strong understanding of incremental ingestion and CDC patterns, including idempotency and deduplication Β· Hands-on experience with workflow orchestration tools (Cloud Composer / Airflow) Β· Ability to design robust error handling, replay, and backfill mechanisms Data Processing & Transformation Β· Experience developing scalable batch and streaming pipelines using Dataflow (Apache Beam) and/or Spark (Dataproc) Β· Strong proficiency in BigQuery SQL, including query optimization, partitioning, clustering, and cost control. Β· Hands-on experience with Hadoop MapReduce and ecosystem tools (Hive, Pig, Sqoop) Β· Advanced Python programming skills for data engineering, including testing and maintainable code design Β· Experience managing schema evolution while minimizing downstream impact Analytics & Data Serving Β· Expertise in BigQuery performance optimization and data serving patterns Β· Experience building semantic layers and governed metrics for consistent analytics Β· Familiarity with BI integration, access controls, and dashboard standards Β· Understanding of data exposure patterns via views, APIs, or curated datasets Data Governance, Quality & Metadata Β· Experience implementing data catalogs, metadata management, and ownership models Β· Understanding of data lineage for auditability and troubleshooting Β· Strong focus on data quality frameworks, including validation, freshness checks, and alerting Β· Experience defining and enforcing data contracts, schemas, and SLAs Good to have Security, Privacy & Compliance Β· Hands-on experience implementing fine-grained access controls for BigQuery and GCS Β· Experience with Sprint planning and helping team technically. Β· Strong stakeholder communication and solution-architecture skills Expertise You’ll Bring:

  • Experience: [10-14]+ years in DevOps and Data Architecture, 5+ years designing on Pyspark/GCP/OCP at scale; prior on-prem cloud migration a must.
  • Education: Bachelor’s/Master’s in Computer Science, Information Systems, or equivalent experience.
  • Certifications:Google Cloud Professional Cloud Architect/DevOps/OCP (required or within 3 months). Plus: Professional Data Engineer, Security Engineer

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…