Google Cloud Platform Data Platform Engineer

Configure and provision the onpremises Cloudera cluster environment including service account creation role definitions and permission structures for multitenant access

Design and implement Apache Iceberg table structures optimized for hybrid onpremcloud workloads

Integrate the Iceberg REST Catalog IRC with Apache Gravitino to establish a unified metadata layer across onprem and Google Cloud Platform environments

Establish Google Cloud Platform as a production tenant on the existing onprem Cloudera cluster validating the endtoend architecture pattern

Define and enforce data access governance including rolebased permissions and service account security policies across both environments

Drive the full lifecycle from environment setup through to production deployment

Publish comprehensive documentation and architectural blueprints covering crossplatform interoperability best practices vendor recommendations and access patterns for hybrid data lake implementations

5 years of relevant experience in data platform engineering

Handson experience with Google Cloud Platform Google Cloud Platform

Experience with onpremises Cloudera big data clusters

Experience with Apache Iceberg table format

Experience with Iceberg REST Catalog IRC

Experience with Apache Gravitino for metadata catalog integration

Experience with service account creation and rolebased access control in hybrid environments

Skills Required

Google Cloud Platform Cloudera Apache Iceberg Iceberg REST Catalog Apache Gravitino Service Account Management Role Based Access Control Hybrid Data Platform Architecture Multi Tenant Data Platform

Setup DPC environment create a service account Iceberg tables IRC with Gravitino DPC roles and permissions existing DPC cluster with Google Cloud Platform as one of the tenants to establish this pattern and take it all the way to production

Setup Google Cloud Platform environment create a service account Iceberg tables IRC Google Cloud Platform IAM roles and permissions existing Google Cloud Platform project GDWdev4 project to establish this pattern and take it all the way to production

Get IRC from DPC and Google Cloud Platform to sync with each other it can be one or more IRC from DPC and Google Cloud Platform

DPC and Google Cloud Platform platform should have the ability

Establish the pattern on interoperability for data access between DPC and Google Cloud Platform for Iceberg tables

Put the governance and guardrails around this access patterns and persona mapping on Google Cloud Platform side

Publish document and blueprints on this cross platform interoperability best practices vendor recommendations and access patterns