Google Cloud Platform Data Engineer-W2

Administer, configure, maintain and upgrade Google Cloud Platform Composer (Apache Airflow) environment ( Mandatory )

Design and implement infrastructure as code using Terraform for provisioning and managing Google Cloud Platform resources. (Mandatory)

Able to create Terraform modules and publish same in TFE (Terraform Enterprise )

DAG deployment, Troubleshooting, performance tuning, and operational support.

Support and optimize Dataflow and Dataproc workloads, including batch and streaming data processing pipelines.

Maintain Google Cloud Platform infrastructure including services like:

Google Cloud Platform Composer (Apache Airflow)

Google Cloud Storage (GCS)

BigQuery (BQ)

Cloud Dataflow /Apache Beam

Cloud Dataproc

Cloud Functions — (Mandatory)

Cloud Run

Pub/Sub

Cloud SQL

Secret Manager

Logging & Monitoring

Monitor Google Cloud Platform usage and quotas, and proactively prevent quota-related issues.

Set up and manage alerting by Creating Alert policies in Google Cloud Platform Monitoring . (Mandatory)

Manage CI/CD pipelines using Jenkins and/or using other CI/CD tools.(Mandatory)

Able to request Identity and Access Management (IAM) permissions, service accounts, and security policies following least-privilege principles.

Ensure security, compliance, and cost-efficiency across the cloud environment.

Monitor cloud infrastructure health, performance, and resource utilization using Cloud Monitoring, Cloud Logging, Error Reporting, and Cloud Trace.

Develop automation scripts and operational tools using Python and/or Java to improve platform efficiency and reduce manual effort.

Create and maintain operational documentation, runbooks, architecture diagrams, standard operating procedures (SOPs), and platform best practices.

Excellent problem-solving and troubleshooting skills.

Nice to Have Skills:

Experience with CDC platforms such as Striim

Experience with ServiceNow integrations and operational workflows

Knowledge of FinOps, cloud cost optimization, and governance frameworks

Networking components understanding including:

VPCs and Shared VPCs

VPC Connectors

Firewall Rules

CIDR Ranges

Exposure to healthcare domain.