GCP Senior Data Lead

• Administer, configure, maintain, and upgrade the Eligible to workP Composer (Apache Airflow) environment. (Mandatory)
• Design and implement Infrastructure as Code (IaC) using Terraform for provisioning and managing Eligible to workP resources. (Mandatory)
• Create Terraform modules and publish them in TFE (Terraform Enterprise).
• Perform DAG deployment, troubleshooting, performance tuning, and operational support.
• Support and Eligible to workimize Dataflow and Dataproc workloads, including batch and streaming data processing pipelines.
• Maintain Eligible to workP infrastructure, including the following services:
• Eligible to workP Composer (Apache Airflow)
• Google Cloud Storage (Eligible to workS)
• BigQuery (BQ)
• Cloud Dataflow / Apache Beam
• Cloud Dataproc
• Cloud Functions (Mandatory)
• Cloud Run
• Pub/Sub
• Cloud SQL
• Secret Manager
• Logging & Monitoring
• Monitor Eligible to workP usage and quotas and proactively prevent quota-related issues.
• Set up and manage alerting by creating alert policies in Eligible to workP Monitoring. (Mandatory)
• Manage CI/CD pipelines using Jenkins and/or other CI/CD tools. (Mandatory)
• Request Identity and Access Management (IAM) permissions, service accounts, and security policies following least-privilege principles.
• Ensure security, compliance, and cost-efficiency across the cloud environment.
• Monitor cloud infrastructure health, performance, and resource utilization using Cloud Monitoring, Cloud Logging, Error Reporting, and Cloud Trace.
• Develop automation scripts and operational tools using Python and/or Java to improve platform efficiency and reduce manual effort.
• Create and maintain operational documentation, runbooks, architecture diagrams, standard operating procedures (SOPs), and platform best practices.
• Demonstrate excellent problem-solving and troubleshooting skills.

GCP (Good Clinical Practices), Apache, Performance Tuning/Optimization, Operational Support, Identify Issues, Data Processing, Data Management, Cloud Computing, Policy Development, Jenkins, * Experience with CDC platforms such as Striim.

• Experience with ServiceNow integrations and operational workflows.
• Knowledge of FinOps, cloud cost Eligible to workimization, and governance frameworks.
• Understanding of networking components, including:
• VPCs and Shared VPCs
• VPC Connectors
• Firewall Rules
• CIDR Ranges
• Exposure to the healthcare domain.

Security Notice: Our official website is www.diverselynx.com We do not operate or authorize any other websites representing Diverse Lynx LLC.