TELECOMMUTE Google Cloud Platform Data Solution Architect
Role details
Job location
Tech stack
Job description
-
Fix and enhance Dataflow and/or Dataproc Data ingestion pipelines (batch & Streaming) .
-
Have Good Understanding of Google Cloud Platform Composer (Apache Airflow) environments.
-
Manage Airflow DAGs and troubleshoot Airflow-related issues.
-
Monitor and optimize Composer performance and scalability.
-
Maintain Google Cloud Platform infrastructure including services like:
-
Google Cloud Storage (GCS)
-
BigQuery (BQ)
-
Cloud Dataflow ( Apache Beam )
-
Cloud Dataproc
-
Cloud Functions
-
Cloud Run
Have Good Understanding of:
- IAM and service account permissions
- Secret Manager
Monitor Google Cloud Platform usage and quotas, and proactively prevent quota-related issues.
Set up and manage alerting, logging, and monitoring using tools like Stackdriver (Cloud Monitoring & Logging).
Requirements
DB design experience (with Excellent RDBS-PLSQL knowledge )
Design Springboot APIs
Analyze, design, create Dockerfile
Knowledge on Angular ( Good to Have )
Design and implement infrastructure as code using Terraform for provisioning and managing Google Cloud Platform resources.
Collaborate with DevOps and development teams to manage CI/CD pipelines using Jenkins and other automation tools.
Ensure security, compliance, and cost-efficiency across the cloud environment.
Document system configurations, procedures, and best practices.
Proficient in either Java or Python programming languages.
Excellent problem-solving and troubleshooting skills.
Strong communication and documentation abilities.
Knowledge on DNS and SSO configuration setup
Knowledge on CDC Pipelines/Application (Good to Have)