TELECOMMUTE Google Cloud Platform Data Solution Architect

SumasEdge Corporation
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English

Job location

Remote

Tech stack

Java
API
Airflow
Google BigQuery
Cloud Computing
Directed Acyclic Graph (Directed Graphs)
Relational Databases
Database Design
DevOps
Document Management Systems
DNS
Data Flow Control
Identity and Access Management
Python
Cloudera
PL-SQL
Data Streaming
Data Logging
Google Cloud Platform
Cloud Monitoring
Spring-boot
Angular
Data Pipelines
Apache Beam
Jenkins

Job description

  • Fix and enhance Dataflow and/or Dataproc Data ingestion pipelines (batch & Streaming) .

  • Have Good Understanding of Google Cloud Platform Composer (Apache Airflow) environments.

  • Manage Airflow DAGs and troubleshoot Airflow-related issues.

  • Monitor and optimize Composer performance and scalability.

  • Maintain Google Cloud Platform infrastructure including services like:

  • Google Cloud Storage (GCS)

  • BigQuery (BQ)

  • Cloud Dataflow ( Apache Beam )

  • Cloud Dataproc

  • Cloud Functions

  • Cloud Run

Have Good Understanding of:

  • IAM and service account permissions
  • Secret Manager

Monitor Google Cloud Platform usage and quotas, and proactively prevent quota-related issues.

Set up and manage alerting, logging, and monitoring using tools like Stackdriver (Cloud Monitoring & Logging).

Requirements

DB design experience (with Excellent RDBS-PLSQL knowledge )

Design Springboot APIs

Analyze, design, create Dockerfile

Knowledge on Angular ( Good to Have )

Design and implement infrastructure as code using Terraform for provisioning and managing Google Cloud Platform resources.

Collaborate with DevOps and development teams to manage CI/CD pipelines using Jenkins and other automation tools.

Ensure security, compliance, and cost-efficiency across the cloud environment.

Document system configurations, procedures, and best practices.

Proficient in either Java or Python programming languages.

Excellent problem-solving and troubleshooting skills.

Strong communication and documentation abilities.

Knowledge on DNS and SSO configuration setup

Knowledge on CDC Pipelines/Application (Good to Have)

Apply for this position