Google Cloud Platform Data Engineer (Looking For W2 Candidate Only)

Ruri Software Technologies LLC
Dallas, TX, United States
2 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Airflow Big Data BigQuery Cloud Storage Continuous Integration Directed Acyclic Graph (Directed Graphs) Data Validation Extract Transform Load (ETL) Data Transformation Data Security Data Warehousing Data Flow Control
+15 more
Python (Programming Language) Query Optimization SQL Stored Procedures Workflow Management Systems Data Logging Freeform SQL Google Cloud Sql Optimization Apache Spark Git Data Lakes Pyspark Infrastructure Automation Frameworks Terraform Data Pipelines

Job description

We are looking for an experienced Google Cloud Platform Data Engineer with strong hands-on experience in Google Cloud Platform (Google Cloud Platform), Apache Airflow, and BigQuery. The ideal candidate will be responsible for designing, developing, implementing, and maintaining scalable data pipelines and data engineering solutions., Design, develop, and maintain scalable data pipelines using Google Cloud Platform.

Build and manage ETL/ELT workflows using Apache Airflow.

Develop complex SQL queries, stored procedures, and data transformations in BigQuery.

Implement and maintain data ingestion processes from multiple sources into Google Cloud Platform.

Work with Google Cloud Platform services such as Cloud Storage (GCS), Dataflow, Pub/Sub, and Cloud Composer.

Develop and schedule automated workflows using Airflow DAGs.

Monitor, troubleshoot, and optimize data pipelines for performance and reliability.

Perform BigQuery query optimization, partitioning, clustering, and cost optimization.

Implement data quality checks, validation, and error-handling mechanisms.

Collaborate with data architects, analysts, and other engineering teams.

Ensure data security, governance, and compliance standards.

Requirements

The candidate should have expertise in building ETL/ELT workflows, managing large datasets, optimizing BigQuery queries, and orchestrating data pipelines using Apache Airflow., Strong hands-on experience with Google Cloud Platform (Google Cloud Platform).

Expertise in BigQuery, including advanced SQL and query optimization.

Hands-on experience with Apache Airflow and DAG development.

Experience with Cloud Composer for workflow orchestration.

Strong Python programming skills.

Experience developing ETL/ELT data pipelines.

Good understanding of data warehousing and data modeling concepts.

Experience with Google Cloud Storage (GCS).

Knowledge of Dataflow, Pub/Sub, and other Google Cloud Platform services.

Experience with Git and CI/CD processes.

Preferred Qualifications

Google Cloud Professional Data Engineer certification.

Experience with Spark / PySpark.

Knowledge of Terraform and infrastructure automation.

Experience with data lake and lakehouse architectures.

Familiarity with monitoring and logging tools in Google Cloud Platform.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…