Data Engineer - Google Cloud Platform

E & E SOLUTIONS, LLC

Denver, CO, United States

4 days ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Query Performance Java (Programming Language) Airflow Big Data BigQuery Cloud Computing Cloud Computing Security Computer Programming Data Architecture Extract Transform Load (ETL) DevOps Data Flow Control

+14 more

Identity and Access Management Query Optimization SQL Databases Data Streaming Enterprise Data Management Google Cloud Data Storage Technologies Sql Optimization Delivery Pipeline Git Data Lakes Integration Frameworks Data Pipelines Apache Beam

Job description

KANINI is seeking an experienced Senior Data Engineer with strong expertise in Google Cloud Platform (Google Cloud Platform) and Java-based Cloud Dataflow development. The ideal candidate will have hands-on experience building high-performance batch and streaming data pipelines using Apache Beam with Java, along with expertise in BigQuery, GCS, Cloud Composer, and modern data architecture., · Design, develop, and maintain scalable batch and streaming data pipelines using Google Cloud Dataflow with Java (Apache Beam).

· Build reusable, high-performance data processing frameworks using Java.

· Develop enterprise-grade ETL/ELT pipelines on Google Cloud Platform.

· Design and implement Medallion Architecture (Bronze, Silver, Gold) for modern data lake solutions.

· Develop and optimize analytical datasets using BigQuery.

· Write efficient SQL queries and optimize query performance for large datasets.

· Orchestrate workflows using Cloud Composer (Apache Airflow).

· Manage data storage and lifecycle using Google Cloud Storage (GCS).

· Implement CI/CD pipelines using Git and modern DevOps practices.

· Apply Google Cloud Platform IAM best practices for security and governance.

· Monitor, troubleshoot, and optimize Dataflow jobs for performance, scalability, and cost efficiency.

Requirements

This role requires a strong background in designing scalable enterprise data platforms, implementing Medallion Architecture, optimizing large-scale data processing, and delivering reliable ETL/ELT solutions on Google Cloud Platform., Mandatory Skills

· Strong hands-on experience with Java-based Google Cloud Dataflow (Apache Beam) - Must Have

· Strong programming experience in Java

· Hands-on experience with Apache Beam SDK

· Extensive experience with Google Cloud Platform (Google Cloud Platform)

· Strong expertise in BigQuery

· Experience building enterprise ETL/ELT pipelines

· Advanced SQL skills including query optimization

· Experience implementing Medallion Architecture

· Experience with Google Cloud Storage (GCS)

· Experience with Cloud Composer (Apache Airflow)

· Knowledge of CI/CD pipelines and Git

· Strong understanding of Google Cloud Platform IAM and cloud security