Senior Data Engineer - Google Cloud

Ontrac Solutions
Chicago, IL, United States
1 day ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Airflow BigQuery Cloud Computing Cloud Engineering Continuous Integration Data Validation Data Cleansing Information Engineering Data Governance IBM DB2
+29 more
Data Flow Control Apache Hadoop Apache Hive Identity and Access Management Python (Programming Language) Microsoft SQL Server Oracle (Applications) Performance Tuning Standard Sql Cloudera Software Engineering SQL Databases Data Streaming Teradata SQL Google Cloud Sql Optimization Google Data Studio Netezza Retrieval-Augmented Generation Apache Spark Git Database Migration Pyspark Terraform Looker Analytics Data Pipelines Serverless Computing Apache Beam Databricks

Job description

The following covers the scope of work we anticipate the contractor supporting throughout the engagement.

  • Assess the customer’s current data estate and produce a target-state GCP data architecture and migration plan

  • Build ingestion, transformation, and orchestration pipelines (batch and streaming) into BigQuery, deployed entirely through Terraform and CI/CD

  • Migrate historical data and workloads with documented reconciliation proving row- and aggregate-level parity

  • Tune BigQuery models and queries for cost and performance, and leave the customer with monitoring and alerting on pipeline health

  • Deliver runbooks, architecture documentation, and knowledge-transfer sessions so the customer team can own the platform after hand-off

Requirements

Software Engineering, Cloud Computing, Consulting, Process Development, Business Transformation, Leading Edge Technology, Apache Hadoop, Cloud Computing, Warehousing, Software Engineering, * 6+ years in data engineering, including 3+ years delivering production workloads on Google Cloud Platform

  • Deep hands-on BigQuery experience: data modeling, partitioning and clustering, cost and performance tuning, and ELT in SQL

  • Built and operated batch and streaming pipelines with Dataflow (Apache Beam) and/or Dataproc (Spark / PySpark), with Pub/Sub as a streaming source

  • Orchestrated production workflows with Cloud Composer (Apache Airflow), including dependency management, retries, and alerting

  • Strong Python and advanced SQL

  • Provisioned GCP data infrastructure with Terraform and deployed through Git-based CI/CD

  • Delivered at least one migration into BigQuery from an on-prem or legacy platform (Hadoop/Hive, Teradata, Netezza, Oracle, DB2, SQL Server, or another cloud warehouse), including data validation and cut-over

  • Client-facing experience: running requirements sessions, presenting designs, and handing off documented solutions to customer teams

USEFUL QUALIFICATIONS

  • Google Cloud Professional Data Engineer certification (or a current Associate Cloud Engineer / Professional Cloud Architect)

  • Databricks certification or production Databricks-on-GCP experience

  • Looker / LookML modeling, or Looker Studio dashboard delivery

  • Serverless integration work on Cloud Run or Cloud Functions (API ingestion, event handlers)

  • Data governance on GCP: Dataplex, Data Catalog, IAM and column-level security, DLP

  • Feeding GenAI use cases from the warehouse: BigQuery ML, Vertex AI, embeddings or RAG data preparation

  • BigQuery Migration Service / SQL translation, Datastream, or Database Migration Service used on a real migration

  • Prior experience at a Google Cloud partner or in Google Cloud Professional Services

Benefits & conditions

  • Competitive Compensation: Compensation will be commensurate with experience.

  • Remote Work: Fully remote engagement from anywhere in the United States or Canada.

About the company

Ontrac Solutions is a leading technology consulting firm, specializing in cutting-edge solutions that drive business transformation. We partner with organizations to modernize their infrastructure, streamline processes, and deliver tangible results. By creating value beyond the hype, we help businesses modernize technology and build new strategies that fuel growth. Our team is committed to innovation, collaboration, and excellence, empowering our clients to succeed in an evolving digital landscape.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…