Systems Manager, GCP Data Engineering

Insight Global
New York, NY, United States
1 day ago
Apply on www.thejobnetwork.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
6 years minimum
Working hours
Regular working hours

Tech stack

Artificial Intelligence Airflow Microsoft Azure Big Data BigQuery Cloud Computing Cloud Storage Code Review Continuous Integration Information Engineering Data Governance Extract Transform Load (ETL)
+19 more
Data Flow Control Information Lifecycle Management Python (Programming Language) Meta-Data Management Query Optimization Cloudera SQL Databases Enterprise Data Management Privacy Controls Google Cloud Data Classification System Availability Apache Spark Information Technology Integration Frameworks Terraform Data Pipelines Serverless Computing Databricks

Job description

Insight Global is seeking a Systems Manager, GCP Data Engineering for a top energy and utilities client. This hands-on leader will manage a skilled team responsible for designing, building, and maintaining enterprise-grade data pipelines on Google Cloud Platform. The position will oversee the complete data lifecycle, including ingestion, transformation, curation, exposure, and activation, while partnering with architecture, platform, governance, and business teams to deliver trusted data products for analytics and AI/ML use cases. The ideal candidate combines deep expertise in GCP, SQL, Python, Spark, data modeling, and serverless architecture with proven people-management experience and a strong focus on operational excellence, data governance, platform reliability, and FinOps cost efficiency.

Requirements

Bachelor’s degree in Computer Science, Engineering, Math, Business, or another technology-focused field with at least 8 years of relevant full-time experience, or a master’s degree in one of these fields with at least 6 years of relevant experience.

-Hands-on data engineering, pipeline architecture, or data-platform operations experience, including experience leading and managing technical teams.

-Extensive experience designing, developing, and operating large-scale data pipelines on Google Cloud Platform.

-Strong working knowledge of GCP services such as BigQuery, Dataflow, Dataproc, Pub/Sub, Dataplex, and Cloud Storage.

-Proficiency in SQL, Python, or Spark for large-scale data processing and data modeling.

-Experience with ETL/ELT pipeline design and workflow orchestration using tools such as Composer or Airflow.

-Experience with CI/CD pipelines and Infrastructure as Code using Terraform.

-Experience defining and managing operational metrics, SLAs, and KPIs for enterprise data-integration platforms.

-Proven ability to review code, guide architecture, troubleshoot complex pipeline issues, and support technical prototyping.

-Valid driver’s license

Nice to Have Skills & Experience

-Master’s degree in Computer Science, Engineering, Math, Business, or another technology-focused field.

-Experience implementing data-governance frameworks, metadata management, lineage, data classification, and data-quality testing.

-Experience with Great Expectations, Dataplex, or Dataform.

-Azure DevOps experience for CI/CD.

-Background in utilities, energy, or another highly regulated industry.

-Exposure to NERC CIP compliance, security protocols, privacy controls, or PII handling.

-Experience migrating data workloads from legacy environments, Azure, Databricks, or C3.ai to GCP.

Familiarity with GCP FinOps, query optimization, storage-cost management, and spend-anomaly identification.

-Experience enabling downstream AI/ML use cases through Vertex AI, Enterprise Gemini, or Model and Agent Garden.

-Google Professional Data Engineer, Google Professional Cloud Architect, or another relevant technical certification.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.thejobnetwork.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

2:30 min

Leveraging BigQuery ML for scalable SQL-based segmentation experiments

Julian Joseph · LIVE

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · World Congress 2024

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

Videos

See all

Related articles

See all