Machine Learning Engineer GCP Vertex AI Apache Iceberg

Ipolarity LLC
Hanover, NJ, United States
12 days ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Compensation
$93,600.0 - $114,400.0
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Apache HTTP Server Big Data BigQuery Continuous Integration Information Engineering Data Governance DevOps Distributed Data Store Monitoring of Systems Apache Hive Python (Programming Language)
+16 more
Machine Learning Metadata Cloudera SQL Databases Management of Software Versions Data Logging Feature Engineering Data Ingestion Apache Spark Model Validation Pyspark Kubernetes Data Lineage Machine Learning Operations Terraform Docker

Job description

  • Deploy and manage ML models using Google Vertex AI.
  • Build automated ML pipelines for batch and near real-time scoring.
  • Develop scalable data processing pipelines using Dataproc, Apache Spark, PySpark, and Spark SQL.
  • Design and optimize large-scale data lakes using Apache Iceberg.
  • Implement partitioning, schema evolution, versioning, and time-travel capabilities.
  • Build data ingestion, transformation, and feature engineering workflows.
  • Implement MLOps, CI/CD, model monitoring, retraining, and automation.
  • Work with BigQuery and Google Cloud Storage (GCS).
  • Monitor model performance, pipeline health, logging, metrics, and alerts.
  • Optimize GCP compute resources and cloud costs.
  • Support production incidents, reliability, security, and governance.

Requirements

7+ years of experience in Machine Learning Engineering, Data Engineering, or related areas. Strong GCP experience. Hands-on Vertex AI experience. Dataproc. Apache Spark / PySpark / Spark SQL. Apache Iceberg. Python and SQL. BigQuery and GCS. Experience building distributed data and ML pipelines. Strong understanding of MLOps and ML model lifecycle management. CI/CD and DevOps experience.

Preferred Skills.

  • Vertex AI Pipelines / Kubeflow Pipelines.
  • Docker / Kubernetes.
  • Feature Stores.
  • Model Monitoring.
  • Terraform / Infrastructure as Code.
  • Data Governance / Metadata / Data Lineage.
  • Financial Services, AML, Fraud, Risk Analytics, or regulated environments., We are looking for a platform-oriented Machine Learning Engineer who can bridge the gap between Data Science and Data Engineering and transform ML models into scalable, governed, production-ready solutions on GCP. If you have strong experience with GCP + Vertex AI + Dataproc/PySpark + Apache Iceberg + MLOps, we’d love to connect!

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:49 min

Building the machine learning engineering pipeline

Dora Petrella · World Congress 2023

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · World Congress 2025

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · World Congress 2026 Europe

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

Videos

See all

Related articles

See all