Remote GCP Data Engineer

Insight Global is seeking a GCP Data Engineer to support a large healthcare client. This individual will join the Network and Providers team, supporting a critical roster migration initiative involving the movement and transformation of data within Google Cloud Platform (GCP).

This role requires a hands-on engineer with strong experience across Python development, GCP data engineering, PySpark, ETL, APIs, and DevOps, along with exposure to modern AI/LLM technologies. The engineer will work with large datasets in BigQuery, develop and orchestrate ETL pipelines, build cloud-native Python applications and APIs, and support CI/CD and infrastructure automation.

Day-to-Day Responsibilities Design, develop, and maintain cloud-native data pipelines in GCP Move, process, and transform data within the GCP environment Develop ETL processes using PySpark, BigQuery, Dataproc, Dataflow, and Cloud Composer/Airflow Create and manage BigQuery tables and data workflows Build Python applications and services using Django, Flask, and/or FastAPI Develop and maintain REST APIs and microservices Support solutions leveraging AI/LLMs, RAG, LangChain, and OpenAI integrations Deploy and support workloads using Cloud Run, GKE, and Kubernetes Develop and support Cloud Functions Write efficient SQL and PySpark for large-scale data processing Support CI/CD pipelines and DevOps best practices Assist with infrastructure automation using Terraform Partner with engineering and business teams to support the roster migration and broader provider/network data initiatives

6+ years of experience as a Data Engineer or Software Engineer -Strong Python development experience ->Experience with Python frameworks such as Django, Flask, and/or FastAPI -Strong experience designing and developing cloud-native data pipelines in GCP -Hands-on experience with BigQuery, Dataproc, Cloud Composer/Airflow, and Dataflow -Strong PySpark and SQL skills -Experience building and supporting ETL/data engineering pipelines -Experience developing APIs and microservices -Experience supporting CI/CD pipelines ->Experience with Kubernetes/GKE and containerized environments