> Markdown version of [/jobs/ext/2805107-gcp-python-data-engineer](https://www.wearedevelopers.com/jobs/ext/2805107-gcp-python-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # GCP Python Data Engineer - **Company:** Capgemini - **Location:** United States - **Experience:** Experienced - **Salary:** $115,000.0 - $145,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Airflow, Data Analysis, Batch Processing, BigQuery, Cloud Computing, Cloud Storage, Computer Programming, Information Engineering, Extract Transform Load (ETL), Data Systems, Data Warehousing, Data Flow Control, Identity and Access Management, Python (Programming Language), Query Optimization, Cloud Services, Standard Sql, Cloudera, Search Technologies, Software Engineering, Data Streaming, Unstructured Data, Enterprise Data Management, Data Logging, Data Processing, Scripting, Google Cloud, Data Storage Technologies, Cloud Monitoring, Large Language Models, Prompt Engineering, Apache Spark, Event Driven Architecture, Data Lakes, AI Platforms, Pyspark, Deployment Automation, Data Management, Virtual Agents, Cloud Optimization, Terraform, Data Pipelines - **Published:** September 9, 2026 - **Apply:** https://www.capgemini.com/jobs/538592-en_US_SAPBTP/x/ ## About the Role * 5+ years of data engineering, software engineering, or related experience. * 2+ years of hands-on Google Cloud Platform (GCP) experience. * 2+ years of professional Python development experience. * Experience developing batch and real-time data pipelines. * Advanced SQL development and query optimization skills. * Experience with data warehousing, ETL/ELT, and modern data architecture patterns. * Strong understanding of cloud-native data engineering practices., * Experience with Vertex AI and Google AI services. * Experience building AI/ML data platforms and pipelines. * Knowledge of Large Language Models (LLMs) and GenAI concepts. * Experience with Gemini models, Agentic AI frameworks, Prompt Engineering, RAG architectures, and Vector Search. * Experience with Dataproc, Spark, or PySpark. * Familiarity with event-driven architectures. * Experience with Terraform or Infrastructure as Code. * Understanding of cloud cost optimization and FinOps practices. * Financial Services industry experience. * Google Cloud Professional Data Engineer Certification. ## Description We are seeking a highly skilled GCP Python Data Engineer to design, build, and optimize scalable cloud-based data solutions on Google Cloud Platform (GCP). The ideal candidate will possess strong Python development skills, hands-on experience with modern data engineering technologies, and expertise in building both batch and real-time data pipelines supporting analytics, AI/ML, and enterprise reporting initiatives. Work Authorization: Candidates must be authorized to work in the United States without current or future sponsorship. No visa sponsorship, transfers, or C2C arrangements are available., Data Engineering & Pipeline Development * Design, develop, and optimize ETL/ELT pipelines for structured and unstructured data. * Build scalable batch and streaming data processing solutions using GCP technologies. * Develop event-driven data processing solutions leveraging Pub/Sub and Cloud Functions. * Create and maintain data ingestion frameworks for enterprise data platforms. Data Storage & Analytics * Design and optimize data lake, lakehouse, and data warehouse solutions. * Build efficient data models supporting analytics, reporting, and AI/ML workloads. * Optimize performance, scalability, and cost efficiency of data pipelines and queries. Development & Automation * Develop robust Python-based solutions and frameworks. * Automate orchestration and workflow management using Cloud Composer (Airflow). * Implement CI/CD pipelines and deployment automation. * Apply software engineering best practices for testing, monitoring, and observability. Collaboration & Support * Partner with business stakeholders, analytics teams, data scientists, and engineers to deliver data solutions. * Troubleshoot production issues and perform root cause analysis. * Continuously improve reliability, scalability, security, and operational excellence., * BigQuery * Dataflow * Dataproc * Pub/Sub * Cloud Functions * Cloud Composer (Airflow) * Cloud Storage * Cloud SQL * IAM * Cloud Monitoring * Cloud Logging Programming & Data Engineering * Python * SQL * Bash/Shell Scripting * ETL/ELT * Data Warehousing * Data Lake / Lakehouse Architectures * Batch Processing * Real-Time Streaming Architectures ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [The Cloud is Calling: Answer with In-Demand Skills](https://www.wearedevelopers.com/videos/945-the-cloud-is-calling-answer-with-in-demand-skills) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Beyond GPT: Building Unified GenAI Platforms for the Enterprise of Tomorrow](https://www.wearedevelopers.com/videos/1525-beyond-gpt-building-unified-genai-platforms-for-the-enterprise-of-tomorrow) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [7 Cloud Computing Trends Coming in 2025 for Developers](https://www.wearedevelopers.com/magazine/412-7-cloud-computing-trends-coming-in-2025-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [The Prompt Engineer ✍️](https://www.wearedevelopers.com/magazine/216-the-prompt-engineer) - [The Top ChatGPT Plugins for Developers in 2023](https://www.wearedevelopers.com/magazine/259-the-top-chatgpt-plugins-for-developers-in-2023) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)