> Markdown version of [/jobs/ext/3564392-data-engineer](https://www.wearedevelopers.com/jobs/ext/3564392-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** HCLTech - **Location:** London, UK (Remote available) - **Contract:** Temporary to permanent - **Skills:** Microsoft Access, Java (Programming Language), Agile Methodology, Automation of Tests, BigQuery, Cloud Storage, Computer Programming, Continuous Integration, Data Architecture, Data Governance, Data Security, DevOps, Fault Tolerance, Data Flow Control, Identity and Access Management, Python (Programming Language), Machine Learning, Meta-Data Management, Performance Tuning, Cloudera, SQL Databases, Technical Data Management Systems, Data Logging, Google Cloud, Data Ingestion, Cloud Monitoring, System Availability, Build Server, Git, Data Management, Terraform, Software Version Control, Data Pipelines, Apache Beam - **Published:** October 3, 2026 - **Apply:** https://find.jobs/jobs-near-me/apply/ats-redirect/?id=2999713623-2 ## About the Role We are seeking a GCP Data Proficient Engineer with strong hands-on experience in designing, building, and operating scalable data solutions on Google Cloud Platform (GCP). The role requires expertise across data ingestion, processing, storage, and analytics, with a strong focus on reliability, security, and performance. The engineer will work closely with product owners, architects, and cross-functional engineering teams to deliver high-quality, data-driven solutions., * Strong hands-on experience with Google Cloud Platform * BigQuery * Dataflow (Apache Beam) * Pub/Sub * Experience with IAM, service accounts, and GCP security best practices Data & Programming * Strong proficiency in SQL (performance tuning and optimization) * Good coding experience in Python (preferred) or Java * Experience handling large-scale, structured and semi-structured datasets DevOps & Quality * Experience with CI/CD, version control (Git), and automated testing * Familiarity with infrastructure-as-code (Terraform preferred) * Understanding of data quality, reconciliation, and validation frameworks Good to Have * Exposure to data governance, lineage, and metadata management tools * Knowledge of machine learning data preparation pipelines on GCP * GCP certifications such as: * Google Professional Data Engineer Behavioral & Soft Skills * Strong analytical and problem-solving mindset * Excellent communication and stakeholder management skills * Ownership-driven, proactive, and quality-focused * Ability to work in Agile / DevOps environments ## Description * Design, develop, and maintain scalable data pipelines using GCP-native services. * Implement batch and streaming data processing solutions using Apache Beam / Dataflow. * Build and optimize analytical datasets in BigQuery for reporting and advanced analytics. * Develop data ingestion frameworks using Pub/Sub, Cloud Storage, and Dataproc. * Design end-to-end data architectures aligned with GCP best practices. * Ensure high availability, fault tolerance, and cost optimization of data platforms. * Implement secure data access, encryption, and governance controls. * Collaborate with cloud architects to continuously improve platform maturity. * Write clean, efficient, and testable code using Python, SQL, or Java. * Implement CI/CD pipelines for data workloads using Cloud Build / Git-based pipelines. * Monitor data pipelines using Cloud Monitoring and Logging. * Troubleshoot production issues and drive root cause analysis. Stakeholder Collaboration * Work closely with business teams, analysts, and downstream consumers to understand data needs. * Translate business requirements into technical data solutions. * Provide technical guidance and mentoring to junior engineers. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Shifting Stress to Progress— Understanding DevOps to do DevOps Better](https://www.wearedevelopers.com/videos/268-shifting-stress-to-progress-understanding-devops-to-do-devops-better) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [The Cloud is Calling: Answer with In-Demand Skills](https://www.wearedevelopers.com/videos/945-the-cloud-is-calling-answer-with-in-demand-skills) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [7 Cloud Computing Trends Coming in 2025 for Developers](https://www.wearedevelopers.com/magazine/412-7-cloud-computing-trends-coming-in-2025-for-developers) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)