> Markdown version of [/jobs/ext/3243258-solution-architect](https://www.wearedevelopers.com/jobs/ext/3243258-solution-architect). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Solution Architect - **Company:** HCLTech - **Location:** London, UK - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Airflow, Audit Trail, Automation of Tests, Batch Processing, BigQuery, Cloud Database, Cloud Storage, Code Review, Continuous Integration, Data Validation, Data Governance, Extract Transform Load (ETL), Data Systems, Data Warehousing, Dimensional Modeling, Data Flow Control, JSON, Python (Programming Language), Metadata, Meta-Data Management, Query Optimization, Release Management, Cloudera, Software Engineering, SQL Databases, Unstructured Data, Parquet, Data Processing, Google Cloud, Real Time Systems, Apache Spark, Git, Data Lakes, Kubernetes, Infrastructure Automation Frameworks, Information Technology, Avro, Apache Kafka, Restful APIs, Terraform, Stream Processing, Software Version Control, Data Pipelines, Apache Beam, Docker - **Published:** September 23, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=9434b65c4c6426af ## About the Role * Strong hands-on experience with GCP data services, particularly BigQuery, Dataflow, Cloud Storage, and Pub/Sub. * Proficiency in SQL, including complex transformations, query tuning, data validation, and analytical processing. * Proficiency in Java or Python for data pipelines, automation, API integration, and production support. * Good understanding of ETL/ELT, data warehousing, data lakes, dimensional modelling, batch processing, and stream processing. * Experience with Apache Beam, Kafka, REST APIs, Docker, Kubernetes, or GKE. * Experience with data formats such as JSON, CSV, Avro, and Parquet. * Working knowledge of Git, automated testing, CI/CD pipelines, observability, and release management. * Ability to design solutions for scalability, resilience, security, performance, operability, and cost efficiency. Preferred Skills * Experience with Cloud Composer or Apache Airflow, Dataproc or Spark, Dataform or dbt, and metadata-driven pipeline frameworks. * Exposure to Terraform or another infrastructure-as-code tool. * Knowledge of Dataplex, data governance, metadata management, lineage, and access-control practices. * Experience modernizing legacy or on-premises data workloads to GCP. * Google Cloud Professional Data Engineer certification or an equivalent cloud data certification., Degree in Computer Science, Software Engineering or a related discipline, or equivalent practical experience. Experience delivering software solutions in agile teams. Knowledge of modern development frameworks, tools and engineering practices. ## Description * Design, develop, test, deploy, and maintain scalable ETL/ELT pipelines for structured and unstructured data. * Build batch and real-time processing solutions using BigQuery, Dataflow, Cloud Storage, Pub/Sub, and related GCP services. * Develop data-processing components and integrations using Java or Python, SQL, REST APIs, Kafka, and containerized services on GKE. * Implement reusable ingestion and transformation frameworks supporting full, incremental, and event-driven loads. * Design data models and optimize BigQuery tables through partitioning, clustering, efficient SQL, and cost-aware processing patterns. * Produce high-level and low-level technical designs, document assumptions, and contribute to architecture reviews. * Implement data-quality checks, schema validation, reconciliation, audit logging, lineage, monitoring, alerting, and error-handling mechanisms. * Troubleshoot complex production issues, perform root-cause analysis, and deliver sustainable corrective actions. * Apply security, privacy, access-control, reliability, and operational-support standards across data solutions. * Use source control, automated testing, CI/CD, and infrastructure-as-code practices to promote repeatable deployments. * Participate in code reviews, improve engineering standards, and mentor less-experienced engineers. * Collaborate with architects, analysts, application teams, platform teams, and business stakeholders to deliver reliable data products. ## Related Videos - [The Cloud is Calling: Answer with In-Demand Skills](https://www.wearedevelopers.com/videos/945-the-cloud-is-calling-answer-with-in-demand-skills) - [Tips and Tricks for Working with JSON](https://www.wearedevelopers.com/videos/1229-tips-and-tricks-for-working-with-json) - [From event streaming to event sourcing 101](https://www.wearedevelopers.com/videos/91-from-event-streaming-to-event-sourcing-101) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Introducing JSON Structure](https://www.wearedevelopers.com/videos/100219-introducing-json-structure) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) ## Related Articles - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [7 Cloud Computing Trends Coming in 2025 for Developers](https://www.wearedevelopers.com/magazine/412-7-cloud-computing-trends-coming-in-2025-for-developers) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)