> Markdown version of [/jobs/ext/3644471-gcp-data-lead](https://www.wearedevelopers.com/jobs/ext/3644471-gcp-data-lead). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # GCP Data Lead - **Company:** HCL America Inc. - **Location:** Phoenix, AZ, United States - **Experience:** Expert - **Salary:** $82,000.0 - **Contract:** Permanent contract - **Skills:** Agile Methodology, Airflow, Big Data, BigQuery, Configuration Management, Computer Programming, Computer Engineering, Continuous Integration, Information Engineering, Relational Databases, Software Design Patterns, Distributed Systems, Enterprise Architecture Framework, Github, Apache Hadoop, Apache Hive, Python (Programming Language), Object-Oriented Software Development, Scrum Methodology, Systems Development Life Cycle, Cloudera, Shell Script, Software Configuration Management, Software Engineering, SQL Databases, Google Cloud, DevOps Tools - Open-source, Apache Spark, Git, Information Technology, Complex Event Processing, Data Analytics, Apache Kafka, Software Version Control, Data Pipelines, Jenkins - **Published:** October 9, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=7f10d304f3670913 ## About the Role * Education: Bachelor's or Master's degree in Computer Science, Computer Engineering, another technical discipline, or equivalent work experience. * Experience: 5+ years of hands-on software development experience with Big Data and analytics solutions. * GCP and Big Data: Hands-on experience with Google Cloud Platform technologies, including BigQuery, Dataproc, Pub/Sub, and Airflow, plus Hadoop, Hive, and Spark. * Programming and scripting: Strong Python and shell-scripting skills. * Data engineering: Strong experience designing, developing, and optimizing scalable data pipelines for large-scale data processing, transformation, and analysis. * SQL and data modelling: Proficiency in SQL and relational database systems, including designing and optimizing data models for performance and scalability. * Event processing: Experience building event-driven processing pipelines using Kafka or Google Cloud Pub/Sub. * Distributed systems: Knowledge of distributed, multi-tiered systems and algorithms. * Software engineering: Strong object-oriented programming skills and knowledge of design patterns. * CI/CD and source control: Experience with CI/CD pipelines, automated testing frameworks, and source-code management tools such as Jenkins and Git. * Problem solving: Ability to analyze complex data-engineering problems, propose effective solutions, and implement them successfully. * Enterprise frameworks: Ability and willingness to learn, adopt, and build solutions using established enterprise Big Data frameworks. * Collaboration: Effective communication with product and cross-functional teams. * Delivery methodology: Understanding of SDLC methodologies and familiarity with Agile and Scrum ceremonies. * Continuous improvement: Proactive approach to identifying improvement opportunities and willingness to learn and apply new technologies. Nice-to-Have Skills * Workflow and messaging tools: Additional design and development experience with Airflow, Pub/Sub, and Kafka. * DevOps tooling: Experience with Git, GitHub, Jenkins, XLR, and configuration-management practices. * Regulatory technology: Experience building innovative engineering solutions for financial-crimes compliance. * Engineering excellence: Experience improving resilience, predictability, delivery efficiency, and automation within engineering teams. * Product partnership: Experience partnering with product teams to envision and deliver technology-led transformation. * Certification: Google Cloud Professional Data Engineer certification. ## Description Big Data / GCP Data Engineer