Data Engineer Senior (Google Cloud)
Role details
Job location
Tech stack
Job description
In this role, you will be contracted to build and maintain scalable data pipelines on Google Cloud Platform (GCP) to serve our fraud data mart customers. You will collaborate with cross-functional teams to ensure data integrity, reliability, and scalability, leveraging your expertise in Google BigQuery, Google Cloud Storage, Dataflow, Cloud Composer, Python, and SQL to develop effective data solutions supporting fraud data analytics and reporting efforts., * Design, build, and maintain scalable data pipelines using Google Cloud Platform tools such as BigQuery, Cloud Storage, Dataflow, Cloud Composer, and Pub/Sub.
- Write high-performance, production-grade Python and SQL, optimizing queries for ETL processes.
- Implement complex data models in BigQuery for optimal performance.
- Collaborate with cross-functional teams to understand data requirements and deliver effective solutions.
- Implement best practices for data quality, governance, and security.
- Monitor and troubleshoot data pipeline issues, ensuring high availability and performance.
- Contribute to data architecture decisions and provide recommendations for pipeline improvements.
Requirements
- Bachelor's or Master's degree in computer science, Information Systems, Engineering, or related field.
- 8+ years of hands-on experience with data management and consolidation.
- Strong expertise in Google BigQuery, Google Cloud Storage, Dataflow, Pub/Sub, and Cloud Composer.
- Proficiency in Python and SQL for data processing and automation.
- Experience with ETL processes and data pipeline design.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.
Nice-to-Have Skills:
- Deep expertise in real-time processing using Kafka or Pub/Sub.
- Experience with Power BI development and visualization.
- Experience with modern data stack such as Snowflake, Databricks.
- Knowledge of DevOps practices and tools such as Terraform.
- Google Professional Data Engineer certification.