GCP Data Engineer (AI Experience)
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+16 more
Job description
We are seeking a GCP Data Engineer with AI experience for a contract position based remotely. This is a contract-to-hire opportunity with a 6-month initial term., * Design and implement robust data pipelines using Google Cloud Platform (GCP) services such as BigQuery, Cloud Storage, and Pub/Sub
- Develop and manage workflows using Cloud Composer (Apache Airflow) for efficient scheduling and orchestration
- Write clean, efficient, and scalable code in Python, leveraging advanced programming techniques
- Craft complex SQL queries in BigQuery, including window functions, CTEs, and performance tuning strategies
- Build and maintain real-time data processing systems using Apache Kafka
- Model and manage NoSQL databases, particularly MongoDB, with a focus on scalable schema design
- Utilize Shell scripting and perform Linux system administration tasks to support data infrastructure
- Conduct data profiling and implement validation techniques to ensure data quality and integrity
- Develop and maintain API integration scripts for seamless service automation and data exchange
- Troubleshoot and resolve data-related issues with strong analytical and problem-solving skills
- Create and maintain data flow diagrams to clearly communicate architecture and pipeline logic to stakeholders
Requirements
GCP (Good Clinical Practices), Artificial Intelligence (AI), GCP (Good Clinical Practices), Artificial Intelligence (AI), Consulting, Data Management, Cloud Storage, Cloud Computing, Apache, Python Programming/Scripting Language, * Required: Minimum 7 years of proven hands-on experience with GCP data services
- Required: Minimum 3 years of proven hands-on experience with the core responsibilities listed above
- Required: Demonstrated experience with AI technologies (GPT, Gemini) with clear, business-focused use cases highlighted on resume
- Required: Strong understanding of distributed systems and data engineering best practices
- Required: Excellent communication and documentation skills
- Required: Ability to work independently and collaboratively in a fast-paced environment
- Required: Experience with Agile methodology
- Required: Experience working in onshore/offshore support model, collaborating effectively with offshore teams
- Preferred: GCP Google Cloud Professional Data Engineer Certification
- Preferred: Experience with SAFe methodology
- Preferred: Experience working with GitHub, RTC, and automation tools
Additional Requirement: Candidates must complete a ROPES Assessment.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦