GCP Data Engineer

Required AI Experience: Must have hands-on experience using GPT and Gemini for business use cases. Candidates must be able to demonstrate how they use these tools. Relevant AI usage must be clearly highlighted on the resume., * Minimum 7 years of proven hands-on experience with GCP data services.

• Minimum 3 years of hands-on experience with the following technologies and responsibilities:

• Design and implement data pipelines using GCP services, including BigQuery, Cloud Storage, and Pub/Sub.
• Develop and manage workflows using Cloud Composer (Apache Airflow), including Cloud Composer 3, for scheduling and orchestration.
• Write clean, efficient, and scalable Python code using advanced programming techniques.
• Develop complex SQL queries in BigQuery using window functions, CTEs, and performance-tuning strategies.
• Build and maintain real-time data processing systems using Apache Kafka.
• Design and manage scalable NoSQL schemas using MongoDB.
• Use Shell scripting and perform Linux system administration tasks to support data infrastructure.
• Perform data profiling and implement data validation techniques to ensure data quality and integrity.
• Develop and maintain API integration scripts for service automation and data exchange.
• Troubleshoot and resolve data-related issues using analytical and problem-solving skills.
• Create and maintain data flow diagrams to communicate architecture and pipeline logic to stakeholders.

Additional Requirements

• Strong understanding of distributed systems and data engineering best practices.
• Excellent communication, documentation, and collaboration skills.
• Ability to work independently in a fast-paced environment.
• Experience with Agile methodology; SAFe experience preferred.
• Experience working in an onshore/offshore support model and collaborating with offshore teams.
• Experience with GitHub, RTC, and automation tools preferred.
• Google Cloud Professional Data Engineer Certification preferred.

Important Screening Checklist * Confirm the candidate is local to Hartford, CT and can work onsite 3 days per week.

• Triple-check and confirm USC, Green Card, or Green Card EAD status.
• Verify 7+ years of hands-on GCP data services experience.
• Verify 3+ years of experience with the listed technical skills.
• Confirm practical GPT and Gemini usage for business use cases and ensure it is clearly highlighted on the resume.
• Confirm availability for the Ropes Assessment.