GCP Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+14 more
Job description
Role : GCP Data EngineerLocation : Charlotte NC (onsite)Rate : $62Indent : SF_OP_207823-1 / SF_OP_207823-2Detailed JD:We are seeking a highly skilled GCP Data Engineer to design, build, and optimize robust data pipelines. In this role, you will bridge the gap between our NoSQL data sources (MongoDB) and our analytical data warehouse (Big Query). You will be responsible for end-to-end data integration, performance tuning, and providing production support and debugging to ensure high availability and data quality.Key ResponsibilitiesĀ· Pipeline Integration: Design, build, and deploy scalable ETL/ELT data pipelines using Python and GCP-native services.Ā· Database Management: Integrate data from MongoDB into Google Cloud Storage and load/transform it in Big Query for analytics.Ā· Support & Debugging: Monitor, troubleshoot, and resolve pipeline failures and data discrepancies.Ā· Performance Tuning: Optimize Big Query queries, Dataflow jobs, and MongoDB indexing to ensure cost-efficiency and fast execution.Ā· Collaboration: Partner with Data Scientists, Software Engineers, and business stakeholders to translate requirements into reliable data models.Required Qualifications & SkillsĀ· Education: Bachelorās degree in computer science, Engineering, or a related technical field.Ā· Core GCP: Hands-on experience with core gcp data services: Big Query, Cloud Dataflow, Cloud Composer (Airflow), and Cloud Storage.Ā· Databases: Strong proficiency in NoSQL databases (specifically MongoDB) and data warehousing concepts.Ā· Programming: Advanced programming and scripting skills in Python and complex SQL.Ā· Support & CI/CD: Experience utilizing Cloud Logging/Monitoring for root cause analysis and implementing CI/CD frameworks.Preferred QualificationsĀ· Certifications such as the Google Cloud Professional Data Engineer.Ā· Familiarity with the BigQuery Data Engineering Agent to aid in pipeline troubleshooting and generation Role : GCP Data EngineerLocation : Charlotte NC (onsite)Rate : $62Indent : SF_OP_207823-1 / SF_OP_207823-2Detailed JD:We are seeking a highly skilled GCP Data Engineer to design, build, and optimize robust data pipelines. In this role, you will bridge the gap between our NoSQL data sources (MongoDB) and our analytical data warehouse (Big Query). You will be responsible for end-to-end data integration, performance tuning, and providing production support and debugging to ensure high availability and data quality.Key ResponsibilitiesĀ· Pipeline Integration: Design, build, and deploy scalable ETL/ELT data pipelines using Python and GCP-native services.Ā· Database Management: Integrate data from MongoDB into Google Cloud Storage and load/transform it in Big Query for analytics.Ā· Support & Debugging: Monitor, troubleshoot, and resolve pipeline failures and data discrepancies.Ā· Performance Tuning: Optimize Big Query queries, Dataflow jobs, and MongoDB indexing to ensure cost-efficiency and fast execution.Ā· Collaboration: Partner with Data Scientists, Software Engineers, and business stakeholders to translate requirements into reliable data models.Required Qualifications & SkillsĀ· Education: Bachelorās degree in computer science, Engineering, or a related technical field.Ā· Core GCP: Hands-on experience with core gcp data services: Big Query, Cloud Dataflow, Cloud Composer (Airflow), and Cloud Storage.Ā· Databases: Strong proficiency in NoSQL databases (specifically MongoDB) and data warehousing concepts.Ā· Programming: Advanced programming and scripting skills in Python and complex SQL.Ā· Support & CI/CD: Experience utilizing Cloud Logging/Monitoring for root cause analysis and implementing CI/CD frameworks.Preferred QualificationsĀ· Certifications such as the Google Cloud Professional Data Engineer.Ā· Familiarity with the BigQuery Data Engineering Agent to aid in pipeline troubleshooting and generation
Requirements
Ā· Education: Bachelorās degree in computer science, Engineering, or a related technical field.
Ā· Core GCP: Hands-on experience with core gcp data services: Big Query, Cloud Dataflow, Cloud Composer (Airflow), and Cloud Storage.
Ā· Databases: Strong proficiency in NoSQL databases (specifically MongoDB) and data warehousing concepts.
Ā· Programming: Advanced programming and scripting skills in Python and complex SQL.
Ā· Support & CI/CD: Experience utilizing Cloud Logging/Monitoring for root cause analysis and implementing CI/CD frameworks.
Preferred Qualifications
Ā· Certifications such as the Google Cloud Professional Data Engineer.
Ā· Familiarity with the BigQuery Data Engineering Agent to aid in pipeline troubleshooting and generation
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleā¦