GCP Data Engineer

Peoplentech Llc
Alexandria, VA, United States
4 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
$128,960.0
Working hours
Regular working hours

Tech stack

Airflow BigQuery Cloud Computing Cloud Storage Computer Programming Databases Continuous Delivery Continuous Integration Information Engineering Data Integration Extract Transform Load (ETL) Data Warehousing
+14 more
Software Debugging Data Flow Control Python (Programming Language) MongoDB NoSQL Performance Tuning SQL Databases Data Logging Scripting Google Cloud System Availability Information Technology Enterprise Integration Data Pipelines

Job description

Role : GCP Data EngineerLocation : Charlotte NC (onsite)Rate : $62Indent : SF_OP_207823-1 / SF_OP_207823-2Detailed JD:We are seeking a highly skilled GCP Data Engineer to design, build, and optimize robust data pipelines. In this role, you will bridge the gap between our NoSQL data sources (MongoDB) and our analytical data warehouse (Big Query). You will be responsible for end-to-end data integration, performance tuning, and providing production support and debugging to ensure high availability and data quality.Key ResponsibilitiesĀ· Pipeline Integration: Design, build, and deploy scalable ETL/ELT data pipelines using Python and GCP-native services.Ā· Database Management: Integrate data from MongoDB into Google Cloud Storage and load/transform it in Big Query for analytics.Ā· Support & Debugging: Monitor, troubleshoot, and resolve pipeline failures and data discrepancies.Ā· Performance Tuning: Optimize Big Query queries, Dataflow jobs, and MongoDB indexing to ensure cost-efficiency and fast execution.Ā· Collaboration: Partner with Data Scientists, Software Engineers, and business stakeholders to translate requirements into reliable data models.Required Qualifications & SkillsĀ· Education: Bachelor’s degree in computer science, Engineering, or a related technical field.Ā· Core GCP: Hands-on experience with core gcp data services: Big Query, Cloud Dataflow, Cloud Composer (Airflow), and Cloud Storage.Ā· Databases: Strong proficiency in NoSQL databases (specifically MongoDB) and data warehousing concepts.Ā· Programming: Advanced programming and scripting skills in Python and complex SQL.Ā· Support & CI/CD: Experience utilizing Cloud Logging/Monitoring for root cause analysis and implementing CI/CD frameworks.Preferred QualificationsĀ· Certifications such as the Google Cloud Professional Data Engineer.Ā· Familiarity with the BigQuery Data Engineering Agent to aid in pipeline troubleshooting and generation Role : GCP Data EngineerLocation : Charlotte NC (onsite)Rate : $62Indent : SF_OP_207823-1 / SF_OP_207823-2Detailed JD:We are seeking a highly skilled GCP Data Engineer to design, build, and optimize robust data pipelines. In this role, you will bridge the gap between our NoSQL data sources (MongoDB) and our analytical data warehouse (Big Query). You will be responsible for end-to-end data integration, performance tuning, and providing production support and debugging to ensure high availability and data quality.Key ResponsibilitiesĀ· Pipeline Integration: Design, build, and deploy scalable ETL/ELT data pipelines using Python and GCP-native services.Ā· Database Management: Integrate data from MongoDB into Google Cloud Storage and load/transform it in Big Query for analytics.Ā· Support & Debugging: Monitor, troubleshoot, and resolve pipeline failures and data discrepancies.Ā· Performance Tuning: Optimize Big Query queries, Dataflow jobs, and MongoDB indexing to ensure cost-efficiency and fast execution.Ā· Collaboration: Partner with Data Scientists, Software Engineers, and business stakeholders to translate requirements into reliable data models.Required Qualifications & SkillsĀ· Education: Bachelor’s degree in computer science, Engineering, or a related technical field.Ā· Core GCP: Hands-on experience with core gcp data services: Big Query, Cloud Dataflow, Cloud Composer (Airflow), and Cloud Storage.Ā· Databases: Strong proficiency in NoSQL databases (specifically MongoDB) and data warehousing concepts.Ā· Programming: Advanced programming and scripting skills in Python and complex SQL.Ā· Support & CI/CD: Experience utilizing Cloud Logging/Monitoring for root cause analysis and implementing CI/CD frameworks.Preferred QualificationsĀ· Certifications such as the Google Cloud Professional Data Engineer.Ā· Familiarity with the BigQuery Data Engineering Agent to aid in pipeline troubleshooting and generation

Requirements

Ā· Education: Bachelor’s degree in computer science, Engineering, or a related technical field.

Ā· Core GCP: Hands-on experience with core gcp data services: Big Query, Cloud Dataflow, Cloud Composer (Airflow), and Cloud Storage.

Ā· Databases: Strong proficiency in NoSQL databases (specifically MongoDB) and data warehousing concepts.

Ā· Programming: Advanced programming and scripting skills in Python and complex SQL.

Ā· Support & CI/CD: Experience utilizing Cloud Logging/Monitoring for root cause analysis and implementing CI/CD frameworks.

Preferred Qualifications

Ā· Certifications such as the Google Cloud Professional Data Engineer.

Ā· Familiarity with the BigQuery Data Engineering Agent to aid in pipeline troubleshooting and generation

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…