Remote Data Engineer

Global Channel Management, Incorporated
Santa Clara, CA, United States
1 day ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours

Tech stack

Airflow Apache HTTP Server Big Data BigQuery Cloud Computing Cloud Storage Computer Programming Continuous Integration Information Engineering DevOps Data Flow Control Github
+16 more
Python (Programming Language) Performance Tuning Software Engineering SQL Databases Data Processing Scripting Google Cloud Cloud Platform System Data Ingestion Sql Optimization Gitlab Git Deployment Automation Data Management Software Version Control Data Pipelines

Job description

Design, implement, and optimize clean, well-structured, and performant analytical datasets to support high-volume reporting, business analysis, and data science model development.

Architect, build, and maintain scalable and robust data pipelines for diverse applications, including business intelligence, advanced analytics

Implement and support Big Data solutions for both batch (scheduled) and real-time/streaming analytics.

Work closely with product managers and business teams to understand data requirements and translate them into technical solutions.

Requirements

Cloud Computing, GCP (Good Clinical Practices), Performance Tuning/Optimization, Data Modeling, Python Programming/Scripting Language, Software Engineering, Data Processing, SQL (Structured Query Language), Data Management, Apache, Cloud Platform Expertise (GCP Focus): Extensive hands-on experience working in dynamic cloud environments, with a strong preference for Google Cloud Platform (GCP) services, specifically:

BigQuery: Expert-level skills in data ingestion, performance optimization, and data modeling within a petabyte-scale environment.

Experience with other relevant GCP services like Cloud Storage, Cloud Dataflow/Beam, or Pub/Sub

Programming & Querying:

Python: Expert-level programming proficiency in Python, including experience with relevant data engineering libraries

SQL: A solid command of advanced SQL for complex querying, data processing, and performance tuning.

Data Pipeline Orchestration: Prior experience using workflow management and orchestration tools (e.g., Apache Airflow, Cloud Composer, Airflow,Dagster, or similar).

DevOps/CI/CD: Experience with version control (Git) and familiarity with CI/CD practices and tools (e.g., GitLab, GitHub Actions) to automate deployment and testing processes.

DevOps/CI/CD, Data Pipeline Orchestration:, SQL, Cloud Platform Expertise (GCP Focus):, Cloud Storage, Cloud Dataflow/Beam, or Pub/Sub

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…