Big Data Engineer, Remote - 71711

PRIMUS Global Services, Inc
United States
1 day ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) Airflow Big Data BigQuery Apache Hive Python (Programming Language) Microsoft SQL Server NoSQL Cloudera Scala (Programming Language) SQL Databases Data Streaming
+10 more
Workflow Management Systems Google Cloud Spring-boot Pyspark Gitlab-ci Apache Kafka Spark Streaming Software Coding Restful APIs Data Pipelines

Job description

We have an immediate opportunity for a Big Data Engineer to develop and support data pipelines using Python, PySpark, and Google Cloud Platform. The role requires experience with batch and streaming data processing, workflow orchestration, complex SQL, and integrating REST APIs into data pipelines. Candidates should be comfortable working across relational and NoSQL databases and supporting automated delivery processes.

Requirements

Required skills include Python, PySpark, Scala, Spark SQL, Spark Streaming, Airflow, Kafka, BigQuery, Dataproc, and GitLab CI. Strong communication and hands-on coding skills are essential. Experience with Java and Spring Boot is preferred. The interview process includes two rounds of live coding exercises using SQL Server, Python, and PySpark.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…