Big Data Engineer, Remote - 71711
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+10 more
Job description
We have an immediate opportunity for a Big Data Engineer to develop and support data pipelines using Python, PySpark, and Google Cloud Platform. The role requires experience with batch and streaming data processing, workflow orchestration, complex SQL, and integrating REST APIs into data pipelines. Candidates should be comfortable working across relational and NoSQL databases and supporting automated delivery processes.
Requirements
Required skills include Python, PySpark, Scala, Spark SQL, Spark Streaming, Airflow, Kafka, BigQuery, Dataproc, and GitLab CI. Strong communication and hands-on coding skills are essential. Experience with Java and Spring Boot is preferred. The interview process includes two rounds of live coding exercises using SQL Server, Python, and PySpark.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦