Big Data Engineer (10 Years)

ERP Analysts, Inc
Dublin, United States
4 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Shift work
Job source

Tech stack

Java (Programming Language) Airflow Big Data BigQuery Continuous Integration Apache Hive Python (Programming Language) NoSQL Cloudera Scala (Programming Language) Freeform SQL Google Cloud
+8 more
Spring-boot Backend Pyspark Gitlab-ci Apache Kafka Spark Streaming Restful APIs Data Pipelines

Requirements

Python, Airflow, PySpark, Spark SQL, Spark Streaming, Scala, Relational/No SQL

databases, Apache Kafka, writing complex SQL queries, Google Cloud Platform (Big Query, Dataproc),

working with RESTful APIs in data pipelines, CI/CD (GitLab CI)

Bonus Skills:

Experience with backend stack (Java, Spring Boot)

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…