Cloudera Data Engineer

SIX Group

Barcelona, Spain

about 1 month ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Languages

English, Spanish

Job source

www.jobleads.com

Tech stack

Java (Programming Language) Agile Methodology Cloudera Impala Data Architecture Linux Hadoop Distributed File System Java Development Kit JSON Linux Servers Microsoft SQL Server Octopus Deploy OpenShift

+10 more

Scrum Methodology Extensible Markup Language (XML) Apache Spark Spring-boot Gitlab Git Gitlab-ci Avro Apache Kafka Spark Streaming

Job description

Act as a Cloudera Data Engineer with high skill on performance software development using Spark and Java/Scala.
Design, plan, and manage Spark applications based on Cloudera cluster technologies and workflows integrated with Kafka streams, ensuring correct implementation and quality of code.
Support the analysis of functional requirements to translate them into detailed technical specifications.

Requirements

Kudu, HDFS, Hive, Impala, Spark, Java, Open JDK, Spring Boot, OpenShift, Kafka, GitLab, GitLab CI, ArgoCD, Linux servers, SQL Server.
Experience with Spark streaming applications (writing in Scala/Java) using Kafka Streams.
Data design with Kudu and HDFS; Impala query development.
Working with XML, JSON, Avro, Git.
Nice to have: Iceberg, GitLab CI, OpenShift, ArgoCD, Agile framework, Linux.
High team-working ability and accurate working methods.
Proficient oral and written English and Spanish.

Benefits & conditions

Flexible Work Models - a well-balanced, productive environment.
Personal Development - culture of continuous learning and feedback, extensive learning offerings.
Agile Working Methods - Scrum or design thinking for solving exciting tasks together in teams.

Diversity is important to us. We welcome applications regardless of any personal background.

full_time

Organization Six Group Services