Cloudera Data Engineer
SIX Group
yesterday
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English, SpanishJob location
Tech stack
Java
Agile Methodologies
Cloudera Impala
Data Architecture
Linux
Hadoop Distributed File System
Java Development Kit
JSON
Linux Servers
Microsoft SQL Server
Octopus Deploy
Openshift
Scrum
XML
Spark
Spring-boot
Gitlab
GIT
Gitlab-ci
Avro
Kafka
Spark Streaming
Job description
- Act as a Cloudera Data Engineer with high skill on performance software development using Spark and Java/Scala.
- Design, plan, and manage Spark applications based on Cloudera cluster technologies and workflows integrated with Kafka streams, ensuring correct implementation and quality of code.
- Support the analysis of functional requirements to translate them into detailed technical specifications.
Requirements
- Kudu, HDFS, Hive, Impala, Spark, Java, Open JDK, Spring Boot, OpenShift, Kafka, GitLab, GitLab CI, ArgoCD, Linux servers, SQL Server.
- Experience with Spark streaming applications (writing in Scala/Java) using Kafka Streams.
- Data design with Kudu and HDFS; Impala query development.
- Working with XML, JSON, Avro, Git.
- Nice to have: Iceberg, GitLab CI, OpenShift, ArgoCD, Agile framework, Linux.
- High team-working ability and accurate working methods.
- Proficient oral and written English and Spanish.
Benefits & conditions
- Flexible Work Models - a well-balanced, productive environment.
- Personal Development - culture of continuous learning and feedback, extensive learning offerings.
- Agile Working Methods - Scrum or design thinking for solving exciting tasks together in teams.
Diversity is important to us. We welcome applications regardless of any personal background.
full_time
Organization Six Group Services