Cloudera Data Engineer

At SIX / BME, our goal is to build and operate a cloud-ready data and software infrastructure using modern technologies. We are looking for a Cloudera Data Engineer to work closely with platform architects, software engineers, and DevOps teams, contributing to the design and operation of high-performance data solutions within the Cloudera ecosystem., * Act as a Cloudera Data Engineer with high skill on performance software development using spark and java/scala languages.

• Design, planning and management spark applications, based on Cloudera cluster technologies and workflows integrated with Kafka streams. Ensuring correct implementation and quality of code.
• Support in the analysis of functional requirements to bring them to detailed technical specifications.
• Technology that you will work with: KUDU, HDFS, Hive, Impala, Spark, Java, OPEN JDK, Springboot, Openshift, Kafka, Gitlab, Gitlab CI, ArgoCD, Linux servers, SQL Server and much more

• Experience in Cloudera ecosystem. Cloudera manager, Ranger, Knox, Atlas, hive…
• Experience with: Spark with streaming applications (writing in Scala/Java) using Kafka Streams. Kudu and HDFS data design, Impala queries.
• experience with: XML, JSON, Avro, GIT
• Nice to have experience: Iceberg case of use, Gitlab CI. Openshift. ArgoCD, Agile framework, Linux
• High team-working ability and accurate working methods
• Proficient oral and written English and Spanish

BME - Bolsas y Mercados Españoles - drives the transformation of financial markets and belongs to SIX, the third largest exchange group in Europe. What sets us apart drives us ahead: between local roots and global relevance, we are a unique blend of tradition and future, of foundation and growth. We value bright minds and inspire them to grow with their ideas. Come and shape the future of finance with us.