Technical Lead, Spark - Cloudera

Jobrapido
Barcelona, Spain
7 days ago
Apply on www.buscojobs.com.es
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience required
6 years minimum
Working hours
Regular working hours

Tech stack

Java (Programming Language) Information Engineering Software Debugging Distributed Computing Environment Distributed Systems Fault Tolerance Python (Programming Language) Cloudera Software Engineering SQL Databases System Testing Parquet
+3 more
SIGA Apache Spark Multi-Cloud

Job description

Overview¿Posee las habilidades y la experiencia adecuadas para este puesto?Siga leyendo para descubrirlo y envíe su solicitud.As Senior Staff Software Engineer, you design and deliver features for Cloudera’s data engineering experience at scale, contributing to Spark and Livy while shaping the next generation of data tooling.You work with a distributed team across the US and Hungary to turn prototypes into production-grade capabilities that run on thousands of nodes.You’ll deepen expertise in distributed data processing and incubate improvements across the data engineering stack.This role offers the chance to impact enterprise-scale analytics in a hybrid, multi-cloud context.Compensaciones / BeneficiosGenerous PTO PolicyFlexible WFH PolicyContinued Career DevelopmentComprehensive BenefitsPaid Volunteer TimeUnplugged DaysResponsabilidadesDesign and prototype new features for the data engineering experience, taking them through production delivery at scaleContribute to Apache Spark and Livy developmentDevelop features in Scala/Java/Python on modern platformsGain and apply distributed data processing knowledge (SQL planners/optimizers, data layouts, Parquet/Iceberg, fault tolerance)Develop deep understanding of the Cloudera Data Engineering Experience stack with a focus on Iceberg and SparkWork on large-scale distributed systems in production clusters (hundreds to thousands of nodes)Debug deployment issues, perform root-cause analysis, and conduct system test analysisImprove internal infrastructure and collaborate with team members and stakeholdersRequisitos principalesBsc/Msc in related field or equivalent experience6+ years of professional software developmentExperience leading and delivering complex product enhancementsStrong xqziphu knowledge of Java/Scala/Python; able to work with at least one of these languagesExperience with distributed systems design and developmentStrong communication skills; ability to research and solve problems independentlyOpen-minded with a willingness to learn and build great productsExperience with distributed systemsstrong oral and written communicationproblem-solving independencecollaboration and teamworkJava/Scala/Python proficiencyDistributed systems design and developmentApache Spark and Livy experience

Requirements

Requisitos principalesBsc/Msc in related field or equivalent experience 6+ years of professional software development Experience leading and delivering complex product enhancements Strong xqziphu knowledge of Java/Scala/Python; able to work with at least one of these languages Experience with distributed systems design and development Strong communication skills; ability to research and solve problems independently Open-minded with a willingness to learn and build great products Experience with distributed systems strong oral and written communication problem-solving independence collaboration and teamwork Java/Scala/Python proficiency Distributed systems design and development Apache Spark and Livy experience

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.buscojobs.com.es
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:50 min

How Parquet metadata enables efficient data reading

Matthias Niehoff Matthias Niehoff · World Congress 2026 Europe

1:41 min

Visualizing the complex developer journey for JVM ecosystems

Bobur Umurzokov · LIVE

2:03 min

Introduction to open table formats built on Parquet

Matthias Niehoff Matthias Niehoff · World Congress 2026 Europe

2:34 min

Capabilities of the Apache Spark processing engine

Ayon Roy · LIVE

4:36 min

Hiring passionate software engineers to tackle unprecedented scaling challenges

Dana Lawson Dana Lawson +1 · World Congress 2026 Europe

1:02 min

Shortcomings of standalone Parquet files for complex data

Matthias Niehoff Matthias Niehoff · World Congress 2026 Europe

Videos

See all

Related articles

See all