Technical Lead, Spark - Barcelona

OverviewAs Senior Staff Software Engineer, you design and deliver features for Cloudera’s data engineering experience at scale, contributing to Spark and Livy while shaping the next generation of data tooling.You work with a distributed team across the US and Hungary to turn prototypes into production-grade capabilities that run on thousands of nodes.You’ll deepen expertise in distributed data processing and incubate improvements across the data engineering stack.This role offers the chance to impact enterprise-scale analytics in a hybrid, multi-cloud context.Compensaciones / BeneficiosGenerous PTO PolicyFlexible WFH PolicyContinued Career DevelopmentComprehensive BenefitsPaid Volunteer TimeUnplugged DaysResponsabilidadesDesign and prototype new features for the data engineering experience, taking them through production delivery at scaleContribute to Apache Spark and Livy developmentDevelop features in Scala/Java/Python on modern platformsGain and apply distributed data processing knowledge (SQL planners/optimizers, data layouts, Parquet/Iceberg, fault tolerance)Develop deep understanding of the Cloudera Data Engineering Experience stack with a focus on Iceberg and SparkWork on large-scale distributed systems in production clusters (hundreds to thousands of nodes)Debug deployment issues, perform root-cause analysis, and conduct system test analysisImprove internal infrastructure and collaborate with team members and stakeholdersRequisitos principalesBsc/Msc in related field or equivalent experience6+ years of professional software developmentExperience leading and delivering complex product enhancementsStrong knowledge of Java/Scala/Python; able to work with at least one of these languagesExperience with distributed systems design and developmentStrong communication skills; ability to research and solve problems independentlyOpen-minded with a willingness to learn and build great productsExperience with distributed systemsstrong oral and written communicationproblem-solving independencecollaboration and teamworkJava/Scala/Python proficiencyDistributed systems design and developmentApache Spark and Livy experience

Requisitos principalesBsc/Msc in related field or equivalent experience 6+ years of professional software development Experience leading and delivering complex product enhancements Strong knowledge of Java/Scala/Python; able to work with at least one of these languages Experience with distributed systems design and development Strong communication skills; ability to research and solve problems independently Open-minded with a willingness to learn and build great products Experience with distributed systems strong oral and written communication problem-solving independence collaboration and teamwork Java/Scala/Python proficiency Distributed systems design and development Apache Spark and Livy experience