Senior Apache Spark Developer
Role details
Job location
Tech stack
Job description
Join to apply for the Senior Apache Spark Developer role at BairesDev At BairesDev®, we've been leading technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse team of more than 4,000 top 1 % tech talent drives significant global impact. Senior Apache Spark Developer at BairesDev We are seeking a Senior Apache Spark Developer to work on distributed data processing systems and real-time analytics. You'll contribute to Apache Spark and related ecosystem projects (Kafka, Hive, Iceberg), focusing on performance optimization and scalable architecture. What You'll Do: * Contribute actively to Apache Spark and related open-source projects as a core contributor. * Develop and optimize distributed data processing engines for batch and real-time analytical workloads. * Develop streaming analytics capabilities using Spark Structured Streaming and integration with Apache Kafka. * Enhance Spark
Requirements
SQL catalyst optimizer and distributed query execution systems. * Collaborate with engineering teams on system integration and deployment. What We Are Looking For: * 10+ years of experience in software development. * Strong expertise in distributed computing and large-scale data processing systems. * Understanding of Apache Spark architecture, including RDDs, DataFrames, and streaming. * Proficiency in Scala, Java, and Python (primary Spark development languages). * Experience in tuning of distributed systems at scale. * Core contributions to Apache open-source projects (Spark, Kafka, Hive, or similar). * Advanced level of English. How We Make Your Work (and Your Life) Easier: * Excellent compensation in USD or your local currency if preferred. * Paid parental leave, vacation, and national holidays. * Innovative and multicultural work environment. * Collaborate and learn from the global top 1 % of talent in each area. * Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities. Referrals increase your chances of interviewing at BairesDev by 2x. Apply now! Seniority level * Mid-Senior level Employment type * Full-time Job function * Information Technology Industries * IT Services and IT Consulting #J-18808-Ljbffr