Big Data Engineer

Descripción de la vacante Location: Remote from SpainEmployment Type: Full-Time ContractorAbout the ProjectJoin the Media Products Analytics Engineering division focused on building platforms and tools to manage and process terabytes of data for both internal and external stakeholders. Our team is responsible for developing robust data infrastructure and high-performance pipelines that power critical media analytics and projection datasets.About the RoleWe’re looking for a Senior Big Data Engineer who can work independently and proactively to design, implement, and maintain scalable data processing pipelines. You will contribute to a high-performing team that owns infrastructure critical to analytics, modeling, and media performance reporting.Essential functionsDesign and develop large-scale data pipelines and infrastructure to process high-volume datasetsBuild and maintain scalable, production-grade ETL/ELT workflows using Apache Spark , Scala , and SQLWork with distributed file systems ( HDFS ) and optimize data processing performanceWrite and test reusable and reliable code using functional programming libraries like Cats and fs2Develop and test solutions in containerized environments (e.g., Docker , Kubernetes )Collaborate with analysts, platform teams, and product stakeholders to deliver data-driven solutionsTake ownership of services with minimal supervision, demonstrating initiative and autonomyQualificationsStrong programming experience with Scala and distributed data frameworks like Apache SparkProficiency in SQL and experience handling large datasets in HDFS environmentsWorking knowledge of Python for scripting and data manipulation tasksHands-on experience developing and testing in Docker and/or Kubernetes environmentsFamiliarity with Cats , fs2 , or other advanced Scala functional programming librariesAbility to work autonomously in a dynamic, fast-paced environment and take full ownership of projectsWe offerOpportunity to work on bleeding-edge