Spark Developer

• Develop and maintain data pipelines using Apache Spark (batch and streaming).
• Design, implement, and optimise large-scale distributed data processing systems.
• Write efficient, clean, and maintainable code in Scala, Python, or Java.
• Collaborate with data engineers, analysts, and business stakeholders to deliver data solutions.
• Monitor and troubleshoot data pipelines, ensuring high availability and performance.
• Work with cloud-based data platforms (AWS, Azure, GCP) to manage and process data.
• Apply data governance, security, and compliance best practices.
• Document processes, technical designs, and workflows.
• Participate in code reviews and follow best practices in software engineering.

Do you have experience in Spark?, * Must have the right to work in the UK. No sponsorship provided.

• Experience with Apache Spark (0-12 years, from learning-level to advanced).
• Programming experience in Scala, Python, or Java.
• Understanding of distributed data processing concepts.
• Familiarity with cloud platforms (AWS, Azure, GCP).
• Knowledge of data storage systems (HDFS, S3, data lakes, relational and NoSQL databases).
• Strong problem-solving and analytical skills.
• Good communication skills and ability to work independently in a remote environment.