Senior Spark Developer

• This role sits within the Cyber Processing & Data Science engineering team, supporting the development of data processing capabilities that underpin critical cyber security services. You will contribute to the design and delivery of highquality Sparkbased solutions that are reliable, scalable and maintainable., * Design, develop and maintain welltested Spark applications and data pipelines. Ensure solutions are robust, performant and maintainable by applying agreed engineering standards and best practices.
• Support continuous improvement through technical leadership
• Lead development tasks by contributing to design discussions, reviewing code and sharing practical knowledge. Challenge inefficient ways of working, introduce improvements where appropriate, and support other engineers by demonstrating good practice and explaining technical concepts clearly.

• As a Senior Spark Developer, you will be a hands-on engineer with strong knowledge of Apache Spark and its surrounding ecosystem. You will demonstrate technical leadership through the quality of your work, applying engineering best practices, improving how solutions are built and operated, and supporting others through collaboration and knowledge sharing. The role values curiosity, innovation and a clear focus on delivering reliable outcomes for customers.

This role requires 5 days a week onsite. Mon - Fri 37.5 hours per week. DV Security Clearance is required. Must have lived in the UK for 10+ years to obtain clearance., * Strong hands-on experience developing Apache Spark applications using Scala

• Good working knowledge of the Spark ecosystem, including Spark SQL and DataFrames
• Experience building and supporting data pipelines and ETL processes
• Solid understanding of software engineering best practice, including testing, code quality and version control
• Experience working with containerised platforms such as Docker and Kubernetes or OpenShift

Desirable Experience

• Experience with Kafka for data ingestion
• Experience with workflow or orchestration tools such as Airflow or NiFi
• Familiarity with cloud object storage (e.g. Azure Blob Storage or S3)
• Experience using monitoring and observability tools such as Prometheus, Grafana or Spark UI
• Working knowledge of Linux environments and basic scripting (e.g. Bash or Python)

Tailored benefits make a real difference. That's why we offer a comprehensive range to support your growth, wellbeing, and everyday life. You can design the package to suit you and your lifestyle. Your core benefits include:

• 10% on target annual bonus
• Access to an online private GP 24/7 for you and your immediate family
• Market-leading paid carers leave with up to 2 weeks off
• Equalised maternity, paternity, and adoption leave - 18 weeks' full pay and 8 weeks' half pay
• Discounted EE and BT products, including mobile and broadband
• Market leading Pension scheme - 5% from you and 10% from us
• Holiday purchase scheme
• You can select additional benefits, including healthcare, dental, gym memberships and more when you're ready.