Senior Data Engineer

SKILLFINDER INTERNATIONAL
London, United Kingdom
4 days ago
Apply on www.careerboard.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours

Tech stack

Java (Programming Language) Agile Methodology Amazon Web Services Big Data Cloud Computing Cloud Engineering Code Review Information Engineering Data Integration Extract Transform Load (ETL) Data Systems Distributed Computing Environment
+17 more
Apache Hadoop Cloud Services Scaled Agile Framework Software Deployment Data Streaming Data Processing Cloud Platform System Data Ingestion Apache Spark SC Clearance Kubernetes Apache Flink Apache Kafka Data Management Stream Processing Data Pipelines Service Stack

Job description

We’re recruiting for a Senior Data Engineer to support a major public sector organisation delivering critical data solutions within a secure environment.

This is an opportunity to work with modern cloud-native technologies, build scalable data processing solutions and contribute to systems that support essential public services., You’ll work within an established engineering environment, developing and maintaining robust data solutions using Java and modern cloud technologies., * Design, develop and maintain scalable data pipelines and processing solutions.

  • Build reliable, high-performance applications using Java.
  • Develop and enhance data ingestion, transformation and integration processes.
  • Work with cloud-based infrastructure and services, particularly AWS.
  • Support event-driven and distributed processing architectures.
  • Apply data modelling, data quality and data life cycle management principles.
  • Collaborate with software engineers, data engineers, architects and other delivery teams.
  • Contribute to technical design, code reviews, testing and continuous improvement.
  • Deliver solutions using Agile engineering practices., * Modern technology stack involving Java, AWS, Kafka and Kubernetes.
  • Opportunity to contribute to secure, business-critical data platforms.
  • Hybrid London working arrangement.

Requirements

  • Advanced Java development experience, including hands-on delivery of production systems.
  • Strong commercial experience in Data Engineering.
  • Experience designing and developing data pipelines, ETL processes and data integration solutions.
  • Strong software engineering fundamentals and experience building scalable, maintainable applications.
  • Knowledge of data modelling, data quality and data life cycle management.
  • Experience working within Agile development teams.
  • Active UK SC security clearance.

Highly Desirable

  • AWS - experience building or supporting cloud-native data solutions.
  • Apache Kafka - experience with event streaming, messaging or Real Time data processing.
  • Kubernetes - experience with container orchestration and distributed application deployment.
  • Experience developing Java-based data processing or event-driven applications.

Additional Advantageous Experience

  • Apache Spark, Flink, Hadoop or other Big Data technologies.
  • Working with high-volume or complex enterprise datasets.
  • Experience delivering solutions within government, defence or other secure environments., If you’re an SC-cleared Senior Data Engineer with strong Java experience and exposure to modern cloud and data technologies, we’d be keen to hear from you.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerboard.com
Prepare application

Good distractions

Loading talks and stories from around this role…