Data Engineer

Catalyst
Newcastle upon Tyne, UK
4 days ago
Apply on www.adzuna.co.uk
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
£66,000.0 - £106,000.0
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Airflow Amazon Web Services Data Analysis Microsoft Azure Big Data Cloud Computing Cloud Engineering Continuous Integration Information Engineering Data Integrity
+18 more
DevOps Distributed Systems Python (Programming Language) Performance Tuning Software Architecture Standard Sql SQL Databases Workflow Management Systems Google Cloud Apache Spark Backend Kubernetes Operational Systems Data Management Terraform Software Version Control Data Pipelines Databricks

Job description

  • We design, build, and maintain scalable data-intensive systems, pipelines, and platforms that power analytics, operational systems, and AI-driven products.
  • We develop and maintain production-grade applications and APIs.
  • We develop reusable, well-tested code following engineering best practices.
  • We participate in architecture and technical design discussions.
  • We write automated unit, integration, and end-to-end tests.
  • We design and develop sophisticated data pipelines that import data from internal and external sources into data platforms.
  • We ensure systems are well maintained to enable uninterrupted access to critical data.
  • We continuously verify data quality and integrity to support decision making.
  • We collaborate with internal and external stakeholders to improve data accessibility and usability.
  • We drive innovation by adopting advanced analytics technologies and methodologies.
  • We deploy cloud-native solutions using Infrastructure as Code and collaborate on cloud architecture and optimisation.

Technologies:

  • AI
  • Airflow
  • AWS
  • Azure
  • Backend
  • CI/CD
  • Cloud
  • Databricks
  • DevOps
  • GCP
  • Support
  • Kubernetes
  • Python
  • SQL
  • Spark
  • Terraform

Requirements

  • We require a 2:1 or 1st class degree in a relevant subject such as Computing Science, Maths, or Physics from a leading university.
  • We require demonstrable experience working as a Data Engineering professional.
  • We would strongly value experience in the Financial Services sector.
  • We require strong proficiency in Python and SQL, with the ability to write clean, performant code for large data volumes.
  • We require experience designing and building data-intensive applications and pipelines.
  • We require experience with complex data matching, reconciliation, and entity resolution across multiple data sources.
  • We require familiarity with distributed computing tools such as Spark and Databricks.
  • We require experience with cloud platforms including AWS, Azure, and GCP.
  • We require experience with orchestration tools such as Airflow.
  • We require knowledge of modern DevOps practices, including version control, CI/CD, and infrastructure as code using Terraform or Kubernetes.
  • We require experience building scalable backend applications.
  • We require understanding of distributed systems and software architecture.
  • We require the ability to test and troubleshoot data products, with a track record of improving data reliability and quality.
  • We require excellent communication skills and the ability to work effectively within a team-based environment.
  • We require a self-motivated, detail-oriented approach and a willingness to learn new technologies and methodologies.

About the company

We are recruiting on behalf of our prestigious client, a newly created JV Technology Consulting business formed by global leaders in management consulting and investment fund management. Based in Newcastle upon Tyne, we offer enviable facilities and are expanding rapidly to meet client demand and support continued strong performance. This is an excellent opportunity to join our elite Tyneside team at a key stage of our growth, working alongside exceptional, collaborative, and passionate people.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.adzuna.co.uk
Prepare application

Good distractions

Loading talks and stories from around this role…