> Markdown version of [/jobs/ext/3521669-data-engineer-newcastle](https://www.wearedevelopers.com/jobs/ext/3521669-data-engineer-newcastle). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - Newcastle - **Company:** Hackajob Ltd - **Location:** Newcastle upon Tyne, UK - **Experience:** Expert - **Salary:** £42,500.0 - £70,500.0 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, Microsoft Azure, Big Data, BigQuery, Cloud Computing, Code Review, Computer Programming, Continuous Integration, Data Architecture, Information Engineering, Extract Transform Load (ETL), Software Design Patterns, DevOps, Github, Python (Programming Language), Software Construction, Data Streaming, Cloud Platform System, Snowflake, Apache Spark, Git, Cloudformation, SC Clearance, Containerization, Kubernetes, Low Latency, Apache Flink, Apache Kafka, Terraform, Stream Processing, Data Pipelines, Docker, Jenkins, Databricks, Microservices - **Published:** September 30, 2026 - **Apply:** https://www.adzuna.co.uk/jobs/details/5902754692 ## About the Role * Strong programming proficiency in Java (preferred) or Python. * Hands-on experience with at least one of Kafka, Flink, or Spark; Flink or Kafka experience is preferred for streaming. * Solid understanding of stream processing concepts, such as event time, state, and backpressure. * Understanding of software engineering best practices, including testing, design patterns, CI/CD, and Git. * Experience building ETL/ELT or streaming data pipelines. * Exposure to microservices and distributed-system concepts. * Experience with cloud platforms; AWS is ideal, but Azure or GCP is also acceptable. * Understanding of distributed compute, large-scale data systems, and performance considerations. * Experience with CI/CD tools such as Azure DevOps, GitHub Actions, or Jenkins. * Experience with Infrastructure as Code; Terraform is preferred. * Experience with containerisation, such as Docker, and orchestration platforms such as Kubernetes or EKS. * Minimum of 3 years experience working on data engineering or large-scale data solutions. * Comfortable working in Agile delivery teams, with strong communication skills and the ability to collaborate with technical and non-technical stakeholders. * An offer of employment is subject to satisfactory BPSS and SC security clearance. This requires 5 years of continuous UK address history (typically with no periods of 30 consecutive days or more spent outside the UK) and declaration at the point of application of British or EU passport-holder status or Indefinite Leave to Remain in the UK. This information relates to a specific client requirement. * Desirable: experience in client-facing or consulting environments, professional cloud or data engineering certifications, experience mentoring or supporting junior engineers, and a background in designing or operating real-time, low-latency systems. * Cloud certifications are beneficial but not required. ## Description * Design, build, and maintain scalable data solutions that enable analytics, AI, and operational insights. * Build, optimize, and maintain scalable data pipelines, primarily using Java, with exposure to Python, Flink, Kafka, or Spark. * Develop and support real-time streaming pipelines and event-driven integrations. * Integrate data from streaming, batch, and API sources using AWS managed services such as Kinesis, MSK, Lambda, and Glue. * Contribute to data modelling, data architecture best practices, and modern patterns such as medallion architecture. * Apply data quality, lineage, governance, and security controls consistently. * Deploy and maintain data applications using CI/CD tooling such as Azure DevOps, GitHub Actions, or Jenkins. * Use Infrastructure as Code, such as Terraform or CloudFormation, to manage cloud environments. * Work with container technologies such as Docker and Kubernetes-based workloads. * Collaborate with client and internal teams, including analytics, ML/AI, and product teams, to deliver clean, well-structured datasets and robust data pipelines. * Participate in code reviews and internal knowledge-sharing sessions. * Provide guidance to junior engineers where needed. Technologies: * AI * API * AWS * Lambda * Azure * CI/CD * Cloud * DevOps * Docker * ETL * Flink * GCP * Git * GitHub * Support * Java * Jenkins * Kafka * Kubernetes * Network * Python * Security * Spark * Terraform * microservices * BigQuery * Databricks * Snowflake