Azure Data Engineer

scrumconnect ltd
Newcastle upon Tyne, UK
16 days ago
Apply on www.apply4u.co.uk
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Microsoft Azure Cloud Computing Cloud Database Continuous Integration Information Engineering Data Systems Azure Data Lake Data Storage Technologies Cloud Platform System Azure Data Factory Software Troubleshooting Infrastructure as Code (IaC)
+9 more
Gitlab Gitlab-ci Apache Kafka Terraform Stream Processing Azure Synapse Analytics Software Version Control Data Pipelines Databricks

Job description

Newcastle, United Kingdom Role Overview We are looking for a proactive and hands-on Azure Data Engineer to join our engineering team. The successful candidate will be responsible for designing, developing, and supporting scalable data solutions using Microsoft Azure. You will work closely with engineering, data, and delivery teams to build reliable data pipelines and cloud-based data platforms, while following best practices around infrastructure, automation, and source control. Key Responsibilities Design, develop, and maintain scalable Azure data solutions and pipelines . Build and manage data pipelines using Azure Data Factory (ADF) . Develop and optimise data solutions using Azure Synapse Analytics . Work with Azure Data Lake for data storage and processing. Implement and maintain cloud infrastructure using Terraform . Use GitLab for source control, version management, and CI/CD processes. Monitor, troubleshoot, and optimise data pipelines and Azure services. Ensure data solutions

Requirements

are secure, scalable, reliable, and maintainable. Collaborate with developers, data analysts, architects, and delivery teams. Proactively identify technical issues and opportunities for improvement. Contribute to automation and continuous improvement of engineering practices. Strong experience working with Microsoft Azure cloud services. Hands-on experience with Azure Data Factory (ADF) . Strong experience with Azure Synapse Analytics . Experience working with Azure Data Lake . Hands-on experience with Terraform and Infrastructure as Code (IaC). Experience using GitLab , including GitLab CI/CD. Strong data engineering and data pipeline development experience. Good understanding of cloud-based data architecture and integration. Strong troubleshooting and problem-solving skills. Proactive approach with the ability to work independently and as part of a team. Good communication and collaboration skills. Nice to Have Experience with Databricks . Experience with Apache Kafka . Experience with Kafka Connect . Knowledge of event-driven data architectures and real-time data processing. Key Technologies Diversity & Inclusion At Scrumconnect Consulting, we believe that diversity drives innovation and better outcomes. We are committed to fostering an inclusive environment where every individual is valued, respected, and supported. We welcome applications from candidates of all backgrounds and actively encourage individuals from underrepresented groups, including women, people with disabilities, and diverse communities, as well as those seeking flexible working arrangements. As a Disability Confident Level 1 employer, we are committed to providing reasonable adjustments throughout the recruitment process and during employment to ensure equal opportunities for all. #J-18808-Ljbffr

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.apply4u.co.uk
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:34 min

Essential commands for running and testing Terraform configurations

Hennie Francis ¡ LIVE

3:14 min

Testing and environment management in GitLab CI

Martin Berånek ¡ LIVE

6:08 min

Applying software engineering environments and testing to data pipelines

Matthias Niehoff Matthias Niehoff ¡ World Congress 2024

2:32 min

Overview of Terraform and Terraform Cloud features

Devlin Duldulao ¡ LIVE

2:30 min

Feature requests for future GitLab CI versions

Martin Berånek ¡ LIVE

4:21 min

Scaling operations using Azure AI Foundry tools

Maxim Salnikov Maxim Salnikov ¡ World Congress 2025

Videos

See all

Related articles

See all