Data Engineer

Addsoft Solutions

2 days ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Languages

English

Compensation

£ 36K

Job location

Tech stack

API

Agile Methodologies

Azure

Big Data

Cloud Computing

Databases

Continuous Integration

Data as a Services

Data Governance

Data Integration

ETL

Data Warehousing

Hive

Python

Microsoft SQL Server

SQL Azure

Azure

PL-SQL

SQL Databases

T-SQL

Azure

Snowflake

Spark

GIT

Build Management

Data Lake

Kafka

Data Management

Azure

Software Version Control

Data Pipelines

Docker

Databricks

Job description

Design and build scalable data pipelines using Azure Data Factory, Databricks, Synapse Analytics, and Azure Data Lake
Migrate on-premises ETL processes to Azure Cloud with minimal downtime and high data accuracy
Develop and optimise data architectures using Delta Lake, SQL, and Apache Spark
Implement ETL workflows and ingest data from databases, APIs, and external systems
Build and maintain data models in Azure SQL Database, MSSQL, Snowflake, and Hive
Implement CI/CD pipelines with Azure DevOps and manage source control using Git
Apply data governance and security controls, including role-based and fine-grained access using Unity Catalog
Collaborate with cross-functional teams in an Agile environment

Requirements

Do you have experience in Unity?, We are looking for a skilled Data Engineer with experience in building and optimising scalable data platforms on Microsoft Azure. This role focuses on designing reliable data pipelines, supporting analytics initiatives, and enabling secure, data-driven decision-making across the organisation., * Strong experience with Azure data services (ADF, Databricks, Synapse, ADLS Gen2)