Data Engineer

Gattaca Plc

Bristol, UK

5 days ago

Apply on www.adzuna.co.uk

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Compensation

£50,000.0 - £56,000.0

Working hours

Regular working hours

Job source

www.adzuna.co.uk

Tech stack

Microsoft Azure Big Data Cloud Engineering Continuous Integration Data as a Services Data Dictionary Information Engineering Data Governance Data Infrastructure Data Integration Extract Transform Load (ETL) Data Security

+27 more

Data Warehousing Database Development Database Schema Dimensional Modeling Distributed Systems Github Python (Programming Language) Meta-Data Management Microsoft SQL Server SQL Azure Performance Tuning Azure Data Lake Scala (Programming Language) SQL Databases Data Processing Azure Data Factory Apache Spark Microsoft Fabric Data Lakes Pyspark Information Technology Deployment Automation Data Analytics Enterprise Integration Azure Synapse Analytics Data Pipelines Databricks

Job description

Our client, a leading organisation within the technology sector, is seeking a Data Engineer to join its team on a permanent basis. The role will focus on designing and maintaining scalable Azure data platforms, developing robust data pipelines and supporting data-driven solutions across the business., * Design, develop and maintain scalable data pipelines and integration solutions using Azure.

Build and optimise ETL and ELT processes with Azure Data Factory, Databricks and Synapse Analytics.
Manage and enhance data lakes, data warehouses and storage solutions, including Azure Data Lake Storage.
Develop and optimise SQL queries, data models and database objects for performance and scalability.
Ensure data quality, security, governance and compliance with organisational standards.
Implement CI/CD practices and support deployment automation through Azure DevOps or GitHub.
Monitor, troubleshoot and resolve data platform and pipeline issues.
Collaborate with stakeholders, analysts and developers while maintaining technical documentation, data dictionaries and operational procedures.

Requirements

Experience in Data Engineering, database development or data integration, with hands-on knowledge of Microsoft Azure data services.
Strong experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics and Azure Data Lake Storage.
Advanced SQL development and performance tuning skills, including experience with Azure SQL Database and SQL Server.
Proficiency in Python, PySpark, Scala and Spark for data processing and distributed computing.
Understanding of data warehousing concepts, dimensional modelling and ETL/ELT frameworks.
Knowledge of data quality, data governance, metadata management and data security principles.
Experience with CI/CD pipelines using Azure DevOps or GitHub, along with an understanding of cloud architecture.
A bachelor’s degree in Computer Science, Information Technology, Data Engineering or a related discipline; Microsoft Azure certifications such as DP-203 or AZ-900 would be advantageous.

Desirable Skills:

Experience with Microsoft Fabric and Azure Database services.
Knowledge of big data technologies, streaming solutions and modern data architecture patterns.
Relevant Microsoft certification, such as Azure Data Engineer Associate, Azure Fundamentals or Azure Database Administrator Associate.

Benefits & conditions

Permanent opportunity within a forward-thinking technology environment.
Access to professional development and Microsoft Azure training opportunities.
Opportunity to work with modern cloud data platforms and large-scale data solutions.
Collaborative working environment with opportunities to contribute to continuous improvement initiatives.