Senior Data Engineer

Clearwater People Solutions Ltd

Guildford, UK

1 day ago

Apply on www.reed.co.uk

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Compensation

£50,000.0 - £60,000.0

Working hours

Regular working hours

Job source

www.reed.co.uk

Tech stack

Query Performance Artificial Intelligence Amazon Web Services Microsoft Azure Data Architecture Information Engineering Data Infrastructure Extract Transform Load (ETL) Data Warehousing DevOps Python (Programming Language) Microsoft SQL Server

+23 more

Oracle Databases Oracle (Applications) Performance Tuning Software Tools Cloud Services SAP NetWeaver Data Management PL-SQL SQL Databases SQL Server Integration Services Transact-SQL Cloud Platform System Azure Data Factory Snowflake Apache Spark Git Microsoft Fabric Data Lakes Data Analytics Performance Monitor Data Management Azure Synapse Analytics Software Version Control Data Pipelines

Job description

Our client is currently recruiting for a Senior Data Engineer to join their team. The Senior Data Engineer will be responsible for designing, developing, and maintaining both legacy and modern cloud-based data platforms and pipelines that enable efficient data collection, processing, and analysis., * Design, implement, and maintain robust ETL/ELT pipelines to ingest and transform data from diverse internal and external sources. Ensure pipelines are scalable, performant, and reliable, including monitoring overnight loads, resolving failures promptly, and implementing automated alerts to maintain timely data availability

Contribute to the design, build, and optimisation of data architectures, models, warehouses, and data lake solutions that support reporting, analytics, and AI initiatives. Ensure solutions meet performance, scalability, and reliability standards across legacy and modern cloud platforms.
Monitor and tune system, pipeline, and query performance. Continuously refine pipelines to enhance efficiency, reduce processing times, and drive improvements in scalability, maintainability, and cost-effectiveness.
Leverage and maintain modern data engineering tools and frameworks (e.g., Azure Data Factory, Synapse, Microsoft Fabric, Spark, Python). Evaluate and recommend emerging technologies that align with organisational strategy and enhance data capabilities.
Maintain legacy data warehouses and pipelines (e.g. Oracle, SQL Server, SSIS, SAP Data Services) until replacement by a modern data platform and tooling.

Requirements

Significant experience in data engineering, preferably working across both traditional and cloud-based platforms.
Proven track record in designing, implementing, and maintaining scalable data architectures and pipelines.
Experience delivering solutions in complex, data-driven organisations where security, compliance, and reliability are critical.
Proficiency in some or all relevant technologies and languages (such as Oracle DBMS/SQL Server, Python, SQL, T-SQL/PLSQL, SSIS, SAP Data Services), cloud data platforms (such as Azure, AWS, Snowflake), and data tools (such as Azure Data Factory, Fabric Data Factory, Synapse, Fabric, Spark, Notebooks), source control (Git) and the DevOps methodology.
Ability to design, maintain, and optimise scalable ETL/ELT pipelines.
Ability to troubleshoot complex data issues, monitor performance, and implement automated solutions.
Strong analytical and problem-solving capabilities with an emphasis on performance tuning and scalability.