Senior Data Engineer (Cloud, Data Integration & Migration)

We are seeking an experienced Senior Data Engineer to join our growing Data Services team. This is a hands-on technical role focused on designing, building, and supporting cloud-based data solutions across AWS and Azure platforms., * Design, develop and maintain scalable ETL and ELT pipelines.

• Build data integration solutions across cloud, on-premise, and third-party systems.
• Design and implement robust data migration solutions, including extraction, transformation, validation, reconciliation, and cutover activities.
• Perform data profiling, root cause analysis, and data quality assessments.
• Develop and optimise data warehouse, data lake, and lakehouse solutions.
• Produce source-to-target mappings, transformation rules, and technical documentation.
• Support data governance, security, and compliance requirements.
• Work collaboratively with stakeholders to understand requirements and deliver effective solutions.
• Troubleshoot complex data issues and implement sustainable solutions.

The successful candidate will have strong experience in data engineering, data integration, ETL/ELT development, data migration, data quality, and cloud-native analytics platforms. They will work closely with technical and business stakeholders to deliver scalable, secure, and high-quality data solutions., * Minimum 5 years’ hands-on experience in Data Engineering.

• Proven experience delivering complex Data Migration and Data Integration projects.
• Strong experience working with large and complex datasets.
• Experience working across both AWS and Microsoft Azure environments.

Databases & SQL

Strong hands-on experience with:

• PostgreSQL
• MySQL
• Microsoft SQL Server
• Oracle
• Amazon Redshift
• Amazon Athena

Excellent SQL development, optimisation, and troubleshooting skills.

AWS Technologies

Strong practical experience with:

• AWS Glue
• Amazon Athena
• Amazon Redshift
• Amazon S3
• AWS Lambda
• AWS Step Functions
• Amazon QuickSight

Microsoft Azure Technologies

Strong practical experience with:

• Microsoft Fabric
• Azure Data Factory
• Azure Synapse Analytics
• Azure Data Lake Storage
• Azure SQL

Data Engineering

Strong knowledge of:

• ETL and ELT design patterns
• Data Integration architectures
• Data Warehousing
• Data Lake and Lakehouse architectures
• Data Modelling
• Data Profiling
• Data Quality Management
• Data Validation and Reconciliation

Desirable Skills

• Python development
• PySpark
• Databricks
• Infrastructure as Code (Terraform, Bicep, CloudFormation)
• CI/CD pipeline development
• Microsoft Purview
• AWS and/or Azure Certifications
• Public Sector delivery experience

Personal Attributes

• Excellent communication and stakeholder management skills.
• Strong analytical and problem-solving capability.
• Ability to explain technical concepts to non-technical audiences.
• Self-motivated with strong attention to detail.
• Able to work independently and collaboratively within project teams.
• Strong ownership and delivery focus., * Degree in Computer Science, Data Engineering, Information Systems, or equivalent industry experience.
• Relevant AWS and/or Microsoft Azure certifications desirable.