Data Engineer

Bright Purple Resourcing Ltd
Bedford, UK
10 days ago
Apply on www.totaljobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours

Tech stack

Sql Server Data Tools (SSDT) .NET Framework Application Programming Interfaces (APIs) Microsoft Azure Bash Shell C Sharp (Programming Language) Cloud Storage Data Validation Data Integration Extract Transform Load (ETL) Data Mapping Data Transformation
+16 more
Data Migration Linux Python (Programming Language) SQL Azure Performance Tuning SQL Databases Systems Integration Transact-SQL Parquet Freeform SQL Claude Code AI Coding Agents Enterprise Integration Api Design Data Pipelines Legacy Systems

Job description

Bright Purple is recruiting an experienced Senior Data Engineer to join a major digital transformation programme, supporting the migration and integration of data into a new, business-critical digital platform. This is a hands-on contract opportunity requiring strong Python, SQL and Azure experience. You’ll work closely with engineering and data teams to deliver reliable data migration, transformation and integration solutions., * Develop and optimise complex SQL queries, scripts and transformation processes.

  • Build and maintain reliable data pipelines using Python and Azure SQL.
  • Identify and resolve data quality, integrity and consistency issues.
  • Implement data validation, reconciliation and error-handling processes.
  • Support system-to-system integrations, including APIs.

Requirements

  • Python and T-SQL expertise, including data transformation and performance optimisation.
  • Hands-on experience with Microsoft Azure and Azure SQL.
  • Strong understanding of ETL processes, data mapping, validation and reconciliation.
  • Experience integrating data across multiple applications and data sources
  • Knowledge of Azure DevOps, repositories and CI/CD pipelines.

Desirable Skills:

  • C# / .NET development experience.
  • Bash / Linux.
  • Azure Blob Storage, Parquet, DuckDB and bulk data loading.
  • SSDT / DACPAC.
  • Experience migrating legacy systems into modern cloud platforms.
  • Experience with containerisation and API-based integrations.
  • Familiarity with AI coding tools such as Claude Code.

This is an excellent opportunity for a technically strong Data Engineer who enjoys solving complex data challenges and delivering practical solutions without unnecessary complexity.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.totaljobs.com
Prepare application

Good distractions

Loading talks and stories from around this role…