Data Engineer

I’m recruiting for an experienced, hands-on Data Engineer to join an established UK retailer on a six-month fixed-term contract, supporting key data platform migrations and improvements.

This is a delivery-focused opportunity where you’ll help migrate existing pipelines, optimise ETL processes and improve data ingestion from Microsoft Dynamics 365 Business Central.

Reporting to the Lead Data Engineer, you’ll work closely with the wider Data Engineering, Business Intelligence and IT teams to deliver several priorities across the organisation’s data roadmap.

What you’ll be doing

• Supporting the migration to Matillion Maia, moving existing pipelines onto the platform and validating outputs to maintain data accuracy and business continuity, with a target completion date of March 2027.
• Reviewing and optimising Matillion and Snowflake ETL flows, improving performance, reducing running costs and making pipelines easier to maintain.
• Improving Business Central data ingestion, reducing load on the source system ahead of an ERP upgrade and taking ownership of delivery where required.
• Documenting and handing over your work, ensuring the permanent team can confidently support and maintain the platform.

• Hands-on experience with Matillion ETL, ideally including Matillion Maia.
• A proven track record of delivering data pipeline migrations while maintaining data integrity and continuity.
• Strong Snowflake expertise, including performance tuning and cost optimisation through query profiling, warehouse sizing and clustering.
• Advanced SQL skills, with experience reviewing, testing and improving complex transformation logic.
• Experience building robust ETL/ELT pipelines, including incremental loading, source-to-target reconciliation and error handling.
• Confidence building and maintaining API integrations, including authentication, pagination and rate limits.
• Clear documentation and a focus on maintainable, well-structured solutions.

Useful additional experience

• Microsoft Dynamics 365 Business Central or other ERP data sources.
• Python for data engineering tasks.
• Experience within retail.

If you’re a hands-on Data Engineer with strong Matillion and Snowflake experience and enjoy delivering platform improvements, please apply or get in touch to find out more.

Data Engineer - Six-Month Fixed-Term Contract - Fully Remote - £400 Per day Outside IR35