Data Engineer - Contract - Migration Programme

The AgileSource LLC
United States
2 months ago
Apply on computerjobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours

Tech stack

HTML Amazon Web Services Microsoft Azure Data Validation Information Engineering Data Governance Extract Transform Load (ETL) Data Migration Digital Assets Python (Programming Language) Cloud Services SQL Databases
+5 more
Cloud Platform System Apache Spark Semi-structured Data Data Pipelines Legacy Systems

Job description

  • Lead the design and execution of data migration strategies from Legacy systems
  • Assess digital assets to determine archiving vs. cloud migration pathways
  • Support migration of selected datasets to the Analytical Cloud platform
  • Ensure compliance with data governance, security, and archival standards (eg National Archives requirements)
  • Develop and maintain data pipelines and transformation logic
  • Perform data validation, quality checks, and integrity assurance throughout migration
  • Collaborate with Business Analysts, PMO, and wider stakeholders to align delivery with programme objectives
  • Identify and mitigate data risks, dependencies, and technical challenges
  • Produce clear technical documentation and handover materials

Requirements

  • Strong experience in data engineering and migration projects, ideally within public sector or regulated environments
  • Proven ability to work with Legacy systems and modern cloud platforms
  • Experience designing and implementing ETL/ELT pipelines
  • Familiarity with cloud data platforms (eg Azure, AWS, or GCP - preferably Azure Analytical Services)
  • Knowledge of data governance, archiving standards, and compliance frameworks
  • Strong skills in data modelling, transformation, and optimisation
  • Proficiency in relevant tools/languages (eg Python, SQL, Spark, or equivalent)
  • Experience handling unstructured and semi-structured data formats (HTML, PDFs, documents)
  • Excellent problem-solving and stakeholder communication skills

About the company

AgileSource is seeking an experienced Senior Data Engineer to support a large-scale digital transformation programme within a government environment.

The successful candidate will play a key role in assessing, migrating, and archiving approximately 1,000 digital assets (HTML pages, PDFs, and slide decks) from Legacy hosting platforms to modern infrastructure, including cloud-based analytical systems and long-term archival storage.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on computerjobs.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:21 min

Projecting external HTML content using default and named slots

Rowdy Rabouw Rowdy Rabouw · World Congress 2022

2:34 min

Capabilities of the Apache Spark processing engine

Ayon Roy · LIVE

1:14 min

Evolution of distributed SQL database architectures

Wei Hu Wei Hu · World Congress 2024

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

6:12 min

Streaming HTML content natively using declarative processing instructions

Chris Heilmann +2 · LIVE

4:36 min

Hiring passionate software engineers to tackle unprecedented scaling challenges

Dana Lawson Dana Lawson +1 · World Congress 2026 Europe

Videos

See all

Related articles

See all