> Markdown version of [/jobs/ext/3036736-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/3036736-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Data Engineer - **Company:** SCRM CONSULTING INC - **Location:** United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Legacy Database, Java (Programming Language), Computing Platforms, Microsoft Azure, Big Data, Databases, Data Validation, Information Engineering, Data Governance, Data Infrastructure, Extract Transform Load (ETL), Data Mapping, Data Transformation, Data Migration, Data Mining, Data Structures, Relational Databases, Database Design, Database Storage Structures, PostgreSQL, SQL Azure, Operational Databases, Performance Tuning, Software Engineering, Technical Data Management Systems, Azure Data Factory, Sql Optimization, Data Lakes, Legacy Systems - **Published:** September 23, 2026 - **Apply:** https://computerjobs.com/us/en/mob/job/E9DED4592DFA12003E ## About the Role * Extensive experience as a Senior/Lead Data Engineer with a strong focus on data migration. * Proven experience designing and delivering complex data migration solutions. * Strong hands-on experience with ETL development and implementation. * Strong experience working with Azure PostgreSQL. * Excellent knowledge of relational databases and SQL. * Strong experience in logical and physical data modelling. * Experience designing database structures for operational and reporting requirements. * Strong understanding of data quality, validation, reconciliation and governance. * Experience migrating large or complex datasets between platforms. * Experience designing staging and production data environments. * Strong understanding of data transformation and mapping. * Experience supporting reporting and analytics through well-designed data structures. * Ability to provide technical leadership across data migration workstreams. * Strong stakeholder management and communication skills. * Experience identifying and managing data migration risks and dependencies. Azure/Data Platform Experience, * Experience working on large-scale government/public-sector data migration programmes. * Experience migrating data from Legacy platforms. * Experience working with Actian or similar Legacy database technologies. * Experience with complex operational reporting environments. * Experience working in Agile delivery teams. * Experience with automated data validation and reconciliation. * Azure certifications or relevant data engineering certifications. Ideal Candidate Profile The ideal candidate will be a Lead/Senior Data Engineer or Database/Data Migration specialist who has hands-on experience taking ownership of complex data migration programmes, particularly where ETL processes, Azure PostgreSQL, data modelling, data quality and reporting are key components. ## Description We are looking for Lead Data Engineer to join a dedicated Data Migration Squad supporting the migration of CRS data and reporting capabilities to a new platform. The role requires strong specialist expertise in data migration, data modelling, ETL, database design, and Azure PostgreSQL. You will take technical ownership of designing and delivering the end-to-end data migration capability, ensuring data is migrated accurately, securely, and within critical programme timelines. This is a senior data engineering and database-focused role and does not require Java or application development expertise., * Design and deliver the end-to-end data migration strategy for CRS. * Develop and implement ETL processes to Azure PostgreSQL to support data migration and future operational requirements. * Design and maintain logical and physical data models for the target platform. * Establish the data migration capability as the new platform becomes available. * Define and implement approaches for moving CRS data into staging and production database environments. * Develop robust processes for data extraction, transformation and loading. * Ensure data quality, validation, reconciliation and governance throughout the migration life cycle. * Support the migration and transformation of data required for 140+ operational reports. * Work closely with business and technical stakeholders to understand reporting requirements. * Ensure target data structures support both current and future reporting requirements. * Provide technical leadership and oversight across data migration and data modelling activities. * Identify, assess and mitigate data migration risks. * Troubleshoot complex data and database issues during migration. * Ensure migration activities are delivered within agreed programme timescales. * Establish repeatable and maintainable migration processes for ongoing operational use., Strong experience with relevant Azure data platform technologies, particularly: * Azure PostgreSQL * Azure Data Factory/ETL tooling * Azure Storage/Data Lake * Azure database services * Azure data integration and migration capabilities * Azure monitoring and operational tooling Data Engineering & Database Skills * Advanced SQL * ETL/ELT * Data migration * Data modelling * Database design * Data transformation * Data mapping * Data validation * Data reconciliation * Data quality * Data governance * Performance optimisation * Reporting data structures * Relational database technologies Reporting Experience The role will support the migration and transformation of data required for 140+ operational reports., * Understanding reporting data requirements. * Designing data structures to support operational reporting. * Data transformation for reporting purposes. * Data validation and reconciliation between source and target systems. * Supporting reporting teams and business stakeholders. * Optimising data structures for reporting performance. Technical Leadership The successful candidate will be expected to: * Take ownership of the technical data migration approach. * Provide guidance on data modelling and database design. * Review migration and ETL solutions. * Identify technical risks and dependencies. * Work collaboratively with technical architects, developers, reporting teams and business stakeholders. * Establish good engineering and data migration practices within the squad. ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Hacking MSSQL on Cloud. All of them. How I became sysadmin on Azure, AWS, GCP and Alibaba.](https://www.wearedevelopers.com/videos/100339-hacking-mssql-on-cloud-all-of-them-how-i-became-sysadmin-on-azure-aws-gcp-and-alibaba) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Kubernetes and Microservices with Multi-Model Databases](https://www.wearedevelopers.com/videos/382-kubernetes-and-microservices-with-multi-model-databases) - [Automated MS SQL Server database deployments with dacpacs and Azure DevOps](https://www.wearedevelopers.com/videos/334-automated-ms-sql-server-database-deployments-with-dacpacs-and-azure-devops) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [What’s the Difference between a Junior, Mid, and Senior Developer?](https://www.wearedevelopers.com/magazine/238-what-s-the-difference-between-a-junior-mid-and-senior-developer) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)