> Markdown version of [/jobs/ext/2216470-data-engineer-500-inside-ir35-remote-6-months](https://www.wearedevelopers.com/jobs/ext/2216470-data-engineer-500-inside-ir35-remote-6-months). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - £500 (Inside IR35) - Remote - 6 months - **Company:** Stealth It - **Location:** UK (Remote available) - **Contract:** Temporary contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, Confluence, JIRA, Information Engineering, Data Integration, Data Integrity, Data Migration, Amazon DynamoDB, Python (Programming Language), Enterprise Data Management, Data Logging, Data Ingestion, Database Migration, Data Delivery, Api Gateway, Restful APIs, Amazon Simple Queue Service (SQS), Webhooks, Data Pipelines - **Published:** August 25, 2026 - **Apply:** https://www.careerboard.com/pt/en/find-jobs-in-United-Kingdom/-6FC77D7D47F7F13B02/ ## About the Role Mandatory Skills & ExperienceCore Engineering * Strong experience in Data Engineering/Data Integration. * Proven experience building integrations against source-system APIs, including: + REST APIs + Webhooks + Event streams * Strong Python development experience for data pipelines and integrations. * Experience designing and implementing event-driven ingestion architectures. * Hands-on AWS experience, particularly: + API Gateway + Lambda + EventBridge + SQS + DynamoDB * Experience implementing state management, watermarking and reconciliation patterns. * Experience identifying and recovering from data delivery gaps and integration failures. * Practical experience with data migration and backfill, ideally using AWS DMS or equivalent technologies. * Experience working with multiple source systems and onboarding new data sources into an enterprise data platform. Data Reliability * Understanding of data quality, completeness and consistency. * Experience implementing monitoring, logging and alerting for data pipelines. * Ability to design resilient integrations with appropriate retry, failure handling and recovery mechanisms. * Understanding of idempotency and reliable event processing. ## Description * Build and maintain integrations with CDS source systems using REST APIs, webhooks and event streams. * Develop event-driven ingestion pipelines using AWS API Gateway, Lambda, EventBridge and SQS. * Implement reliable state and watermark tracking using DynamoDB. * Develop reconciliation mechanisms to identify and recover from missed or failed webhook deliveries without creating unnecessary polling load on source systems. * Onboard new source systems onto the platform's standard ingestion architecture as the CDS estate expands. * Integrate with enterprise platforms such as Confluence, JIRA and other collaboration/ITSM systems where required. * Undertake data migration and backfill activities, including using technologies such as AWS Database Migration Service (DMS). * Develop and maintain Python-based integration and data pipeline components. * Work closely with Knowledge Engineers to ensure ingested data has the required quality, structure and metadata for downstream graph population and AI use cases. * Implement monitoring, logging, error handling and alerting to maintain high levels of integration reliability. * Investigate and resolve data ingestion failures and integration issues. * Contribute to the development and continuous improvement of the platform's ingestion patterns, standards and engineering practices. * Ensure solutions meet appropriate enterprise security, governance and regulatory requirements. ## Related Videos - [Improving quality with Agentic AI with Rovo Dev and Xray](https://www.wearedevelopers.com/videos/2005-improving-quality-with-agentic-ai-with-rovo-dev-and-xray) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [42 x 2 Canvases Later: Two Years, Two Minds, Many Lessons](https://www.wearedevelopers.com/videos/1458-42-x-2-canvases-later-two-years-two-minds-many-lessons) - [Beyond Webhooks: The Future of Scalable API Event Delivery](https://www.wearedevelopers.com/videos/100312-beyond-webhooks-the-future-of-scalable-api-event-delivery) - [A Founder's Journey : From Startup Chaos to Purposeful Growth](https://www.wearedevelopers.com/videos/1926-a-founder-s-journey-from-startup-chaos-to-purposeful-growth) - [Integrate your Cognitive Assistant with 3rd-party DBs and software](https://www.wearedevelopers.com/videos/249-integrate-your-cognitive-assistant-with-3rd-party-dbs-and-software) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Fullstack Developer Salary UK](https://www.wearedevelopers.com/magazine/251-fullstack-developer-salary-uk) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [The 12 Best Jobs for Software Engineers](https://www.wearedevelopers.com/magazine/401-the-12-best-jobs-for-software-engineers)