> Markdown version of [/jobs/ext/4762954-lead-aws-data-engineer-inside-ir35](https://www.wearedevelopers.com/jobs/ext/4762954-lead-aws-data-engineer-inside-ir35). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead AWS Data Engineer (inside IR35) - **Company:** IT Human Resources - **Location:** London, United Kingdom - **Experience:** Expert - **Contract:** Temporary contract - **Skills:** Unity 3d, Amazon Web Services, Amazon S3, Data Analysis, D3.Js, Data Architecture, Information Engineering, Data Governance, Extract Transform Load (ETL), Data Vault Modeling, Apache Hive, Identity and Access Management, Python (Programming Language), Performance Tuning, Power BI, Cloud Services, Tableau (Software), Highcharts, Sql Optimization, ReactJS, Cloudformation, Data Lakes, Pyspark, Kubernetes, Qlikview, Star Schema, AWS Data Analytics, Data Management, Tools for Reporting, Terraform, Data Pipelines, Docker, Databricks - **Published:** November 18, 2026 - **Apply:** https://www.careerboard.com/gb/en/find-jobs-in-United-Kingdom/-E0DF8CA1FF9A4F7549/ ## About the Role * 12+ years' experience within Data Engineering, Data Architecture, or Analytics Engineering. * Expert knowledge of Databricks, PySpark, Spark SQL, Delta Lake, and Unity Catalog. * Strong AWS experience including S3, Redshift, Glue, EMR, Lambda, and IAM. * Proven experience building and optimising large-scale cloud data platforms. * Strong data modelling expertise including Star Schema, Snowflake Schema, and Data Vault. * Advanced SQL and Python development skills. * Experience delivering enterprise BI and reporting solutions using Power BI, Tableau, or Qlik. * Strong understanding of data governance, security, and performance optimisation. * Previous experience leading technical teams and mentoring engineers. Desirable Skills * React.js development experience. * Experience with D3.js, Recharts, Chart.js or similar visualisation libraries. * Scala development experience. * Infrastructure as Code using Terraform or CloudFormation. * Docker, Kubernetes, and CI/CD automation experience. * Experience working within Agile/Scrum environments. What we are seeking * A strategic technical leader who can balance architecture, hands-on engineering, and stakeholder engagement. * Strong communication skills with the ability to engage both technical and non-technical audiences. * Proven experience delivering enterprise-scale data and analytics solutions. * Someone passionate about engineering excellence, innovation, and building high-performing teams. ## Description We are seeking a Lead/Principal Data & Visualisation Engineer to take ownership of my client's enterprise data platform strategy, architecture, and analytics capability. This is a senior leadership role where you will shape the future of our cloud data ecosystem, drive engineering best practices, and deliver business-critical insights through modern data and visualisation technologies. Remit * Lead the architecture and roadmap for enterprise-scale data engineering and analytics platforms. * Design and optimise Databricks lakehouse solutions and high-volume ETL/ELT pipelines. * Build scalable, secure cloud-native data platforms using AWS services. * Drive best practices across data governance, security, quality, performance, and cost optimisation. * Define enterprise reporting standards and analytics frameworks. * Architect executive dashboards and interactive data visualisation solutions. * Provide technical leadership, mentorship, and architectural guidance to engineering teams. * Partner with senior stakeholders to translate business objectives into scalable technical solutions. * Influence strategic technology decisions across data, analytics, and visualisation platforms.