Lead AWS Data Engineer (inside IR35)

IT Human Resources
London, United Kingdom
1 day ago
Apply on www.careerboard.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours

Tech stack

Unity 3d Amazon Web Services Amazon S3 Data Analysis D3.Js Data Architecture Information Engineering Data Governance Extract Transform Load (ETL) Data Vault Modeling Apache Hive Identity and Access Management
+21 more
Python (Programming Language) Performance Tuning Power BI Cloud Services Tableau (Software) Highcharts Sql Optimization ReactJS Cloudformation Data Lakes Pyspark Kubernetes Qlikview Star Schema AWS Data Analytics Data Management Tools for Reporting Terraform Data Pipelines Docker Databricks

Job description

We are seeking a Lead/Principal Data & Visualisation Engineer to take ownership of my client’s enterprise data platform strategy, architecture, and analytics capability. This is a senior leadership role where you will shape the future of our cloud data ecosystem, drive engineering best practices, and deliver business-critical insights through modern data and visualisation technologies.

Remit

  • Lead the architecture and roadmap for enterprise-scale data engineering and analytics platforms.
  • Design and optimise Databricks lakehouse solutions and high-volume ETL/ELT pipelines.
  • Build scalable, secure cloud-native data platforms using AWS services.
  • Drive best practices across data governance, security, quality, performance, and cost optimisation.
  • Define enterprise reporting standards and analytics frameworks.
  • Architect executive dashboards and interactive data visualisation solutions.
  • Provide technical leadership, mentorship, and architectural guidance to engineering teams.
  • Partner with senior stakeholders to translate business objectives into scalable technical solutions.
  • Influence strategic technology decisions across data, analytics, and visualisation platforms.

Requirements

  • 12+ years’ experience within Data Engineering, Data Architecture, or Analytics Engineering.
  • Expert knowledge of Databricks, PySpark, Spark SQL, Delta Lake, and Unity Catalog.
  • Strong AWS experience including S3, Redshift, Glue, EMR, Lambda, and IAM.
  • Proven experience building and optimising large-scale cloud data platforms.
  • Strong data modelling expertise including Star Schema, Snowflake Schema, and Data Vault.
  • Advanced SQL and Python development skills.
  • Experience delivering enterprise BI and reporting solutions using Power BI, Tableau, or Qlik.
  • Strong understanding of data governance, security, and performance optimisation.
  • Previous experience leading technical teams and mentoring engineers.

Desirable Skills

  • React.js development experience.
  • Experience with D3.js, Recharts, Chart.js or similar visualisation libraries.
  • Scala development experience.
  • Infrastructure as Code using Terraform or CloudFormation.
  • Docker, Kubernetes, and CI/CD automation experience.
  • Experience working within Agile/Scrum environments.

What we are seeking

  • A strategic technical leader who can balance architecture, hands-on engineering, and stakeholder engagement.
  • Strong communication skills with the ability to engage both technical and non-technical audiences.
  • Proven experience delivering enterprise-scale data and analytics solutions.
  • Someone passionate about engineering excellence, innovation, and building high-performing teams.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerboard.com
Prepare application

Good distractions

Loading talks and stories from around this role…