Senior Data Engineer

Cushman & Wakefield
London, UK
25 days ago
Apply on www.adzuna.co.uk
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
6 years minimum
Compensation
£80,095.0
Working hours
Regular working hours

Tech stack

Geographic Information Systems Artificial Intelligence Microsoft Azure Code Review Continuous Integration Information Engineering Data Systems Geocoding JSON Python (Programming Language) Query Optimization SQL Databases
+10 more
Parquet Data Ingestion Sql Optimization Multi-Agent Systems Apache Spark Data Lakes Pyspark Git Flow Information Technology Databricks

Job description

This is a hands-on senior role on key transformation projects across EMEA and APAC. You will work directly with the team lead and a group of analytical engineers who push each other to stay at the frontier of what is possible., What you will work on

  • Driving the shift from a code writing team to an AI orchestration team. This means building agentic workflows that handle data engineering tasks and CI/CD, designing semantic models for downstream consumption, and implementing an AI Gateway for governance.

  • Stewarding our AI amplified Databricks based framework, maintaining it and improving it incrementally as we learn.

  • Designing data models that bring sources from anywhere in the world into a single coherent shape.

  • Building data solutions for domains like custom MDM, geocoding, client mastering, and profiling. Real estate context is a plus but not .

  • Designing and implementing stable, automated ingestion pipelines from diverse sources.

  • Owning production troubleshooting and root cause analysis. When things go wrong, you diagnose and resolve pipeline failures, performance issues, and data quality problems by working through code, logs, and documentation systematically.

  • Reporting on data quality and shipping the improvements that move the numbers.

Requirements

  • Systems thinking. You see the bigger picture and build for scale rather than for the ticket in front of you.

  • Production troubleshooting and root cause analysis. You diagnose and resolve pipeline failures, performance issues, and data quality problems under pressure, working through code, logs, and documentation systematically rather than guessing.

  • Data modeling. You design cross functional data products, establish data contracts, and handle complex business rules.

  • Advanced SQL, including window functions, query optimization, and MERGE/UPSERT operations.

  • Python and PySpark. You write reusable, parameterized functions and work comfortably with JSON, CSV, and Parquet.

Platform knowledge

  • Deep experience with Databricks (Declarative Pipelines, DABS, Delta Lake, Spark optimization, job orchestration).

  • Familiarity with the Azure ecosystem.

  • Working understanding of Unity Catalog.

About you

  • Around 6 or more years of relevant experience.

  • A degree in a quantitatively rigorous field such as computer science, data science, econometrics, mathematics, or physics.

  • Driven and curious. You want to work on things that have not been figured out yet.

  • Strong written communication. Async updates and clear documentation are part of the job.

Nice to have

  • Experience with agentic data engineering, using coding agents in real delivery and building the harness around them: repo conventions, reusable context, tests and guardrails that make agent output trustworthy.

  • Geospatial data processing (H3 indexes, spatial SQL, point in polygon at scale).

  • Recursive CTEs and complex SQL patterns.

  • Infrastructure familiarity (Azure Portal, resource management, CLI).

  • Strong Git workflows and code review habits.

  • Real estate domain experience.

What we offer

  • Autonomy. We set the high level roadmap. You decide how to get there.

  • Dedicated learning time and a team that levels each other up. The frontier moves weekly. We give you the time to keep up with it, and you will be surrounded by people doing the same.

  • A rare growth path. You will build leading capability in a field where very few organisations in our sector have yet begun, giving you a skill set you could not have assembled elsewhere in this industry.

  • A solid technical foundation. The architecture, standards, and best practices are already in place. You build on top, not from scratch.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.adzuna.co.uk
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:47 min

Exploring JSON, CBOR, and JOSE for data serialization

Aaron Russell · LIVE

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:50 min

How Parquet metadata enables efficient data reading

Matthias Niehoff Matthias Niehoff · World Congress 2026 Europe

4:36 min

Hiring passionate software engineers to tackle unprecedented scaling challenges

Dana Lawson Dana Lawson +1 · World Congress 2026 Europe

2:03 min

Distinguishing type definition constructs from data validation routines

Clemens Vasters Clemens Vasters · World Congress 2025

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

Videos

See all

Related articles

See all