Databricks Data Engineer

Marks Sattin Ltd
London, UK
15 days ago
Apply on www.markssattin.co.uk
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
£156,000.0 - £182,000.0
Working hours
Regular working hours

Tech stack

Data Analysis Business Logic Microsoft Azure Big Data Continuous Integration Information Engineering Data Governance Extract Transform Load (ETL) Data Mapping Data Profiling Apache Hive Information Technology Audit
+16 more
Python (Programming Language) Microsoft SQL Server Performance Tuning Power BI Migration Manager SQL Stored Procedures SQL Server Integration Services Transact-SQL Cloud Platform System Git Data Lakes Pyspark Data Lineage Data Management Tools for Reporting Databricks

Job description

  • Lead the assessment and modernisation of legacy SQL Server, ETL and reporting workloads into a Databricks-based architecture.
  • Design scalable data models, Delta Lake structures and transformation pipelines supporting real estate investment data.
  • Analyse data lineage, dependencies, business logic and data quality to determine what should be migrated, redesigned or retired.
  • Build robust reconciliation, monitoring and governance controls to ensure accuracy, auditability and operational resilience.
  • Partner closely with investment, finance and technology teams to deliver a phased migration strategy aligned to business objectives., 4. Process Improvement 5. Finance Change 6. Programme Management

Finance and Accounting

  1. External Audit
  2. Qualified Finance
  3. Newly Qualified Finance
  4. Part Qualified & Transactional Finance
  5. Tax
  6. Tax – Industry
  7. Tax - Practice
  8. Treasury

Governance

  1. Compliance
  2. Internal Audit
  3. IT Audit
  4. Risk

Requirements

  • Strong experience with SQL Server, T-SQL, Databricks and Spark SQL in enterprise environments.
  • Proven track record delivering large-scale data migration or modernisation programmes.
  • Expertise in relational, dimensional and analytical data modelling, including modern lakehouse and medallion architectures.
  • Experience performing data profiling, lineage analysis, source-to-target mapping and data quality assessment.
  • Strong understanding of production-grade data platforms, performance optimisation and operational support.
  • Experience migrating SSIS, ETL pipelines, stored procedures and reporting solutions to cloud-based platforms.
  • Exposure to Azure DevOps, Git and CI/CD practices.
  • Experience with Python, PySpark, Power BI or real estate technology platforms would be advantageous.
  • Previous exposure to commercial real estate, investment management or alternative asset management environments is highly desirable.

This role will suit a senior data professional who enjoys solving complex platform challenges and influencing strategic technology decisions rather than simply maintaining existing systems. You’ll have the opportunity to shape the target-state architecture, establish best practices and leave a lasting impact on a critical transformation programme within a globally recognised investment business.

If you’re interested in helping build the next generation of real estate data capabilities, we’d love to hear from you. Please get in touch or share your CV for a confidential discussion.

About the company

Marks Sattin is partnering with a global real estate investment and asset management organisation undergoing a significant transformation of its data estate. As part of a wider modernisation programme, the business is migrating critical real estate data capabilities from legacy SQL Server environments into a modern Databricks platform, creating a more scalable, governed and future-ready foundation for analytics, reporting and investment decision-making.

This is an opportunity to play a key role in shaping the future of a business-critical data platform used across real estate equity and debt operations. Working within the Real Estate Technology team, you’ll collaborate with business, finance and technology stakeholders to modernise data models, rationalise legacy processes and establish best-practice data engineering standards that will support the organisation for years to come.

You’ll join a highly visible programme where your work will directly influence platform architecture, data governance and reporting capabilities across a complex investment environment.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.markssattin.co.uk
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

Videos

See all

Related articles

See all