> Markdown version of [/jobs/ext/2791076-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/2791076-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer

- **Company:** Orlaroseassociates
- **Location:** Greater London, UK
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Airflow, Microsoft Azure, Big Data, Continuous Integration, Information Engineering, Data Infrastructure, Extract Transform Load (ETL), Python (Programming Language), PostgreSQL, Microsoft SQL Server, MySQL, Role-Based Access Control, Cloud Services, Management of Software Versions, Data Processing, Apache Spark, Data Lakes, Data Analytics, Data Management, Data Pipelines, Databricks
- **Published:** September 8, 2026
- **Apply:** https://www.collegerecruiter.com/job/2840673049-senior-data-engineer

## About the Role

* 5+ years' experience in data engineering
 * At least 2 years operating in a senior or lead capacity
 * Proven experience building data platforms from scratch in production environments
 * Strong experience with Azure Databricks, Spark and Python
 * Experience with MySQL, PostgreSQL and MSSQL
 * Strong experience troubleshooting complex data issues and optimising queries
 * Experience working in agile, fast-paced tech or data-driven environments
 * Experience with dbt, Airflow or similar orchestration tools
 * Experience building basic reports for proof-of-concept work, * Security-first mindset with strong ethical data handling principles
 * Comfortable operating in ambiguity and owning end-to-end delivery
 * Strong analytical and problem-solving skills
 * Collaborative team player with strong communication skills
 * Eager to stay current with emerging data technologies
 * Committed to continuous improvement

## Description

You will design, implement and secure a modern cloud-based data platform (Databricks, pipelines and governance frameworks), ensuring that data is:

 * Accurate
 * Accessible
 * Secure and compliant
 * Cost-effective at scale

This is a hands-on engineering role with architectural input, suited to someone comfortable building platforms from the ground up in production environments handling large-scale datasets., * Architect and build end-to-end data pipelines, data lakes and warehouses on Databricks (Azure environment)

 * Integrate ETL/ELT tools and cloud services to create scalable data workflows
 * Establish standardised processes for:
 + Data modelling
 + Quality assurance
 + Versioning
 + Orchestration (e.g. dbt, Airflow, Unity Catalog)

Security & Governance

 * Implement security best practices including:
 + Role-based access control (RBAC)
 + Data encryption and masking
 + Compliance with GDPR and relevant standards
 * Support governance frameworks ensuring integrity and compliance at scale

Performance & Optimisation

 * Optimise platform performance, cost-efficiency and scalability
 * Support real-time and large-scale data processing
 * Automate monitoring, alerting and recovery processes
 * Drive CI/CD adoption for data pipelines and infrastructure-as-code
 * Work closely with data scientists, analysts and business stakeholders to define data requirements and SLAs
 * Contribute to proof-of-concept reporting where required
 * Translate business needs into robust technical solutions


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [MySQL Protocol Features You Should Be Aware Of](https://www.wearedevelopers.com/videos/100267-mysql-protocol-features-you-should-be-aware-of)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)
- [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)
- [Software Engineer Salary in The UK](https://www.wearedevelopers.com/magazine/231-software-engineer-salary-in-the-uk)