> Markdown version of [/jobs/ext/105026-data-engineer](https://www.wearedevelopers.com/jobs/ext/105026-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer

- **Company:** Kp Law (previously Keller Postman)
- **Location:** Warrington, UK
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Amazon Web Services, Microsoft Azure, Business Intelligence Development, Cloud Database, Cloud Engineering, Encodings, Data Validation, Information Engineering, Data Governance, Data Infrastructure, Data Integrity, Data Transformation, Python (Programming Language), SQL Azure, Software Architecture, Power BI, Standard Sql, Transaction Data, Business Intelligence Development Studio, Apache Spark, Data Layers, Data Lakes, Data Pipelines, Key Vault, Databricks
- **Published:** May 28, 2026
- **Apply:** https://www.apply4u.co.uk/jobs/x/37609157/

## About the Role

·Proven experience as a Data Engineer working in a modern cloud data platform
·Strong hands-on experience with Databricks and Apache Spark
·Experience building and maintaining medallion (Bronze/Silver/Gold) architectures
·Experience extracting and ingesting data using APIs
·Strong SQL skills for data transformation, validation, and analysis
·Proficiency in Python (or Scala) for data engineering and automation
·Experience designing and implementing data quality checks and controls
·Strong problem solving skills with a focus on data reliability and integrity
Desirable Skills & Experience
·Experience with cloud platforms such as Azure (especially services such as ADLS, Azure SQL Server, Key Vault) or similar platform services such as AWS/GCP
·Familiarity with Delta Lake and transactional data patterns
·Experience with data orchestration tools (e.g. Databricks Workflows, MS Scheduler)
·Understanding of data modelling concepts for analytics and reporting
·Experience supporting Power BI or other BI tooling through curated data layers
·Exposure to data governance, cataloguing, or lineage tools
·Familiarity with legal industry data and metrics.
Our Values

## Description

As a Data Engineer you will be responsible for maintaining, enhancing, and evolving an existing Databricks data platform to support trusted, scalable, and high-quality data products.
Working closely with analysts, developers, and business stakeholders, you will build and extend a medallion architecture that underpins reporting, analytics, and downstream use cases. A key focus of the role will be embedding strong data quality controls and supporting clear data quality exception reporting to improve transparency, trust, and decision-making across the organisation.
Key Duties & Responsibilities Databricks Platform & Data Engineering
Maintain and optimise an existing Databricks environment, ensuring reliability, performance, and cost-effectiveness
Design, build, and enhance data pipelines using Spark and Databricks best practices
Develop scalable, reusable data engineering patterns to support multiple data domains
Monitor and troubleshoot pipeline failures, performance bottlenecks, and data issues
Medallion Architecture Development
Build and evolve Bronze, Silver and Gold layers aligned to business and analytical needs
Implement clear transformation, enrichment, and aggregation logic between layers
Design the Gold layer data models in collaboration with analysts and BI developers to meet defined analytical and reporting consumption requirements
Data Quality & Exception Reporting
Define and implement data quality rules, validations, and thresholds across the data lifecycle
Develop automated data quality checks and exception reports to highlight data issues
Proactively identify root causes of data quality incidents and implement preventative fixes
Partner with data owners and stakeholders to resolve data quality issues and improve source system practices
Data Governance, Security & Integrity
Support data governance standards including schema management, naming conventions, and metadata
Ensure appropriate data access controls and security measures are applied
Maintain data lineage and documentation to support auditability and trust

Stakeholder Collaboration
·Work closely with analysts, developers and business teams to understand data requirements
·Translate business needs into robust, maintainable data engineering solutions
·Provide guidance on data availability, structure, and appropriate usage
·Documentation & Knowledge Sharing
·Document pipelines, data models, data quality rules, and architectural decisions
·Contribute to shared standards, templates, and best practices within the Data team
·Support knowledge transfer and mentoring within the Data team

Continuous Improvement
·Continuously improve pipeline performance, reliability, and maintainability
·Identify opportunities to automate, standardize or simplify data engineering workflows
·Stay up to date with Databricks, Spark and cloud data engineering best practices
Essential Skills & Experience


## Related Videos

- [REST, GraphQL, gRPC, and more: A comparison of modern API styles](https://www.wearedevelopers.com/videos/100247-rest-graphql-grpc-and-more-a-comparison-of-modern-api-styles)
- [Best Practices for Using GitHub Secrets](https://www.wearedevelopers.com/videos/1214-best-practices-for-using-github-secrets)
- [Hacking MSSQL on Cloud. All of them. How I became sysadmin on Azure, AWS, GCP and Alibaba.](https://www.wearedevelopers.com/videos/100339-hacking-mssql-on-cloud-all-of-them-how-i-became-sysadmin-on-azure-aws-gcp-and-alibaba)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Data Analytics with Microsoft Fabric: End-to-End Use Case with Data Agents](https://www.wearedevelopers.com/videos/1547-data-analytics-with-microsoft-fabric-end-to-end-use-case-with-data-agents)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)