> Markdown version of [/jobs/ext/3193003-senior-data-quality-engineer-sdet-with-databricks-and-microsoft-fabric](https://www.wearedevelopers.com/jobs/ext/3193003-senior-data-quality-engineer-sdet-with-databricks-and-microsoft-fabric). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Quality Engineer, SDET with Databricks and Microsoft Fabric - **Company:** DataArt - **Location:** London, UK - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Application Testing, Automation of Tests, Unit Testing, Microsoft Azure, C Sharp (Programming Language), Continuous Integration, Data Governance, Data Integrity, Extract Transform Load (ETL), Database Testing, Python (Programming Language), Microsoft SQL Server, Power BI, Standard Sql, Selenium, Delivery Pipeline, Specflow, Microsoft Fabric, Playwright, Data Pipelines, SDET, Service Stack, Legacy Systems, Databricks - **Published:** September 18, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=7b7eb2fd9eea9753 ## About the Role * 5+ years of experience in quality engineering, with meaningful recent experience testing data or ETL processes rather than applications. * Strong Python and SQL skills, used for building test automation rather than only running it. * Experience with pipeline validation, including row counts, control totals, referential integrity, and business rule assertions. * Experience with source to target reconciliation using defined tolerances. * Experience with test automation within CI/CD, including gates that block a release. * Experience with Azure DevOps. * Experience with SQL Server. * English proficiency at a level suitable for direct client conversations. * Nice to have: Experience with Azure Databricks or Microsoft Fabric. * Experience with data quality frameworks, including Great Expectations, dbt tests, Databricks Expectations, DLT quality rules, Soda, or Deequ. * Experience designing a test framework from scratch rather than extending an existing one. * Experience testing semantic models and BI layers. * Experience working in a regulated financial services environment. * Experience with application test automation alongside data testing, including Selenium, C#, SpecFlow, or Playwright. ## Description Position overview: This is a data focused quality engineering role rather than an application testing role. You will build automated validation for data pipelines and data products, own reconciliation testing between legacy and target systems, and put quality gates into the delivery pipeline so that a failure blocks a release rather than producing a report that nobody reads. Technology stack: Python, SQL Server, Azure Databricks, Microsoft Fabric, Azure DevOps, dbt tests, Power BI * Responsibilities: Design and implement data testing and quality assurance frameworks. * Build automated validation for data pipelines and data products. * Own source to target reconciliation between legacy systems and the new platform. * Build repeatable regression packs that run unattended. * Write unit tests that execute automatically within CI/CD, with quality gates that can block a release. * Detect and handle schema drift and unexpected structural changes. * Validate reports, dashboards, and semantic models, including measure definitions, filter behaviour, and totals. * Apply AI assisted techniques to test generation and coverage analysis, with human review. ## Related Videos - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Proactive monitoring and smoke testing in your production environment](https://www.wearedevelopers.com/videos/139-proactive-monitoring-and-smoke-testing-in-your-production-environment) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Old tools, new tricks](https://www.wearedevelopers.com/videos/1916-old-tools-new-tricks) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [Modern Web Data Extraction: Techniques, Tools, and Legal & Ethical Considerations](https://www.wearedevelopers.com/videos/2046-modern-web-data-extraction-techniques-tools-and-legal-ethical-considerations) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [Dev Digest 119 - ❤️ === ❤️](https://www.wearedevelopers.com/magazine/454-dev-digest-119) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)