> Markdown version of [/jobs/ext/2215148-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/2215148-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** TD Bank, Inc. - **Location:** Belfast, UK - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Microsoft Azure, Cloud Database, Continuous Integration, Data Discovery, Information Engineering, Data Governance, Python (Programming Language), Software Engineering, SQL Databases, Unstructured Data, Enterprise Software Applications, Data Ingestion, Apache Spark, Data Lakes, AI Platforms, Pyspark, Data Management, Tools for Reporting, Data Pipelines, Databricks - **Published:** August 25, 2026 - **Apply:** https://dejobs.org/x/x/F770C5076CAC46FB9311DCB3D96132BA/job/ ## About the Role * 10+ years of experience in data engineering, data platform delivery, software engineering, or related enterprise technology roles. * Strong hands-on experience with Databricks, Spark / PySpark, Python, SQL, Delta Lake, Azure, ADLS, and cloud-based data engineering patterns. * Experience designing scalable data pipelines, data products, and lakehouse solutions using modern cloud data platform patterns. * Experience with Unity Catalog or similar governance capabilities, including data discovery, access control, lineage, ownership, and catalog structures. * Experience delivering enterprise-grade data platforms including CI/CD, monitoring, data quality, operational controls, and support processes. * Strong analytical and problem-solving skills, with the ability to work through complex data, platform, and integration challenges. * Strong communication skills with the ability to work effectively across local, global, and offshore teams. * Ability to coordinate with India-based delivery resources and help bridge time zone, requirement, and execution gaps. * Exposure to AI-ready data platform concepts, including metadata enrichment, document/data automation, unstructured data processing, RAG patterns, or AI/ML enablement would be beneficial. * Knowledge of Research, Capital Markets, Global Markets, client analytics, readership, CRM, revenue, or market data domains would be beneficial. ## Description The TDS Research Technology team is responsible for delivering the data, analytics, and AI platforms that support Research business capabilities globally. From Belfast, this role will help build the strategic Research data platform leveraging Databricks, enabling reusable data products, modern analytics, and future AI solutions across the organization., We are seeking a Senior Data Engineer to help build and evolve the strategic Research data platform in Databricks. Working as part of a global Research Technology team, this role will focus on developing scalable data pipelines, governed data products, and foundational capabilities that support analytics, BI reporting, and AI initiatives. The successful candidate will bring a strong combination of hands-on engineering expertise and delivery leadership, acting as a key liaison between global business stakeholders and technology teams to drive successful execution and platform adoption. Role Responsibilities * Work as part of a Belfast-based data engineering team contributing to globally used Research data platforms, products, and services. * Build the foundational Research data platform that will serve as a strategic data and AI enabler for the Research business. * Design, develop, and maintain scalable data pipelines using Python, SQL, Spark, Databricks, Azure, and related cloud data technologies. * Create curated, reusable, and governed data products that can be consumed by Research applications, dashboards, reporting tools, and AI-enabled solutions. * Support data ingestion and transformation patterns across structured, semi-structured, and unstructured data sources where required. * Contribute to data domain, table, object, field, and metadata structures that align with Unity Catalog and broader data governance patterns. * Implement data quality, reconciliation, lineage, monitoring, audit, and operational controls required for production-grade data platforms. * Support CI/CD, automation, deployment, and environment management practices for Databricks and Azure-based data workloads. * Partner closely with global engineering colleagues, business stakeholders, platform teams, and data consumers to translate requirements into scalable data solutions. * Act as a coordination bridge with Cognizant resources in India, using the Belfast time zone overlap to support delivery alignment, issue resolution, and execution follow-through. * Communicate effectively, contribute to design discussions and demos, and support a collaborative global delivery model., It is ideal for a senior data engineer who wants to help establish foundational data capabilities, support strategic AI and analytics initiatives, and play a visible role in shaping the future Research data platform. ## Related Videos - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)