Specialist Data Engineer
Role details
Job location
Tech stack
Job description
-
Designing and maintaining ETL/ELT pipelines using Azure Data Factory, Synapse and Databricks.
-
Collaborating with data modellers, analysts, and governance leads to ensure data quality and usability.
-
Contribute to the design, implementation and maintenance of large-scale enterprise data platform solutions, ensuring quality, scalability, reliability and performance.
-
Collaborating with the team, overseeing the ongoing operational support of the data platform services and processes.
-
Ensuring the team's SLA obligations for data delivery, and reliability are met, and that incidents and requests are managed appropriately.
-
Partner with Data Engineer Lead in forums and working groups with business stakeholders and cross-functional teams in collecting functional and non-functional requirements, considering technical environments, business constraints and wider enterprise organisation.
-
Collaboration and overseeing development and testing of data service improvements with cross-functional teams in all environments, balancing business priorities with technical improvements and managing technical debt.
-
Overseeing code promotion process across the data platform solutions and environments, adhering to Service Management change process.
-
Support delivery of data models in partnership with stakeholders, ensuring data quality and integrity.
-
Partner closely with IT application and infrastructure teams in promoting; strong alignment to security and compliance, continual integration with source systems and efficient infrastructure resource management.
-
Contribute to making complex decisions regarding data design and implementation, with significant impact on data quality and business intelligence outcomes.
-
Oversee the creation and maintenance of technical documentation and knowledge sharing including data flow/mappings, data dictionary, ERD related to the data solutions., We're committed to being a great place to work- attracting and developing people from the widest possible range of backgrounds. We want everyone to perform at their best and feel able to be themselves. We understand that if we're diverse and inclusive, we'll better understand different perspectives, which is fundamental to our job resolving financial complaints.
We welcome applications from Black and other ethnic minority candidates, and female candidates, for all positions and particularly so for senior leader positions as they are under-represented within the Financial Ombudsman Service at this level.
We are proud to be a Disability Confident Leader. This means that we will put disabled candidates entering under the scheme through to the next stage of the recruitment process should they meet the minimum criteria for a role. A minimum criterion needs to be measurable from reviewing a candidate's CV/supporting statement. Exceptions may apply if due to the volume of applications we are not able to interview all eligible candidates who qualify under the scheme. If you would like to speak to a member of our team about any reasonable adjustments you need, please email and let us know your preferred method of contact.
Find out more
Check out below channels to find out more about everyday life at the Financial Ombudsman Service - and don't forget to follow us while you're there!
Requirements
-
Building scalable data pipelines, utilising Azure Data Factory, Synapse and Databricks to build and maintain robust data pipelines that process and transform data efficiently.
-
Experience with large data migration (essential)
-
Designing data models: Creating and optimising data models, writing complex SQL and Python queries.
-
Hands on experience with Spark and RESTFul APIs
-
Solid knowledge of data warehouse and Delta Lakehouse technologies.
-
Working with Microsoft Azure and SQL technologies such as Azure Synapse Analytics, Azure Data Factory, Azure storage, Azure SQL and SQL Server.
-
Implementing CI/CD pipelines for data solutions
-
Collaborating cross-functionally, working with data analysts, and business stakeholders to deliver comprehensive data solutions.
-
Experience in executing projects, setting targets, planning work, and ensuring timely delivery of projects.
-
Earning certifications, holding Azure certification such as Azure Data Engineer Associate or similar is highly desirable.
-
Identifying improvements: Continuously improving processes to enhance the efficiency and effectiveness of data operations.
-
Experience with SAP Data Services (desirable)
Benefits & conditions
We also offer an attractive, competitive salary and flexible benefits to suit our people. Here's a list of some of the many benefits and perks you can get for working with us:
- 25 days holiday entitlement, with the option to buy extra or sell days
- Generous pension
- Various Family Friendly Policies, including enhanced maternity pay, carers and dependants leave
- Employer provided benefits such as Private medical insurance, virtual GP, Critical illness cover, Life assurance cover, to name a few
- Choice of voluntary benefits including Technology scheme, Cycle to work scheme, Will-writing service amongst others
- Employee Assistance Programme
- Extensive opportunities for personal and career development
- Nationwide gym membership discounts, and a fully equipped on-site gym open 24/7 in London
- Extensive Well-being resources including on-site therapists (London office only)
- Beautiful and bright London office looking over the Thames and near to mainline stations
- Our Coventry office is 2 minutes' walk from the main station
- Our employee led networks (a couple of examples being our Women's Network, Carers network, and Neurodiverse Network) do fantastic work in educating and raising awareness across a range of experiences and support us in being an inclusive employer and a great place to work. You can get involved, too!