Data Engineer

You will play a critical role as part of a small specialist to design, build and enhance data pipelines using Microsoft Fabric. With strong collaboration and analytical skills, you will work with the business to provide data solutions to meet business needs., * Translate complex transactional data into optimised analytical models (facts and dimensions) to support reporting and insights.

• Design, build, and enhance data pipelines within Microsoft Fabric to improve performance, scalability, and data quality.
• Engineer new integrations from internal and external data sources using best-practice ETL/ELT methodologies.
• Monitor and optimise SQL-based workflows to ensure accuracy and efficiency in daily data processing.
• Lead efforts to migrate legacy reporting datasets to modern platforms, ensuring minimal disruption.
• Collaborate with analytics teams to develop custom data models and engineered datasets tailored to business requirements.
• Partner with data science colleagues to create summary and aggregated datasets for advanced analytics and predictive modelling.
• Respond efficiently to ad hoc data requests, ensuring outputs are timely, accurate, and aligned to stakeholder needs., At Core-Asset, we’re committed to protecting and respecting your privacy. Our privacy statement explains when and why we collect personal information about people who engage with our services, how we use it, the conditions under which we may disclose it to others, and how we keep it secure. We may change this policy from time to time, so please check this policy occasionally to ensure that you’re happy with any changes.

• Strong proficiency in T-SQL and experience developing complex queries and procedures.
• Expertise in Spark and PySpark for scalable data processing.
• Solid understanding of OLTP and OLAP architectures and data modelling principles.
• Experience with Microsoft Azure, including Fabric, Azure Data Factory, Data Lake, Data Warehouse, and Blob Storage.
• Sound knowledge of ETL/ELT best practices.
• Strong analytical and problem-solving skills with a focus on data accuracy and reliability.
• Excellent collaboration and communication skills, with the ability to translate business requirements into technical solutions.
• Comfortable working in dynamic environments and committed to continuous improvement.

• A highly competitive salary
• Wider Benefits package

Core-Asset Consulting offers specialist recruitment services to asset management, accounting & finance, asset servicing, legal and the wider financial services sector in Scotland.