Data Engineer - Microsoft Fabric & Analytics Platform

Benefitscompetitive
Cardiff, United Kingdom
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English

Job location

Cardiff, United Kingdom

Tech stack

Adaptable Database Systems
Data analysis
Azure
Big Data
Business Systems
Cloud Database
Data Governance
Data Infrastructure
ETL
Data Transformation
Data Structures
DevOps
Microsoft Dynamics CRM
JSON
Python
Microsoft Dynamics
Power BI
Standard Sql
SQL Databases
XML
Azure
Spark
Microsoft Fabric
Data Lake
Data Lineage
Data Analytics
Microsoft Dynamics 365 Finance & Operations
Data Management
Azure
Software Version Control
Data Pipelines
Databricks

Job description

We are seeking a Data Engineer to join our Business Intelligence team and help shape the next generation of our enterprise analytics platform.Our team is responsible for designing, developing, and maintaining the organisation's data platform, transforming data from multiple business systems into trusted, accessible, and actionable information. We work closely with stakeholders across the business to deliver scalable data solutions and intuitive Power BI reporting that support data-driven decision making.We are currently evolving our architecture towards a modern Microsoft Fabric-based platform, leveraging Lakehouse and Delta Lake technologies to create a high-performance, scalable analytics environment capable of processing large volumes of data efficiently. This platform will form the foundation of future reporting, analytics, and data products across the organisation. This role will play a key part in designing and building data ingestion pipelines, transforming and modelling data, and establishing best practices for our growing data platform., Design, develop, and maintain data pipelines using Microsoft Fabric and Azure technologies.Build and optimise Delta Lake and Lakehouse solutions for large-scale analytical workloads.Integrate data from multiple source systems, including Dynamics 365 CE, Dynamics 365 Finance & Operations, and other enterprise applications.Design and implement scalable data models to support reporting and analytics requirements.Develop robust data transformation, validation, and quality assurance processes.Work closely with business stakeholders, analysts, and report developers to understand data requirements and deliver effective solutions.Support the creation of high-quality, user-friendly Power BI datasets and reporting solutions.Maintain documentation covering data lineage, architecture, transformations, and business rules.Contribute to data governance, security, and platform best practices.Identify opportunities to improve platform performance, scalability, and maintainability., Data EngineeringExperience designing and developing data pipelines and ETL/ELT processes.Strong SQL skills with experience working on large datasets.Experience working with structured and semi-structured data sources such as SQL databases, JSON, CSV, XML, and APIs.Understanding of data modelling principles and analytical data structures.Experience troubleshooting data quality and performance issues.Microsoft Data PlatformExperience with Microsoft Fabric, Azure Synapse, Azure Data Factory, Databricks, or similar modern data platforms.Experience working with Lakehouse architectures and Delta Lake technologies.Understanding of cloud-based data storage and processing concepts.Experience implementing Medallion architecture in a Lakehouse.Experience with Python, Spark, or PySpark.Reporting & AnalyticsUnderstanding of how data structures support Power BI and analytical reporting.* Experience preparing data for consumption by reporting and analytics teams.Soft SkillsStrong problem-solving and

Requirements

analytical skills.Excellent communication and stakeholder engagement abilities.Ability to work independently while collaborating effectively within a team.Desire to learn and adapt to evolving technologies and business requirements.Desirable Skills & ExperienceExperience with Dynamics 365 Customer Engagement (CE).Experience with Dynamics 365 Finance & Operations (F&O).Knowledge of Kimball methodology, dimensional modelling, fact tables, and dimension tables.Experience with Power BI semantic models and performance optimisation.Experience with source control and DevOps practices.What We're Looking ForWe're looking for someone who enjoys solving data problems, building scalable solutions, and working with modern cloud-based analytics technologies. The ideal candidate will be passionate about creating a robust data platform that enables the business to make better decisions through trusted, accessible data.

About the company

BenefitsCompetitive Salary.Bonus Scheme.25 Days Annual Leave (plus bank holidays).Hybrid working model.Healthcare & Company Pension.E-learning and career development opportunities.Global company gatherings and events.Plus more that can be found on the benefits section on the Careers page, We are committed to providing a welcoming, supportive environment. Creditsafe is an equal opportunities employer that values diversity. Please contact us if you need any assistance with your application.

Apply for this position