Data Engineer
Role details
Job location
Tech stack
Job description
working - Implementing robust governance frameworks for successful digital initiatives - Streamlining project execution with advance technology and connected data - Organising project data and enabling automation. As an experienced Data Engineer, you will be responsible for the design, build, and operation of the enterprise-grade reporting and analytics capability. The successful candidate will be accountable for creating scalable data pipelines and curated data models across disparate business systems, establishing master data foundations in Microsoft Fabric, Databricks, or equivalent platform, and enabling trusted reporting through Power BI or equivalent dashboard tools. The role also supports a cost management initiative to create a governed cost-rates database, reusable semantic models, and business-facing reports that improve cost visibility, decision-making, and financial control. Key Responsibilities - Lead the end-to-end design and implementation of a reporting platform
Requirements
ingesting data from multiple internal business systems into Microsoft Fabric, Databricks, or a comparable cloud data platform. - Design and maintain batch data pipelines using ELT/ETL patterns and orchestration frameworks. - Develop and govern master and reference data structures to support consistent business definitions, dimensional modelling, and reporting quality. - Profile, cleanse, transform, and validate source data; implement data quality controls, exception handling, reconciliation logic and auditability across the data lifecycle. - Apply data modelling best practice to build reusable lakehouse / warehouse / semantic models optimised for reporting, drill-down analysis, and self-service consumption. - Evaluate and implement AI-assisted approaches were useful for data classification, anomaly detection, data quality monitoring, metadata enrichment, or business rule automation. - Design and deliver Power BI datasets, semantic models, dashboards, and reports with appropriate row-level security, performance tuning, and adoption support. - Own the technical delivery of a cost management data solution, including cost-rate database design, ingestion workflows, historical version control, and reporting outputs. - Partner with finance, operations, and business stakeholders to translate reporting requirements into scalable data products and measurable business outcomes. - Establish DevOps and platform operations practices including monitoring, alerting, release management, documentation, support handover, and continuous improvement. - Define and enforce standards for data governance, metadata, lineage, access control, privacy, and retention in alignment with internal policy and regulatory requirements. - Provide technical leadership and operate with a high degree of autonomy across architecture, build, testing, deployment, and run-state support. Qualifications - Approximately 8-10 years of hands-on experience in data engineering, analytics engineering, or enterprise reporting platform delivery. - Strong delivery experience with Microsoft Fabric, Azure Data Factory, Azure Synapse Analytics, Azure SQL, Microsoft Purview, Databricks, or equivalent cloud data technologies. - Advanced SQL skills and strong proficiency in Python; experience with Spark / PySpark and data transformation frameworks is highly desirable. - Demonstrated expertise in dimensional modelling, semantic layer design, data warehousing, lakehouse concepts, and master data management. - Strong practical experience building Power BI data models, DAX measures, governance controls, deployment pipelines, and interactive executive/business reporting.