Azure Data Engineer Microsoft Fabric ETL West London Hybrid/Remote Flexibility

• Ingest, warehouse, and store data at scale within the Azure cloud platform to create core data assets.
• Apply hands-on experience with Microsoft Fabric through active project work.
• Build high-value Data Products from Data Assets to fulfill commercial needs.
• Collaborate closely with Operations, Architecture, Delivery, Product, and Software Engineering teams to release platform increments.
• Contribute toward solution-level architecture, design, and continuous improvement of ADF and Synapse pipelines.
• Own releases end-to-end from development to production following DevOps and CI/CD methodologies.
• Migrate Legacy databases and storage systems to modern Azure cloud lakes and data warehouses.
• Integrate AI-driven capabilities into the coding, testing, and documentation of data engineering artifacts.

• Minimum 3+ years of hands-on experience designing and developing complex ETL/ELT pipelines in the cloud using Azure Data Factory and Azure Synapse.
• Practical experience working in both Serverless and SQL pools in Synapse Analytics.
• Direct client project experience working within Microsoft Fabric.
• Strong background in creating detailed data mappings from high-level requirements to solution-level execution.
• Comprehensive understanding of data warehousing concepts across lakes and traditional databases, covering the full ETL lifecycle.
• Proficiency in relational databases (SQL Server, MySQL), NoSQL, writing complex queries, and developing Stored Procedures.
• Hands-on experience working with PySpark Notebooks for data ingestion and provisioning.
• Strong understanding of Agile methodologies, automation scripting, and DevOps/CI/CD pipelines.

Desirable Skills:

• Coding experience in Python, PySpark, or similar languages.
• Experience utilizing AI-driven automation for coding, documentation, and testing.
• Exposure to other Azure technologies such as Power BI and Power Automate.
• Experience working with non-relational databases (CosmosDB, MongoDB) and handling unstructured data.
• Prior background working in the automotive or intelligence/data-provider industries.

Soft Skills:

• Strong communication, problem-solving, and collaboration skills.
• High attention to detail with the ability to meet tight deadlines.