Azure Data Engineer

Job Overview Azure Data Support Engineer Location: Newcastle or London preferred Job Type: Full-time | Permanent (On-Call Requirement)We are looking for a versatile Azure Data & ML Support Engineer with strong expertise in Azure cloud services, DevOps, SQL, and data warehousing to support and optimize ongoing operations in a Managed Services environment. This role is responsible for ensuring the stability, performance, and reliability of enterprise-scale data and machine learning workloads on Azure through proactive monitoring, issue investigation, automation, and continuous improvement.The ideal candidate will also play a key role in supporting data warehouse systems by managing SQL-based data loads orchestrated through Azure Data Factory (ADF), and by writing and optimizing SQL queries to aid in troubleshooting, data validation, and automation tasks.Key ResponsibilitiesAzure Platform Support & MonitoringSupport and maintain Azure-based data solutions, including:Azure Data Factory (ADF) pipelines, dataset, linked service, triggerAzure Databricks (Spark jobs, notebooks, clusters)Azure Machine Learning models and endpointsPower BI dashboards and dataset refreshesMonitor and troubleshoot failures in pipelines, jobs, and ML workflows using Azure Monitor, Log Analytics, and custom alerting.DevOps & AutomationMaintain CI/CD pipelines using Azure DevOps, GitHub Actions, etc. for ADF, Databricks and ML model deployments.Develop automation scripts using Python, PowerShell, or Bash to reduce manual intervention and improve service reliability.SQL and Data Warehouse OperationsWrite, optimize, and troubleshoot SQL queries for data validation, root cause analysis, and reporting.Support and maintain data warehouse environments such as Azure Synapse Analytics, SQL Server / Azure SQL DB, Snowflake or BigQuery (optional).Monitor ETL performance and investigate slow-running queries and data load failures.Issue Investigation & RCAInvestigate job failures and performance issues across data pipelines, ML endpoints, and dashboards.Perform root cause analysis (RCA) and provide short-term and long-term solutions.Develop and implement self-healing automation for recurring failures.Service Operations & Support (Managed Services)Provide L2/L3 support aligned with ITIL practices (incident, problem, change management).Participate in on-call rotations and handle critical incident response.Maintain detailed SOPs, runbooks, knowledge-base articles, and client documentation.Required Skills and QualificationsAzure ServicesAzure Data Factory (ADF): pipelines, triggers, parameterisation, monitoringAzure Databricks: Spark, notebooks, job orchestrationAzure Machine Learning: pipelines, model deployment, monitoringPower BI Service: dataset refreshes, access control, report diagnosticsDevOps & AutomationCI/CD: Azure DevOps, GitHub Actions, YAML pipelinesScripting: Python, PowerShellMonitoring: Azure Monitor, Log Analytics, Alerts, Application InsightsSQL & Data WarehousingSQL skills for debugging, data validation, and optimisationExperience with Azure SQL DB or SQL ServerFamiliarity with data modelling concepts and warehouse performance tuningSupport & Incident ManagementStrong troubleshooting and analytical skills for root cause analysisExposure to ITSM tools (e.g., ServiceNow, Jira)Preferred QualificationsMicrosoft Certifications (e.g., DP-900, AZ-900, DP-203)Familiarity with AKS, Docker, or containerised ML environmentsUnderstanding of data governance and security in cloud environmentsAI Foundry, Gen AI, Fabric experienceSoft SkillsStrong verbal and written communicationGood documentation and presentation skillsAbility to handle pressure and prioritise effectively in a live support environmentWork Hours & Availability: Core business hours (08:30-17:30) with rotational on-call support (1 in 4 weeks). Flexibility for off-hours/weekend support during critical deployments or outages.Why Join Us?Be part of a high-impact team managing enterprise-scale Azure solutionsWork on the intersection of data, AI, DevOps, and automationOpportunities to grow across data engineering, MLOps, and cloud automationA dynamic, learning-focused work environment with cutting-edge tools and processesEqual Employment Opportunity Statement All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.Job candidates will not be obliged to disclose sealed or expunged records of conviction or arrest as part of the hiring process.Avanade is committed to providing veteran employment opportunities to our service men and women.Please read Avanade's Hiring and Privacy Statement for more information on how we process your data during the Recruiting and Hiring process.#J-18808-Ljbffr Similar jobs, Contract Azure Data Engineer - SC Cleared Contract: Inside IR35Rate: £450/500 per dayLocation: Remote / LondonTrueNorth are working with a successful tech consultancy who work heavily in the public sector - we're looking for Azure Data Engineers for some immediate contract...

2nd Line Support EngineerLondon£30,000 - £35,000We have an exciting opportunity for a highly motivated individual to join our client, a managed Services Technology business, to work on their rapidly growing Outsourced IT Helpdesk.As a 2nd Line Engineer, you will be...

Job Description Data Engineer - Azure/Databricks £550-650/day overall assignment rate to umbrella 6-month contract Remote working - twice a month onsite Working with a market-leading client who are looking for an Azure Data Engineer contractor to work on a large-scale...

Overview Azure Data Engineer - Hybrid / London - Up to £70k + Benefits Recann is recruiting on behalf of a leading international professional services firm seeking a skilled and proactive Azure Data Engineer to join its collaborative Data team. This role will be at the..., UBDS Group delivers modern cloud, data and AI solutions across public and private sector organisations. We design and build scalable, secure and production-ready platforms that solve real-world problems and deliver measurable outcomes.We're looking for a Principal Data..., About UBDSUBDS Group empowers organizations to achieve remarkable digital transformations through innovative technology solutions We work with clients across the public and private sector to design and build products, platforms and services that genuinely make a difference...