Senior Azure Data Engineer / ETL Developer

• Lead the technical architecture for our Azure platform and support our on-premises-to-cloud migration and cloud consolidation initiatives.
• Build large-scale batch and real-time data pipelines using data processing frameworks on Azure.
• Design and implement high-performance data ingestion pipelines from multiple sources using Azure Databricks.
• Develop scalable, reusable frameworks for data ingestion.
• Lead the design of ETL, data integration, and data migration solutions.
• Design, build, and support end-to-end ETL integrations from source systems into Oracle ERP, primarily Oracle General Ledger (GL).
• Partner with architects, engineers, information analysts, business stakeholders, and technology stakeholders to develop and deploy enterprise-grade platforms for data-driven solutions.
• Integrate end-to-end data pipelines from source systems to target data repositories while maintaining data quality and consistency.
• Use event-based and streaming technologies to ingest and process data.
• Work with project team members to support delivery of additional components, including API interfaces and Search.
• Evaluate the performance and applicability of tools against customer requirements.

Technologies:

• AI
• API
• Azure
• Big Data
• Cloud
• Databricks
• ETL
• ERP
• IBM
• Support
• JIRA
• Oracle
• Python
• PySpark
• SQL
• Spark
• REST

• Strong experience with IBM DataStage and Azure Data Factory (ADF).
• Experience with ADLS, Azure SQL DB, and data warehousing.
• Strong working experience implementing Azure cloud components, including Azure Data Factory, Azure Data Analytics, Azure Data Lake, Azure Data Catalogue, and Logic Apps.
• Knowledge of Azure Storage services, including ADLS and Storage Accounts.
• Expertise designing and deploying data applications on Azure cloud solutions.
• Hands-on experience tuning performance and optimizing code in Databricks.
• Good understanding of SQL, T-SQL, and/or PL/SQL.
• Experience working on Agile projects and knowledge of Jira.
• Analytical and problem-solving skills, particularly in big data environments.
• Experience with Python scripting, Spark SQL, or PySpark is a plus.
• Experience handling data ingestion projects in an Azure environment is desirable.

We are Adecco Pontoon, an employment consultancy focused on improving access to the workplace. We value people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, and more, and aim to create an inclusive environment where people can thrive. This is a Senior Azure Data Engineer - ETL Developer contract role based in London, with three days per week onsite. The initial contract is 12 months, with a possible extension, and the rate is £600-£650 inside IR35. We use generative AI tools to support candidate screening, while our hiring team makes all final decisions and reviews applications with care.