Senior Azure Data Engineer

• As a Senior Azure Data Engineer, you will play a key role in our data team, contributing to our ongoing transformation. Your primary responsibilities will include:
• Developing, constructing, testing, and maintaining data architectures within large-scale data processing systems
• Managing data pipelines using Azure Data Factory, Delta Lake, and Spark
• Designing and implementing scalable data solutions utilizing Azure Cloud architecture knowledge
• Manipulating data using Spark, SQL, Python, R, and other data frameworks to understand the dataset's characteristics
• Interacting with API systems to query and retrieve data for analysis
• Collaborating with business users and stakeholders to gather and agree on requirements

Technologies:

• API
• Azure
• CI/CD
• Cloud
• Databricks
• DevOps
• ETL
• Python
• PySpark
• SQL
• Serverless
• Spark

More:

We are a well-known and prestigious business, expanding rapidly while nurturing a strong and positive culture across our workforce. This hybrid role allows you to work from home 2 or 3 days per week, with other days based onsite in West London, just a few minutes walk from a Central Line tube station.

• To be considered for the Senior Azure Data Engineer position, you'll need at least 5 years of experience, ideally with 1 or 2 years in a senior or lead capacity. We are looking for goal-driven individuals who can take ownership of work tasks without the need for constant supervision. Given that you will engage with multiple business areas, effective communication to understand requirements and build trusted relationships is essential. You should possess many, if not all, of the following qualifications:
• Experience as a Senior Data Engineer or in a similar role
• Strong knowledge of Azure Cloud architecture and Azure Databricks, DevOps, and CI/CD
• Proficiency in PySpark, Python, SQL, and other data engineering development tools
• Familiarity with metadata-driven pipelines and SQL serverless data warehouses
• Knowledge of querying API systems
• Experience in building and optimizing ETL pipelines using Databricks
• Strong problem-solving skills and attention to detail
• Understanding of data governance and data quality principles
• A degree in computer science, engineering, or equivalent experience

We offer a competitive salary range of £70,000 - £80,000, commensurate with experience, and may consider a higher offer for outstanding candidates. Our vibrant, rewarding, and diverse work environment supports your career development. Candidates must be authorized to work in the UK without the need for sponsorship now or in the future.