Azure Data Engineer

We are seeking a highly skilled Azure Data Engineer to join our dynamic data team. The successful candidate will be responsible for designing, developing, and maintaining robust data solutions within the Azure cloud environment. This role offers an exciting opportunity to work with cutting-edge technologies and contribute to the optimisation of our organisation’s data infrastructure. Candidates should possess strong analytical skills and a solid understanding of big data architectures, database design, and cloud-based data management., * Develop and implement scalable data pipelines using Azure Data Factory, Spark, Hadoop, and other relevant tools.

• Design and optimise data models for efficient storage and retrieval within data warehouses and lakes.
• Integrate diverse data sources including Oracle, Microsoft SQL Server, and Big Data platforms such as Apache Hive and Hadoop.
• Write complex SQL queries, stored procedures, and scripts in Python, VBA, Bash (Unix shell), and Shell Scripting to automate data processes.
• Collaborate with cross-functional teams to gather requirements and translate them into technical specifications.
• Perform database design tasks ensuring optimal performance, security, and compliance standards are met.
• Utilise Informatica for ETL processes where applicable to streamline data workflows.
• Analyse large datasets to identify trends, patterns, and insights that support business decision-making.
• Maintain documentation of data architecture, pipelines, and procedures for ongoing support and future enhancements.

• Proven experience as an Azure Data Engineer or similar role with a strong background in cloud-based data solutions.
• Proficiency in AWS cloud services is desirable alongside Azure platform expertise.
• Extensive knowledge of Java, Python, SQL (including Microsoft SQL Server), and VBA scripting.
• Hands-on experience with Big Data technologies such as Hadoop, Apache Hive, Spark, and related ecosystems.
• Strong understanding of database design principles for relational databases like Oracle and SQL Server as well as NoSQL options.
• Familiarity with Data Warehouse concepts and architecture best practices.
• Experience working with ETL tools such as Informatica is advantageous.
• Analytical mindset with excellent problem-solving skills and attention to detail.
• Ability to work independently as well as part of a collaborative team environment.

This role offers an engaging environment for professionals eager to advance their expertise in cloud data engineering while contributing to innovative projects within a forward-thinking organisation.