Azure Data / Dev Ops Engineer
Role details
Job location
Tech stack
Job description
We are seeking a highly skilled Azure Data / DevOps Engineer to join our dynamic team. The successful candidate will be responsible for designing, implementing, and maintaining cloud-based data solutions within the Azure environment, ensuring optimal performance and security. This role offers an exciting opportunity to work on large-scale data projects, leveraging a broad range of technologies including big data platforms, scripting languages, and database management systems. The ideal applicant will possess strong analytical skills and a proactive approach to problem-solving, contributing to the organisation's data-driven decision-making processes., * Develop and maintain scalable data pipelines and workflows using Azure Data Factory and other cloud-native tools.
- Design, implement, and optimise data warehouses and data lakes in Azure, ensuring high availability and security.
- Manage database systems such as Oracle, Microsoft SQL Server, and utilise database design principles for efficient data storage.
- Implement automation processes using Bash (Unix shell), Shell Scripting, VBA, and other scripting languages to streamline deployment and operational tasks.
- Integrate big data technologies including Hadoop, Apache Hive, Spark, and Informatica for processing large datasets.
- Collaborate with cross-functional teams to develop solutions that support business analysis and reporting needs.
- Monitor system performance, troubleshoot issues promptly, and ensure compliance with security standards.
- Maintain documentation of system configurations, procedures, and best practices for continuous improvement.
Requirements
Do you have experience in SQL?, * Proven experience working with cloud platforms such as Azure and AWS in a Data / DevOps capacity.
- Strong proficiency in programming languages including Java and Python for data processing tasks.
- Hands-on experience with big data frameworks like Hadoop, Spark, Apache Hive, and related tools such as Informatica.
- Extensive knowledge of SQL databases including Microsoft SQL Server and Oracle; expertise in database design is essential.
- Familiarity with data warehousing concepts and architecture.
- Demonstrated ability to develop automation scripts using Bash (Unix shell), Shell Scripting, VBA, with a focus on operational efficiency.
- Good understanding of analysis techniques to interpret complex datasets effectively.
- Prior experience working in fast-paced environments with a focus on continuous integration/continuous deployment (CI/CD) practices is desirable.
This position offers an engaging environment where innovation meets technical excellence-ideal for professionals eager to advance their expertise in cloud-based data engineering and DevOps practices within a collaborative team setting.
Benefits & conditions
Pulled from the full job description
- Financial planning services
- Life insurance
- Employee stock ownership plan
- Company pension
- Casual dress
- Health & wellbeing programme, * Casual dress
- Company pension
- Employee stock ownership plan
- Financial planning services
- Health & wellbeing programme
- Life insurance