Senior Data Engineer

• Design, develop, and maintain robust data pipelines using tools such as Apache Spark, Hadoop, and Informatica.
• Build and optimise data warehouses and large-scale databases employing Oracle, Microsoft SQL Server, and other relational database systems.
• Develop efficient database schemas and perform database design to ensure optimal performance and scalability.
• Implement ETL processes using Apache Hive, SQL, Bash (Unix shell), Shell Scripting, and VBA to facilitate seamless data integration.
• Collaborate with data analysts and stakeholders to understand data requirements and deliver tailored solutions.
• Monitor system performance, troubleshoot issues, and implement improvements to enhance reliability and efficiency.
• Ensure compliance with organisational standards for data security, privacy, and governance.
• Stay abreast of emerging trends in big data technologies such as AWS cloud services, Python programming, Java development, and analysis tools.

Do you have experience in VBA?, We are seeking a highly skilled Data Engineer to join our dynamic team. The successful candidate will be responsible for designing, developing, and maintaining scalable data pipelines and architectures to support our organisation's data-driven initiatives. This role offers an exciting opportunity to work with cutting-edge technologies and contribute to the optimisation of our data infrastructure. The ideal applicant will possess strong technical expertise, excellent problem-solving skills, and a keen eye for detail. This position is paid and suitable for candidates eager to advance their career in data engineering within a collaborative environment., * Proven experience with AWS cloud platforms for scalable data solutions.

• Strong proficiency in Java, Python, SQL (including optimisation techniques), Bash (Unix shell), Shell Scripting, and VBA.
• Extensive knowledge of big data frameworks including Hadoop, Spark, Apache Hive, and related ecosystem components.
• Hands-on experience with relational databases such as Oracle and Microsoft SQL Server; expertise in database design principles.
• Familiarity with data warehouse architecture concepts and implementation strategies.
• Excellent analysis skills with the ability to interpret complex datasets effectively.
• Demonstrated ability to develop scalable ETL workflows using Informatica or similar tools.
• Strong problem-solving skills combined with organisational abilities to manage multiple projects efficiently. This role offers a stimulating environment where technical expertise is valued alongside innovative thinking. We welcome applications from motivated individuals eager to make a significant impact on our organisation's data capabilities through their specialised skills in data engineering technologies.