Data Engineer

We are seeking a highly skilled Data Engineer to join our dynamic team. The successful candidate will be responsible for designing, developing, and maintaining robust data pipelines and data warehouses to support business analytics and decision-making processes. This role requires a strong understanding of big data technologies, database systems, and cloud platforms, with an emphasis on optimisation, scalability, and security. The ideal applicant will possess excellent analysis skills and a proactive approach to problem-solving within a fast-paced environment., * Develop and maintain scalable data pipelines using tools such as Apache Spark, Hadoop, and Informatica.

• Design and implement efficient database schemas for data warehouses using Oracle, Microsoft SQL Server, and other relational databases.
• Manage cloud-based data solutions on AWS, ensuring high availability and security.
• Write complex SQL queries and optimise existing code for performance improvements.
• Develop scripts using Bash (Unix shell), Shell Scripting, VBA, and Python to automate data processing tasks.
• Collaborate with cross-functional teams to gather requirements and translate them into technical specifications.
• Perform data analysis to identify trends, anomalies, and opportunities for optimisation.
• Ensure data quality and integrity through validation procedures and continuous monitoring.
• Document data architecture, pipelines, and processes for future reference and compliance purposes.

• Proven experience as a Data Engineer or in a similar role with a strong understanding of database design principles.
• Proficiency in programming languages such as Java, Python, VBA, Bash (Unix shell), and Shell Scripting.
• Extensive knowledge of big data technologies including Hadoop, Apache Hive, Spark, and related ecosystems.
• Hands-on experience with cloud platforms like AWS for deploying scalable data solutions.
• Strong familiarity with relational databases such as Oracle and Microsoft SQL Server.
• Experience designing data warehouses and working with ETL tools like Informatica.
• Excellent analysis skills with the ability to interpret complex datasets effectively.
• Knowledge of SQL optimisation techniques and performance tuning strategies.
• Familiarity with analysis tools and frameworks used in large-scale data environments is desirable. This position offers an exciting opportunity to work at the forefront of data technology within a collaborative environment committed to innovation and excellence.