Senior Data Engineer

We are seeking an experienced Senior Data Engineer to join our dynamic data team. The successful candidate will be responsible for designing, developing, and maintaining scalable data pipelines and data warehouses to support business analytics and decision-making processes. This role requires a strong understanding of big data technologies, cloud platforms, and database systems, with a focus on delivering high-quality data solutions that meet organisational needs., * Design, develop, and optimise data pipelines using tools such as Apache Spark, Hadoop, and Informatica.

• Build and maintain robust data warehouses leveraging technologies like Oracle, Microsoft SQL Server, and cloud-based solutions such as AWS.
• Collaborate with data analysts and business stakeholders to understand data requirements and translate them into technical specifications.
• Implement database design best practices to ensure efficient storage and retrieval of large datasets.
• Write complex SQL queries, stored procedures, and scripts to facilitate data extraction, transformation, and loading (ETL).
• Develop automation scripts using Bash (Unix shell), Shell Scripting, VBA, or Python to streamline data processes.
• Monitor system performance and troubleshoot issues related to data pipelines or storage solutions.
• Ensure compliance with security standards and best practices for data privacy and protection.
• Stay current with emerging technologies in big data processing, cloud computing, and database management.

Do you have experience in Spark?, * Proven experience as a Data Engineer or in a similar role with a strong background in database design and management.

• Proficiency in programming languages such as Java, Python, VBA, Bash (Unix shell), or Shell Scripting.
• Extensive knowledge of big data frameworks including Hadoop, Apache Hive, Spark, and related tools.
• Hands-on experience working with cloud platforms like AWS for deploying scalable data solutions.
• Strong understanding of relational databases including Oracle and Microsoft SQL Server.
• Experience designing and implementing data warehouses and ETL processes.
• Excellent analysis skills with the ability to interpret complex datasets accurately.
• Familiarity with analysis tools such as VBA or other scripting languages is advantageous.
• Demonstrated ability to work collaboratively within cross-functional teams in a fast-paced environment. This position offers an exciting opportunity for a dedicated professional eager to contribute to innovative data projects within a forward-thinking organisation.

Pulled from the full job description

• Life insurance
• Free parking
• Company pension
• On-site parking