Data Engineer

Our client is seeking a skilled Senior Data Engineer to lead the design, development, and maintenance of data integration solutions and data warehouse environments. This role will focus on building and optimising ETL/ELT pipelines, supporting data warehousing initiatives, and ensuring the quality, performance, and reliability of large-scale data systems. The successful candidate will collaborate closely with data architects, analysts, and developers to drive data integration and analytics across the organisation., * Lead the design, development, and maintenance of large-scale data systems, including data warehouses, data lakes, and pipelines.

• Design, develop, and maintain ETL/ELT processes utilising tools such as Matillion.
• Create and maintain optimal data flows and data pipeline architectures.
• Develop and manage data warehouse objects, including tables, views, and security roles in Snowflake.
• Extract data from diverse sources, including databases, flat files, and APIs.
• Transform and cleanse data to ensure quality and integrity.
• Load data into the data warehouse while ensuring consistency and accuracy.
• optimise ETL processes for performance, scalability, and reliability.
• Implement data validation, quality checks, and security measures.
• Troubleshoot and resolve data issues, performance bottlenecks, and ETL failures.
• Implement best practises for data warehousing, data modelling, and ETL development.
• Document ETL processes, data mappings, and configurations.
• Collaborate closely with data architects, analysts, and developers to support data integration initiatives.

• Experience with relational databases, ETL/ELT, and data warehousing.
• Expertise in ETL/ELT tools such as Informatica, ODI, Matillion, or SSIS.
• Experience with cloud-based data platforms like Snowflake.
• Proven experience in designing and developing complex near real-time and/or batch data integration solutions.
• Familiarity with both traditional and non-traditional analytical data design methodologies (e.g., Kimball, Inmon).
• Strong SQL programming skills and a solid understanding of relational database concepts.
• Experience in loading and maintaining enterprise data warehouse environments.

Nice to Have

• Experience working with finance data or within financial services environments.
• Familiarity with SAP systems and databases.
• Knowledge of data visualisation tools such as Power BI or Tableau.

If you're passionate about data engineering and meet the above criteria, we would love to hear from you. Join our client and play a pivotal role in enhancing their data infrastructure and analytics capabilities. Apply today!