Senior Data Engineer

We are collaborating in sourcing several Data Engineers for a large UK client. You will work from your choice of the Edinburgh, London, or Manchester offices, with 6 days per month, and the rest remotely., As a Data Engineer, you’ll be looking to simplify our organisation by developing innovative data-driven solutions through data pipelines, modelling and ETL design, aiming to be commercially successful while keeping our customers and the bank’s data safe and secure.

You’ll drive customer value by understanding complex business problems and requirements to correctly apply the most appropriate and reusable tool to gather and build data solutions. You’ll support our strategic direction by engaging with the data engineering community to deliver opportunities, along with carrying out complex data engineering tasks to build a scalable data architecture., * Building advanced automation of data engineering pipelines through removal of manual stages

• Embedding new data techniques into our business through role modelling, training, and experiment design oversight
• Delivering a clear understanding of data platform costs to meet your department’s cost-saving and income targets
• Sourcing new data using the most appropriate tooling for the situation
• Developing solutions for streaming data ingestion and transformations in line with our streaming strategy

• You should have at LEAST 8 years of commercial experience working as a Data Engineer
• Strong understanding of data usage and dependencies and experience of extracting value and features from large-scale data.
• Experience designing ETL and ELT solutions, delivering high-quality, well-modelled data through rigorous testing, cleansing, monitoring, and modern data warehousing on platforms such as Snowflake
• Hands-on experience with AWS cloud data platforms and managed services, including Airflow, managed ETL, using AWS Glue and metadata services, along with strong security and governance practices
• Experience of using programming languages like SQL and Python, alongside knowledge of data and software engineering fundamentals
• Good knowledge of modern code development practices
• Strong communication skills with the ability to proactively engage with a wide range of stakeholders
• S3 object storage and QuikSight
• Experience working within Financial Services