Principal Data Engineer

• Design and deliver scalable data platform solutions using Snowflake and complementary technologies.
• Build and optimise end-to-end ELT and data pipelines, focusing on performance, reliability and maintainability.
• Help shape data strategy, engineering standards and best practices for governance and data democratisation.
• Support adoption of advanced analytics, AI and machine learning capabilities.
• Develop Infrastructure as Code alongside Cloud Engineering.
• Ensure solutions meet data privacy, security and compliance requirements.
• Work collaboratively in an Agile environment and across the wider business.
• Keep up with emerging technologies and drive continuous improvement across the platform.

Technologies:

• AI
• Azure
• CI/CD
• Cloud
• Docker
• GitHub
• Support
• Java
• Kafka
• Machine Learning
• Python
• PySpark
• SQL
• Scala
• Security
• Snowflake
• Teamcity
• dbt

• Strong experience with Snowflake, including Warehouses, Streams/Tasks, Snowpipe, Snowpark, UDFs/Stored Procedures, Time Travel and Cloning.
• Experience with Snowpark and end-to-end pipeline development; experience with PySpark, Polars or Dask is valuable.
• Strong Python skills, including testing, build tooling and engineering best practices.
• Strong SQL skills, including Snowflake-optimised SQL.
• Experience with dbt, including Jinja templating, or equivalent transformation frameworks.
• Experience with CI/CD; GitHub Actions, TeamCity or Artifactory experience is preferred.
• Experience working in Agile software or data engineering environments and applying modern engineering practices.
• Ability to work independently, communicate complex technical ideas clearly, collaborate effectively with stakeholders and champion better ways of working.
• Experience with Docker, Java/Scala, Kafka, Pulsar, Azure Event Hub, Collibra, Apache Iceberg, Apache Arrow, PySpark or AI engineering technologies such as Snowflake AI, LangChain, LlamaIndex or Pinecone is advantageous.
• Must live within a reasonable commuting distance of Manchester.
• Must reside in the UK and have full working rights; sponsorship is not available.

We are partnering with Morson Edge on behalf of a leading investment management firm to recruit a Principal Data Engineer for our established Data Platform team. This is a 12-month contract, inside IR35, paying up to £1,000 per day depending on experience. The role is based in Manchester and is hybrid, with four days a week onsite. You will combine hands-on engineering with technical leadership and help shape our strategic data platform, with Snowflake at its heart and a growing ecosystem of modern data technologies. We offer the opportunity to join a collaborative team, influence the development of a modern data platform and gain exposure across data engineering, analytics and AI.