Lead Data Engineer

We have an exciting opportunity for a Lead Data Engineer to join our growing Data & AI function within FSP. The successful applicant will work alongside our architects and consultants to deliver high-quality data solutions across a variety of cloud platforms and tech stacks to help our customers become more successful in delivering the insight to maximise and scale automated decision making.

Responsibilities

• You will work as a leader to our wider Data Engineers; leading technical design and architecture discussions
• Mentoring and coaching team members
• Operating as a technical lead across multiple projects and teams.
• Understand customer requirements and work collaboratively to design data solutions that deliver high-quality outcomes.
• Enable higher quality data to be created & managed in our customers organisations
• Develop high-quality data products utilising (primarily) cloud native patterns
• Engineer cloud-based data lake patterns to connect and leverage organisational & external data
• Provide technical support and guidance through prototyping, testing, build, and launch of data products
• Contribute towards the creation of technical support and design documentation for data platforms and solutions.
• Contribute to continually refining our development standards and best practices.

• Extensive experience designing and delivering enterprise-scale data engineering solutions

• Strong hands-on experience with Azure Databricks, including PySpark, Delta Live Tables and Databricks Workflows and orchestration

• Microsoft Fabric experience, including Lakehouse, Data Factory, Warehouse and Spark
• Knowledge of Azure Data Platform services, including ADF, ADLS Gen2, Azure Synapse Analytics
• A strong background in Python and SQL development
• Proven experience building batch and streaming data pipelines
• Experience implementing Medallion Architecture and Lakehouse patterns
• Strong understanding of data modelling techniques (dimensional, star schema, data vault)
• Experience with CI/CD, Infrastructure as Code and DevOps practices, Git-based source control and deployment pipelines
• Strong understanding of data governance, security, and access control

Knowledge and experience of the following would be advantageous:

• Experience with GCP and AWS
• On-prem data platform and integration solutions, including Microsoft SQL Server, SQL Server Integration Services (SSIS)
• Experience in working with Power BI, including Power Query, DAX, and Power BI Service
• Experience with enterprise data governance frameworks
• Certifications for desired cloud technologies

What we look for in our people

• Strong alignment with FSP values and ethos
• Commitment to teamwork, quality and mutual success
• Proactivity with an ability to operate with pace and energy
• Strong communication and interpersonal skills
• Dedication to excellence and quality

• Hybrid working - we empower you to make smart choices about when and where to work to achieve great results
• Industry leading coaching and mentoring
• Competitive salary and an excellent benefits package

Equal and Fair Opportunity

FSP is a leading consultancy specialising in Digital, Security and AI solutions. Our success is enabled by our unwavering commitment to excellence, our people centric culture alongside best-in-class operations, ensuring impactful and sustainable outcomes for our clients.

As a long standing and highly accredited Microsoft Partner, with extensive solution designations, we partner with clients across a range of commercial sectors, enabling digital transformation, innovation and robust cyber security.

We navigate the complexities of data sensitivity, confidentiality, governance and compliance. We blend strategic insight, depth of technical expertise, delivery and operational excellence to meet the specific requirements outlined.

We take a collaborative, one team approach with our clients to drive sustainable change, providing outstanding client experience and delivering exceptional results that are aligned with business priorities.

Our commitment to security and quality is reinforced by our ISO27001 and ISO9001 certifications (UKAS), as well as our CREST approved penetration testing and SOC capabilities. Additionally, we are an IASME Cyber Essentials Certification Body and Cyber Essentials Plus certified.

Find out more about our accolades here: https://fsp.co/about-fsp/

Why work for FSP?

At FSP, we are committed to providing:

• A collaborative and supportive environment in which you can grow and develop your career
• The tools and opportunity to do work of which you can be proud