Senior Lead Data Engineer (Data)
Role details
Job location
Tech stack
Job description
We have an exciting opportunity for a Senior Lead Data Engineer to join our growing Data & AI function within FSP. The successful applicant will work alongside our architects and consultants to deliver high-quality data solutions across a variety of cloud platforms and tech stacks to help our customers become more successful in delivering the insight to maximise and scale automated decision making.
Responsibilities
- You will work as a leader to our wider Data Engineers; leading technical design and architecture discussions
- Mentoring and coaching team members
- Operating as a technical lead across multiple projects and teams.
- Understand customer requirements and work collaboratively to design data solutions that deliver high-quality outcomes.
- Enable higher quality data to be created & managed in our customers organisations
- Develop high-quality data products utilising (primarily) cloud native patterns
- Engineer cloud-based data lake patterns to connect and leverage organisational & external data
- Provide technical support and guidance through prototyping, testing, build, and launch of data products
- Contribute towards the creation of technical support and design documentation for data platforms and solutions.
- Contribute to continually refining our development standards and best practices.
Requirements
-
Extensive experience designing and delivering enterprise-scale data engineering solutions
-
Strong hands-on experience with Azure Databricks, including PySpark, Delta Live Tables and Databricks Workflows and orchestration
-
Microsoft Fabric experience, including Lakehouse, Data Factory, Warehouse and Spark
-
Knowledge of Azure Data Platform services, including ADF, ADLS Gen2, Azure Synapse Analytics
-
A strong background in Python and SQL development
-
Proven experience building batch and streaming data pipelines
-
Experience implementing Medallion Architecture and Lakehouse patterns
-
Strong understanding of data modelling techniques (dimensional, star schema, data vault)
-
Experience with CI/CD, Infrastructure as Code and DevOps practices, Git-based source control and deployment pipelines
-
Strong understanding of data governance, security, and access control
Knowledge and experience of the following would be advantageous:
- Experience with GCP and AWS
- On-prem data platform and integration solutions, including Microsoft SQL Server, SQL Server Integration Services (SSIS)
- Experience in working with Power BI, including Power Query, DAX, and Power BI Service
- Experience with enterprise data governance frameworks
- Certifications for desired cloud technologies
What we look for in our people
- Strong alignment with FSP values and ethos
- Commitment to teamwork, quality and mutual success
- Proactivity with an ability to operate with pace and energy
- Strong communication and interpersonal skills
- Dedication to excellence and quality
Benefits & conditions
- Hybrid working - we empower you to make smart choices about when and where to work to achieve great results
- Industry leading coaching and mentoring
- Competitive salary and an excellent benefits package
Equal and Fair Opportunity