Senior Data Engineer

Design, build and assure scalable, secure data products and pipelines across Azure, AWS and Databricks. Lead data integration design, technical decisions and best practices, while mentoring engineers and enabling high-quality analytics, BI and data science outcomes.

Reporting & Collaboration

• Reports to Lead Data Engineer with oversight from Head of Data Operations & Engineering
• Works across Data Science, Analytics, Architecture, Cyber, Product and Delivery teams
• Acts as a senior technical lead, guiding engineers and influencing cross-team decisions, * Lead design and delivery of scalable batch & streaming data pipelines and products
• Define and assure enterprise-aligned data integration architectures
• Optimise cloud platforms (Azure, AWS, Databricks) for performance and cost
• Build and own ETL/ELT pipelines using PySpark, SQL and orchestration frameworks
• Automate and modernise legacy data processes with reusable patterns
• Design robust data models (Delta Lake, schema evolution, metadata, lineage)
• Ensure data security, governance, and compliance (access control, encryption, lifecycle)
• Provide technical leadership, mentoring and design reviews
• Collaborate with stakeholders to translate complex technical decisions clearly
• Support strategic roadmap, tooling and continuous improvement initiatives

Core Skills & Expertise

Data Engineering

• Advanced PySpark and SQL, performance tuning and best practice coding
• Data modelling (conceptual, logical, physical) and integration design
• Data quality, testing frameworks and automated validation
• Strong data analysis, profiling and insight delivery

Cloud & Platforms

• Azure: Data Factory, Synapse, Databricks, ADLS Gen2, Event Hub, Purview
• AWS: S3, Glue, Athena, Kinesis, Lambda, EMR, Lake Formation
• Databricks: Delta Lake, Unity Catalog, Structured Streaming, MLflow
• SQL Server stack (SSIS, SSRS)

Engineering Practices

• CI/CD for data platforms and Infrastructure-as-Code (Terraform/Bicep)
• Git, monitoring and alerting tools
• Data governance, lineage and observability frameworks
• Leading technical design assurance and reviews

• Degree (or equivalent) in Computer Science or related field
• Experience in enterprise-scale data engineering
• Relevant certifications (Azure, AWS, Databricks) desirable

Pontoon is an employment consultancy. We put expertise, energy, and enthusiasm into improving everyone’s chance of being part of the workplace. We respect and appreciate people of all ethnicities, generations, religious beliefs, sexual orientations, gender identities, and more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive.