Principal Data Engineer

IDPP
Reading, United Kingdom
2 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
£ 208K

Job location

Reading, United Kingdom

Tech stack

Airflow
Amazon Web Services (AWS)
Azure
Information Systems
Continuous Integration
Data Architecture
Information Engineering
Data Governance
Data Infrastructure
Data Integration
ETL
Data Systems
Data Warehousing
DevOps
Digital Assets
Python
Meta-Data Management
Cloud Services
DataOps
Software Engineering
SQL Databases
Data Streaming
Enterprise Data Management
Google Cloud Platform
Cloud Platform System
Azure
Snowflake
Spark
SC Clearance
Microsoft Fabric
Infrastructure Automation Frameworks
Information Technology
Integration Frameworks
Data Management
Data Pipelines
Databricks

Job description

We are seeking a Principal Data Engineer to join our SDP Data and Integration team. You will be accountable for the design, implementation, governance and continuous improvement of enterprise data platforms, pipelines and architectures. This is a technical leadership role ensuring data solutions are secure, scalable, reliable and aligned with business objectives.

You will lead the development of modern cloud-based data platforms, promote engineering best practices, and establish standards for data integration, data quality, data governance and DevOps/DataOps. Working closely with business stakeholders, architects, analysts and software 1engineering teams, you will enable data-driven decision-making and advanced analytics capabilities across the organisation., * Design and maintain scalable, secure and resilient data architectures and platforms

  • Lead the development of enterprise data pipelines, data integration frameworks and data products
  • Establish and enforce data engineering standards, patterns and best practices
  • Implement DataOps and DevOps methodologies to improve deployment efficiency, automation and operational reliability
  • Collaborate with cross-functional teams to understand data requirements and deliver effective solutions
  • Ensure data quality, integrity, lineage, security and compliance across all data assets
  • Provide technical leadership, mentoring and coaching to data engineering teams
  • Support cloud migration and modernisation initiatives involving data platforms and services
  • Identify opportunities to optimise performance, reduce costs and increase scalability
  • Manage technical risks, dependencies and delivery challenges
  • Evaluate emerging technologies and recommend innovative approaches
  • Support the development of data governance frameworks and architecture roadmaps

Requirements

  • Bachelor's degree in Computer Science, Software Engineering, Data Engineering, Information Systems or related discipline
  • 7+ years' experience in data engineering, software engineering or data platform development
  • Significant experience designing and implementing enterprise-scale data solutions
  • Strong understanding of cloud-based data platforms and modern data architectures
  • Strong expertise in designing and implementing enterprise-scale data architectures
  • Extensive experience with cloud data platforms (Microsoft Azure, AWS or Google Cloud)
  • Strong proficiency in SQL, Python, Spark and modern data processing frameworks
  • Experience building and managing ETL/ELT pipelines and streaming data solutions
  • Practical experience with DataOps, DevOps, CI/CD pipelines and Infrastructure as Code
  • Expertise in data modelling, data warehousing and master data management principles
  • Strong understanding of data governance, metadata management and data quality frameworks
  • Experience using tools such as Azure Data Factory, Databricks, Snowflake, Microsoft Fabric, Airflow or similar
  • Leadership skills with the ability to mentor engineers and influence technical direction
  • Excellent stakeholder engagement and communication skills
  • Strategic thinking and the ability to align technical solutions with business goals
  • Strong analytical and problem-solving capabilities
  • Experience working in Agile delivery environments and cross-functional teams
  • Must hold or be eligible for SC clearance
  • Sole British passport holder (dual nationality not accepted due to security requirements)

Apply for this position