Head of Data Engineering
Role details
Job location
Tech stack
Job description
If you are care focused and looking to join an organisation that is thriving on success, then CHEC is your employer of choice! We have an exciting opportunity for a new Head of Data Engineering to support our ambitious growth plans as we continue to expand throughout the UK.
About the role:
The role holder is responsible for the leading the design, development, and ongoing enhancement of organisation's data infrastructure and pipelines to support advanced data collection, storage, processing, and analysis.
The role holder is accountable for a team of data engineers, fostering a culture of technical excellence and continuous improvement. The role holder will work collaboratively with cross-functional teams, including analysts, software engineers, and key stakeholders, to ensure that data solutions are robust, scalable, and aligned with the strategic goals of delivering high-quality care for our patients.
We are looking for someone who can:
Lead the design and execution of scalable data storage solutions, including databases, data warehouses, and data lakes, ensuring efficient handling of large data volumes.
Oversee development and optimisation of ETL pipelines for effective data extraction, trans-formation, and loading from diverse sources.
Establish and manage data schemas, models, and dictionaries to promote data governance and ensure consistency across the organisation.
Develop data integration solutions to facilitate seamless and secure data flow between systems.
Lead data cleansing, validation, and enrichment processes to ensure data accuracy and quality.
Engage with analysts and software engineers to convert business needs into robust data engineering solutions and provide comprehensive reports.
Identify and address performance bottlenecks, optimise data processing and query performance for scalability.
Implement monitoring frameworks to oversee data pipeline health, swiftly resolving issues to maintain system integrity.
Conduct performance tuning to fulfil scalability and availability targets.
Develop and enforce stringent data security measures, including access controls and encryption, to protect sensitive data.
Ensure all data handling complies with relevant data protection and privacy regulations.
Document data engineering processes and configurations to maintain a detailed knowledge base.
Lead collaborations with stakeholders to align data services with business requirements, delivering essential reports and data visualisations.
Requirements
Previous experience in a similar, fast paced environment
Proven experience working as a lead data engineer or in a similar role, handling large datasets and complex data pipelines.
Previous experience managing a team
Experience with big data processing frameworks and technologies.
Experience with data modelling and designing efficient data structures.
Experience with data integration and ETL (Extract, Transform, Load) processes.
Experience in data cleansing, validation, and enrichment processes.
Strong programming skills in languages such as Python, Java, or Scala.
Knowledge of data warehousing concepts and dimensional modelling.
Understanding of data security, privacy, and compliance requirements
Proficiency in data integration and ETL tools
Strong analytical skills and the ability to understand complex data structures.
Capable of identifying data quality issues, troubleshooting problems, and implementing effective solutions.
