Data Engineer
Role details
Job location
Tech stack
Job description
We are looking for an experienced Data Engineer to design, develop, and maintain the scalable data infrastructure that underpins our transformation. You will integrate disparate systems, modernise architecture, and help establish a secure, future-proof data platform that turns data into a strategic asset.
This is an opportunity to play a pivotal role in delivering Knovia's mission to ensure AI leaves no one behind, with key role responsibilities including, * Design, build, and maintain scalable ETL/ELT pipelines from multiple internal and external sources
- Develop reliable batch and streaming data ingestion processes
- Build and manage data warehouses, data lakes, and lakehouse architectures
- Implement automated data quality frameworks, testing, monitoring, and alerting
- Optimise performance, scalability, and cost-efficiency across the data platform
- Ensure infrastructure supports analytics, automation, and AI workloads, * Contribute to the design and evolution of modern, cloud-based data architectures
- Apply best-practice data modelling (dimensional, relational, semantic, data vault where appropriate)
- Participate in architectural reviews and technical roadmapping
- Lead proof-of-concept initiatives for new tools, frameworks, and cloud-native services
- Document architecture, data flows, and technical decisions
Data Governance & Compliance
- Embed strong data governance practices
- Implement metadata management, cataloguing, and lineage tracking
- Support GDPR, data protection, retention, and access control requirements
- Champion security, privacy, and data ethics best practices
Collaboration & Delivery
- Work cross-functionally with Engineering, IT, Analytics, and AI teams
- Partner with Integration & Automation Specialists to build APIs and event-driven pipelines
- Translate business requirements into scalable technical solutions
- Contribute to a collaborative engineering culture (code reviews, knowledge sharing), To promote and maintain an inclusive working environment, as part of your application process we will ask you to share data on certain characteristics. These answers will not form part of the selection and recruitment process and will not be shared with anyone outside of the People Team.
Requirements
Do you have experience in SQL?, Degree in Computer Science, Data Engineering, Mathematics, or related field (or equivalent experience)
. Minimum 3 years' experience in a Data Engineer role
. Proven experience building cloud-based data platforms
. Hands-on experience with:
- SQL and Python
- ADF, Airflow, or similar orchestration tools
- Databricks, Snowflake, Microsoft Fabric, or similar platforms
- ETL/ELT frameworks
- Azure or equivalent cloud environments
. Experience supporting BI, analytics, ML, or automation workloads (desirable)
. Strong understanding of modern data architectures (lakehouse, streaming, API-driven)
. Solid grasp of data modelling principles
. Strong debugging, optimisation, and problem-solving capability
. Confident communicator with both technical and non-technical stakeholders
. Collaborative mindset with a passion for building modern data ecosystems
Benefits & conditions
We have a number of benefits available and all colleagues benefit from our standard benefits including;
Generous Annual Leave: 25 days, increasing with length of service, and 8 Public Bank Holidays ,plus a holiday purchase scheme
Paid Volunteering Leave: Up to 3 days of paid leave for volunteering opportunities and corporate conscience initiatives
Perkbox: Access to a wide range of lifestyle benefits and wellness tools
Recognition and Long Service Awards: Celebrating the milestones and contributions of our colleagues
