Data Engineer
Role details
Job location
Tech stack
Job description
Ingesting and understanding new data sources, evolving our data approach (e.g., to a fully-fledged data fabric), implementing and streamline MLOps processes and exploring how we can sensibly and safely utilise artificial intelligence (AI) to turbo charge our work (e.g., smart data quality monitoring, meta data curation and service optimisation).
In short there will be plenty to keep you interested, your technical and power skills developing and a real chance to drive innovation and change.
As part of this you may also be asked to liaise with our clients (directly or through events, conferences, webinars etc.), to help support their data driven journeys.
Why should you consider this role?
Alongside the work opportunities as described your development will be supported, you will be sensibly renumerated, we will provide a compelling benefits package, and we are a great bunch of folks to work with - though we would say that!
Please note - we are not expecting experience in all of the skills below .. we do invest in professional training and development for our employees and we have some very experienced Data Engineers here that you can learn from, * Amazon Redshift (query tuning, distribution/sort keys, workload management)
- Data modelling (normalisation, dimensional)
- dbt (modeling, testing, documentation, deployment)
- Building scalable ETL/ELT pipelines with Python
Workflow Orchestration:
- Apache Airflow (DAG design, scheduling, monitoring, scaling)
- Best practices for dependency management, retries, and alerting
Cloud & Serverless:
- AWS Lambda (Python-based serverless pipelines, event-driven processing)
- IAM roles, policies, and security best practices
Programming & Scripting:
- Python (data processing, automation, testing)
- SQL (advanced query writing and optimization)
Data Engineering Best Practices:
- CI/CD for data pipelines (Git, GitHub Actions, etc.)
- Data quality checks, monitoring, and observability
- Infrastructure as Code (Terraform etc.)
Requirements
Skills required: Ideally 3 years experience as a Data Engineer, AWS, a keen interest in AI & ML, * Ideally a degree in Information Systems, Computer Science, Information Technology, Software Engineering or similarly related and quantitative discipline.
- AWS .. has used AWS commercially
- Circa 3 years of commercial experience working primarily in an AWS Cloud environment using approaches/tooling like ours (see technical skills), delivering scalable, performant, reliable solutions.
- Strong data reliability/observability, data governance and information security credentials.
What technical skills are required?, * Experience with logging/monitoring
- Exposure to data governance, cataloguing, and lineage tools
- Ability to work with a range of structured, semi-structured and unstructured file formats including Parquet, json, csv, xml, pdf, jpg.
- Tools and methods to develop comprehensive data reliability and active metadata solutions.
- Ability to work with and develop APIs (including data transformations).
- Ability to deliver data deidentification and anonymisation solutions.
- Understanding of Cloud security frameworks (specifically on the AWS Cloud) including appropriate data encryption
Desirable
- Utilising AI within data engineering to drive performance
- Facilitating search tools such as Solr
- MLOps experience including familiarity with tools such as DVC & mlflow
- Full data engineering cycle knowledge (tools and skills) for stream data, * Takes ownership and thrives on improving how things are done
- Is proactive, self-motivated, and solutions-focused
- Can influence and collaborate across teams
- Balances delivery detail with big-picture thinking
- Enjoys mentoring and helping others grow
- Is excited to help scale a values-led SaaS company making a real difference
What else are we looking for?
- Ability to work effectively both as an individual (e.g., during remote deep work) and within a team - supportive, collaborative.
- An individual who takes a keen interest in data engineering's frontiers and best practice. Someone who is a critical thinker and a problem solver.
- A proactive, detail focused, person who is curious and seeks continuous improvement both in our systems and their skills.
- Clear written and verbal communication, including effective communication with non-technical audiences. Business acumen, i.e., understanding the business context with a proven ability to align and actively support business goals and OKRs.
- An individual who takes a keen interest in productivity, working to optimise their own output as part of a team that values this highly
Benefits & conditions
Competitive salary and rewards package including: - Private Health care , 4 x salary Life cover, 25 days annual leave, increasing to 28 after 3 year's service,salary sacrifice pension scheme and much more ..
