> Markdown version of [/jobs/ext/2208062-data-engineer](https://www.wearedevelopers.com/jobs/ext/2208062-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Hackajob Ltd - **Location:** Birmingham, UK - **Experience:** Starter - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Amazon Web Services, Data Analysis, Unit Testing, Microsoft Azure, Big Data, Cloud Computing, Databases, Continuous Integration, Extract Transform Load (ETL), Data Mapping, Data Transformation, Data Structures, Data Warehousing, Distributed Computing Environment, Python (Programming Language), Machine Learning, Metadata, NoSQL, Scrum Methodology, Tensorflow, Software Engineering, SQL Databases, Data Streaming, Systems Architecture, Software Organization, Test-Driven Development (TDD), Apache Spark, Cloudformation, Containerization, Integration Tests, Kubernetes, Infrastructure Automation Frameworks, Build Process, Operational Systems, Terraform, Software Version Control, Data Pipelines, Docker - **Published:** August 24, 2026 - **Apply:** https://www.totaljobs.com/job/data-engineer/hackajob-ltd-job107889302 ## About the Role We have a number of opportunities available from junior to senior level and we are looking for data engineers who have a variety of different skills which include some of the below. - Strong proficiency in Python - Extensive experience with cloud platforms (AWS, GCP, or Azure) Experience with: o Data warehousing and lake architectures o ETL/ELT pipeline development o SQL and NoSQL databases o Distributed computing frameworks (Spark, Kinesis etc) o Software development best practices including CI/CD, TDD and version control. o Containerisation tools like Docker or Kubernetes o Experience with Infrastructure as Code tools (e.g. Terraform or CloudFormation) - Strong understanding of data modelling and system architecture - Demonstrable experience on at least one AI/ML project - Knowledge of common machine learning frameworks and models - A good understanding of approaches to monitoring ML models in production - Experience leading a team and decision making skills, are essential As a technology consultancy, we look for people who can deliver both exceptional technical solutions and work as true partners to the organisations we support. To do this you must be able to: - Communicate effectively verbally and in writing, demonstrated through: o Effectively explain complex technical solutions to a non-technical audience o Writing meaningfully to deliver clear information, and guidance o Giving impactful presentations, articulating clearly key points - Demonstrate critical thinking by: o Analysing and evaluating information o Using information gathered to present solutions and reach decisions o Displaying familiarity and comfort with a breadth of technologies (appropriate to the level of the role) and an appreciation of how they can be combined and applied to solve customer problems - Work in partnership with others to: o Effectively manage both internal and external stakeholders to ensure synergy o Collaborate meaningfully with all parties to ensure outcomes are reached effectively Whilst having experience in a consultancy is beneficial, demonstrable experience in working with clients/external partners in other settings will always be considered. ## Description Locations: London, Manchester, Birmingham or Bristol (must be willing to travel to client sites throughout the UK on an ad hoc basis), Deploy machine learning models to production and implement measures to monitor their performance - Implement ETL pipelines and orchestrate data flows using batch and streaming technologies based on software engineering best practice - Define, document and iterate data mappings based on concepts and principles of data modelling - Re-engineer data pipelines to be scalable, robust, automatable, and repeatable - Navigate, explore and query large scale datasets - Build processes supporting data transformation, data structures, metadata, dependency and workload management - Identify and resolve data issues including data quality, data mapping, database and application issues - Implement data flows to connect operational systems, data for analytics and business intelligence (BI) systems - Deliver high quality implementation and documentation for critical functionality - Deliver code, unit tests, feature tests, stubs and integration tests. - Operate in an agile environment as part of a scrum team and participate in sprint rituals - Work with team members to understand designs, functional requirements and triage issue - Stay engaged with the latest technological developments, especially in the fields of generative AI ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [NoSQL Data Modeling for Front-end Developers](https://www.wearedevelopers.com/videos/297-nosql-data-modeling-for-front-end-developers) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Where To Find Software Engineering Jobs](https://www.wearedevelopers.com/magazine/396-where-to-find-software-engineering-jobs) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [The 12 Best Jobs for Software Engineers](https://www.wearedevelopers.com/magazine/401-the-12-best-jobs-for-software-engineers)