Data Engineer
Role details
Job location
Tech stack
Job description
I am looking for a driven and experienced Data Engineer to help to design, build and maintain a data lakehouse in databricks pulling data from core platforms and external sources and refining this into well curated analysis ready datasets.
As a Data Engineer you will operate within an Agile delivery environment, working closely with other Data Engineers, Data Analysts and a Data Architect to deliver against the backlog; providing vital insight from a wide-ranging dataset to support executive and operational decision making that will underpin sustained growth of business units domestically and internationally.
Requirements
The ideal candidate will possess a strong background in Data Engineering with a proven ability to design, build, and maintain scalable data pipelines and solutions.
From a technical standpoint you will ideally possess:
- Proven experience with databricks
- Proficiency in programming languages such as Python, Spark, SQL.
- Strong experience with SQL databases.
- Expertise in data pipeline and workflow management tools (e.g., Apache Airflow, ADF).
- Experience with cloud platforms (Azure preferred) and related data services.
- Knowledge of big data technologies (e.g., Hadoop, Spark, Kafka).
- Experience of Waterfall and Agile delivery methodologies
Benefits & conditions
Full Time / Permanent
£55,000 - £60,000 plus up to 20% bonus, private medical and other extensive benefits
Hybrid - 1-2 days a week in the North Oxfordshire head office