Senior Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+4 more
Job description
As a Senior Data Engineer, you’ll join a small, highly collaborative team and play a key role in the development and evolution of the company’s cloud-based data platform. You’ll be responsible for developing and maintaining ETL pipelines, enhancing their in-house ingestion framework, administering the Databricks platform, and supporting a range of data initiatives across Business Intelligence, Analytics and AI.
This role would suit an experienced Data Engineer with strong Databricks, PySpark/Python and SQL expertise looking to step up in a senior role.
Responsibilities
Development and maintenance of ETL pipelines
Development and maintenance of our in-house ingestion framework
Administration of the Databricks platform including data governance
Supporting the Business Intelligence team in report development
Supporting the wider business’ data needs, including the AI lab and various other group functions
Requirements
Ideally a BSc / MSc in Computer Science (equivalent experience / similar degrees may also suffice)
Databricks experience (ideally 3 years)
Experience with Declarative Automation Bundles and Lakeflow Declarative Pipelines would be beneficial
Python (including pyspark and declarative pipelines)
SQL (especially DBSQL, experience with Databricks-native AI functions is a plus)
Preferred
Databricks Data Engineering Associate / Professional Certifications
git
GitHub (including GitHub Actions)
Star Schema Modelling
Experience using Power BI or providing data for users of Power BI would be helpful in this regard
Preparation of Feature Tables for Machine Learning
Previous mentorship experience or line management would be a plus, but not essential
Benefits & conditions
£60,000 base salary
£4,900 car allowance or equivalent company car
Up to 12% annual bonus
Private healthcare
Discount scheme
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…