Senior Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+5 more
Job description
- Design, build, and maintain scalable data pipelines and data products using Databricks, PySpark, Spark SQL, and Delta Lake
- Develop and optimise ETL/ELT processes to ingest, transform, and curate data from internal and external systems
- Shape enterprise data architecture, balancing scalability, performance, security, and maintainability
- Partner with stakeholders across Finance, Product, Sales, Marketing, and Engineering to turn business challenges into technical solutions
- Embed data quality, governance, and access controls throughout the data lifecycle
- Mentor a junior engineer and help mature a growing data function
Technologies:
- AI
- AWS
- CI/CD
- Cloud
- Databricks
- ETL
- Marketing
- Python
- PySpark
- SQL
- Security
- Spark
Requirements
- Senior-level experience in data engineering with strong hands-on Databricks skills, including PySpark, Spark SQL, and Delta Lake
- Advanced SQL and Python coding skills
- Track record of building and optimising enterprise-scale data pipelines and ETL/ELT solutions
- Solid grounding in data architecture, modelling, and modern data platform design
- Cloud experience, preferably AWS
- Familiarity with CI/CD and source control best practice
- Desirable: data science-leaning background or interest in exploring ML/AI and data/predictive modelling strategies
About the company
We are a UK HQ-based, fast-growing software business with 400+ staff globally, serving hundreds of enterprise customers worldwide. This is a remote role in the UK with very occasional visits to our London office. We offer a salary of up to £85,000 basic, plus a 10% bonus and an extensive benefits package. You will join a small, high-impact team at the heart of our data strategy, with real influence over data architecture and platform direction as we continue to build our Data Ops journey. Our benefits include health insurance, income protection, life assurance, subsidised gym membership, and 25 days holiday plus your birthday off.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Data Analyst Salary in the UK
Software Engineer Salary London
Top Big Data Technologies That You Need to Know
How to Become an AI Engineer