Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+25 more
Job description
Weâre looking for a Data Engineer to help design, build and optimise the data pipelines that power our core lakehouse ecosystem.
This role sits at the heart of our data platform, helping turn raw, complex source data into reliable, structured and performant data products that can be trusted by teams across the business.
Youâll work across batch and event-driven data, supporting the way we ingest, transform, test and make data available for analytics, reporting, AI use cases and future data products.
What youâll be doing day to day
As a Data Engineer, youâll work closely with Data Engineering, Analytical Engineering, Product, Commercial and Technology teams to build high-quality data pipelines and platform capabilities.
Youâll help improve how data moves through the business, making sure our pipelines are reliable, observable, cost-effective and built using strong software engineering practices.
Youâll be responsible for:
- Designing, building and maintaining robust data pipelines across batch, streaming and event-driven data sources
- Ingesting, cleansing and transforming raw application, operational and enterprise data into reliable, structured data products
- Working with lakehouse technologies such as Databricks, Delta Lake, BigQuery or similar cloud data platforms
- Supporting data readiness for analytics, machine learning and AI-enabled use cases, including structured and unstructured datasets
- Improving pipeline reliability, performance and cost efficiency through monitoring, observability and operational best practice
- Building automated tests, documentation and validation checks to improve data quality and reduce downstream issues
- Working closely with Analytical Engineers and stakeholders to make sure upstream data products are fit for reporting, insight and business use
- Applying engineering standards across version control, code review, CI/CD, deployment and incident resolution
- Using AI-assisted engineering tools where appropriate to support development, testing, documentation and optimisation
- Contributing to data governance, security, naming standards and data contract practices across the platform
Youâll likely bring experience in:
- Strong Python and SQL skills for data manipulation, cleansing, transformation and pipeline development
- Building and maintaining production data pipelines in a cloud or lakehouse environment
- Working with Databricks, Delta Lake, Delta Live Tables, BigQuery, Snowflake or similar technologies
- Batch processing, workflow orchestration and data transformation patterns
- Event-driven or streaming data concepts, including ingestion patterns, APIs or event routing
- Applying software engineering practices to data, including Git, pull requests, testing, documentation and CI/CD
- Monitoring and troubleshooting data pipelines, including performance, reliability and cost considerations
- Working with data quality checks, data contracts, governance standards or access controls
- Collaborating with engineers, analysts and business stakeholders to turn data requirements into practical, maintainable solutions
- Making pragmatic decisions in fast-moving environments, balancing delivery, quality and long-term maintainability
Nice to have
- Experience with Spark, Databricks Workflows, Delta Live Tables or medallion-style data architecture
- Exposure to real-time streaming technologies, event-driven architecture or API-based ingestion
- Experience preparing data for machine learning, vector indexing, AI agents or generative AI applications
- Experience using AI tools such as GitHub Copilot, Claude, Gemini or similar to support development, debugging, testing or documentation
- Understanding of data lineage, catalogue tooling, access management or enterprise governance frameworks
What success looks like
Success in this role is about building data pipelines and products that teams can trust.
Youâll help improve the reliability, quality and performance of our data platform, making it easier for teams across On the Beach to access and use the data they need. Youâll reduce friction for downstream analytics and AI use cases by creating well-structured, well-tested and well-documented data products.
Youâll also contribute to a strong engineering culture within the data team, where standards are clear, pipelines are observable, and continuous improvement is part of how we work.
What to expect from our interview process
Weâll run a multiple stage interview process, one stage of which will be an in-person interview at our fabulous Aeroworks office in Manchester city centre.
We want to make sure everybody has the opportunity to perform at their best. If you require any reasonable adjustments during the interview process please let the Talent Acquisition team know and they will be happy to assist.
Requirements
Do you have experience in Spark?
Benefits & conditions
Pulled from the full job description
- Annual leave
- Employee discount
- Sick pay
- Employee assistance programme
- Cycle to work scheme
- Work from home
- Discounted gym membership
Full job description
Weâre On the Beach! Since 2003, weâve been rewriting the rules of how people discover, book and experience their perfect getaway. What started as connecting people to short-haul beach holidays has evolved into something much bigger: premium beach destinations, long-haul adventures and vibrant city breaks and thatâs just the beginning of our story.
Powered by our deep-rooted entrepreneurial spirit, proprietary tech, curiosity and our incredible people, weâre accelerating delivering best-in-class technology, the ultimate holiday app, and experiences that keep our customers coming back for more.
Ready to build the future of travel with us?, Ways of working Our full time hours are 37.5 per week, but we donât have rigid working hours so you can find the working pattern thatâs right for you. We have core working hours between 10am - 4pm, so we can collaborate and enjoy the social side of work.
We also have hybrid working so we all work from home and from our Aeroworks office in Manchester City Centre. As a team we are in the office 2 days per week (usually Tuesday & Wednesday).
Our benefits We might be biased but we think our colleagues are pretty great. Theyâre the people that have made On the Beach what it is today and continue to make it vibrant and successful tomorrow. Thatâs why we offer a competitive benefits package, known as our Beach Perks, to all On the Beach colleagues.
These include:
- 25 days holiday plus your birthday off
- Generous discount on holidays, plus you will receive 2 extra days annual leave on top of your holiday allowance to use whilst youâre away on your On the Beach package holiday
- Access to Learnerbly learning platform, plus workshops, courses and professional qualifications
- Enhanced maternity, paternity, shared parental leave and adoption pay, plus other family friendly support
- Employee Assistance Programme and free access to counselling
- Simplyhealth Optimise Health Plan
- Company Sick Pay scheme
- Regular wellbeing events
- Gym discount
- Share Incentive Plan (SIP)
- Death in Service cover
- Onsite subsidised coffee shop
- The Sandbox (our very own bar)
- Food and drink discounts across a number of venues in Manchester City Centre
- Regular social events
- Cycle to Work scheme
What to expect from our interview process
Weâll run a multiple stage interview process, one stage of which will be an in-person interview at our fabulous Aeroworks office in Manchester city centre.
We want to make sure everybody has the opportunity to perform at their best. If you require any reasonable adjustments during the interview process please let the Talent Acquisition team know and they will be happy to assist.
Ways of working Our full time hours are 37.5 per week, but we donât have rigid working hours so you can find the working pattern thatâs right for you. We have core working hours between 10am - 4pm, so we can collaborate and enjoy the social side of work.
We also have hybrid working so we all work from home and from our Aeroworks office in Manchester City Centre. As a team we are in the office 2 days per week (usually Tuesday & Wednesday).
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on indeed.comGood distractions
Talks and stories from around this role â technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Data Engineer Salary UK
Dev Digest 121 - AI goes offline
Dev Digest 132 - Binging WADFlix?
Top Big Data Technologies That You Need to Know