Data Engineer

Internet Marketing Agency
2 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
£ 90K

Job location

Remote

Tech stack

.NET
Airflow
Amazon Web Services (AWS)
Computer Vision
Big Data
Software as a Service
Databases
Data Architecture
Data Governance
Data Infrastructure
Data Integrity
ETL
Data Systems
Database Storage Structures
PostgreSQL
Machine Learning
Online Analytical Processing
Node.js
Oracle Applications
Query Optimization
Redis
Transaction Data
TypeScript
WebSocket
Amazon Connect
Tailwind
Amazon Web Services (AWS)
Snowflake
GIT
Build Management
Angular
Kubernetes
Amazon Web Services (AWS)
Transactional Database
Kafka
GraphQL
Data Management
Data Pipelines
Elixir
Redshift

Job description

Are you a Senior Data Engineer who wants to join a scaling SaaS startup that is just about to close its Series A?

A hospitality SaaS company are shaking up the industry, building a modern platform designed around real data.

Remote in UK or Europe. You will need to be +/- 2 hours UTC

£80,000 - £90,000 + Equity

Interview Process 3 stages - Interview with Founder, Interview with team members, Final Technical Interview

Tech Stack: Angular, TypeScript, Liveview, Tailwind, Elixir, Node, Nest, Postgres, GraphQL, Git, Kubernetes, Websockets, AWS

Today the platform already processes a large volume of transactional information and has a strong data foundation in place.

  • ~500GB of structured transaction data
  • 100M+ transactions across multiple restaurant types
  • A data platform ready to scale

The next step is turning this into a high-performance analytics and data infrastructure that powers benchmarking, product insights and machine learning.

That is where you come in.

We are looking for a Senior Data Engineer who can design and build the analytics architecture that sits alongside the transactional platform and unlocks the value of this data.

The Role:

You will design and build the analytics infrastructure that powers data across the business.

This includes building scalable pipelines, selecting and implementing the right warehouse architecture and ensuring analytical queries can run in seconds across hundreds of millions of records.

You will work closely with engineers, data scientists and ML engineers to ensure the platform supports both product intelligence and machine learning use cases.

This is a hands-on role where you will own the architecture, pipelines and performance of the analytics stack.

What You Will Be Doing

  • Design and build a scalable analytics architecture capable of handling hundreds of millions of transactions

  • Build and optimise an OLAP analytics stack separate from the transactional database

  • Design and maintain ETL / ELT pipelines moving data from transactional systems into the analytics warehouse

  • Ensure data integrity across 100M+ transaction records

  • Optimise analytical queries to deliver sub-second or few-second performance

  • Implement monitoring, alerting and testing across data pipelines

  • Support data modelling and suggest improvements to existing database structures

  • Manage supporting infrastructure across the data platform

  • Work closely with ML engineers to support model training and inference

  • Collaborate with technical and non-technical stakeholders to turn business questions into efficient data models

  • Contribute to the long term data architecture strategy

  • Help establish data governance, consistency and quality standards across the platform, * Understanding of data science concepts such as clustering or recommendation

90 Day Outcomes

Within the first 90 days you will be expected to deliver clear progress on the analytics platform.

This includes:

  • Selecting the appropriate analytics warehouse based on performance, cost and scalability

  • Designing and deploying ETL / ELT pipelines ingesting data from Amazon Aurora into the analytics warehouse

  • Implementing monitoring and alerting across pipelines and warehouse infrastructure

  • Reducing benchmark analytics query times to under 2 seconds

  • Implementing a caching layer for frequently used analytical queries

  • Evaluating the current data architecture and recommending improvements to support long term scale

If you've spent most of your career working for a large business, think about applying. You'll need to be able to adapt, pivot and face the challenges that happen in startups., Job Description Senior Software Engineer (Algorithms & Computer Vision) - Liverpool An innovative technology company is seeking a Senior Software Engineer with strong experience in algorithms and computer vision to join its growing development team. This role will focus..., We are hiring for Senior Systems Engineer(HCM / Employee Records, Absence / Recruitment / Learning / Performance - ORACLE) Location : Remote - Expert-level knowledge of Oracle Cloud HCM modules, specifically Employee Records, Absence Management, Recruitment, Learning, and..., Senior Software Engineer (Algorithms & Computer Vision) - Liverpool An innovative technology company is seeking a Senior Software Engineer with strong experience in algorithms and computer vision to join its growing development team. This role will focus on building and..., Senior .NET Engineer £65,000-£70,000 * Fully Remote UK * SaaS / PPM Sector I'm supporting a high-growth SaaS company in the Project Portfolio Management sector to hire a Senior .NET Engineer to join their remote-first UK engineering team. This role focuses on building...

Requirements

  • Strong experience as a Senior Data Engineer

  • Advanced SQL skills and strong query optimisation experience

  • Experience building large scale analytics systems

  • Hands-on experience with OLAP databases such as ClickHouse, Snowflake or Amazon Redshift

  • Experience designing and implementing ETL pipelines from scratch

  • Experience implementing caching strategies using Redis or AWS ElastiCache

  • Strong knowledge of AWS infrastructure

  • Ability to explain complex technical ideas to non-technical stakeholders

Nice To Have

  • Experience with real time analytics systems

  • Experience building benchmarking or BI platforms

  • Experience working with very large datasets

  • Familiarity with orchestration tools such as Airflow, Kafka or AWS Glue

  • Knowledge of partitioning and sorting strategies for large datasets

  • Experience in startup or high growth environments, Job Description We are currently in the market to recruit multiplePrincipal Civil Design Engineers (Water),ideally with wastewater networks and/or clean water networks experience, for a variety of major long-term water industry frameworks across the UK. In addition to a..., Amazon Connect Senior Engineer Travel: Ability to travel up to 30% Location: Remote UK Are you a cloud-based Customer Experience Software Engineer with experience in the implementation of AWS Cloud contact center solutions. with a solid understanding of application...

Benefits & conditions

Job Description Azure Data Engineer | Outside IR35 | £400 - £450 | 6 months | Hybrid LiverpoolYou'll be designing, developing, and managing data pipelines across Azure, primarily using Azure Data Factory to integrate multiple data sources and deliver streamlined workflows...

About the company

Palantir Data Engineer Our client is a Leading Digital Transformation Consultancy who have been named a Times Top 100 Company To Work For for 7 consecutive years. As a Palantir Data Engineer, you will join a highly regarded digital, data, and technology consultancy..., Job Description Senior Fire Engineer job available in London, Manchester, Leeds, Sheffield & Birmingham with a respected and forward-thinking fire consultancy, offering a competitive salary + annual bonus + 38 days annual leave + hybrid and flexible working + pension +...

Apply for this position