Senior Data Engineer

Talon.One LinkedIn Jobs
Berlin, Germany
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Remote
Berlin, Germany

Tech stack

JavaScript
API
Airflow
Business Logic
Big Data
Google BigQuery
Information Engineering
Data Infrastructure
Data Warehousing
DevOps
Github
PostgreSQL
Octopus Deploy
Shell Script
Google Cloud Platform
Data Ingestion
Cypress
AWS Lambda
Debezium
Kubernetes
Kafka
Terraform
Docker

Job description

As a Senior Data Engineer / Data Ops, you will be responsible for all engineering tasks related to the data infrastructure, data ingestion and DWH pipelines. You will own our data ingestion workflows (currently based on a Kafka stream) and will make sure that the data from our PostgresDB instances with a very high amount of data is ingested live into BigQuery. Besides, you will manage our overall data platform infrastructure, recommend improvement and make sure to always follow best practices. Finally, you will also of course be involved in the Data Engineering pipelines, assisting in the modelling of various data sources helping literally all departments within the company making better decisions., * Own the data ingestion streams for all of our client's DBs, from Postgres to BigQuery

  • Own the overall data infrastructure: set up, maintain and improve our stack with new technologies for more efficiency and best practices. E.g. improve orchestration
  • Write DWH pipelines and improve our overall DWH code to apply best practices and bring more efficiency.
  • Be part of a data team composed of various profiles, be at the center of all infrastructure decisions and work closely with other stakeholders from the R&D department, especially the DevOps team., * Kubernetes running on Google Cloud, ArgoCD, Terraform
  • PostgreSQL
  • Aiven Kafka Connect, Strimzi, Debezium
  • DBT cloud, GCP, BigQuery, Fivetran
  • We use Go for our API, core logic, and internal tooling
  • Cypress for automated end-to-end testing
  • Other odds & ends in JavaScript and shell script

Requirements

Do you have experience in Terraform?, * 3 -5 years of experience in the Data Engineering / Data Ops field, ideally working on some big data warehouse projects.

  • You are familiar with the modern data stack and are able to recommend, set up and maintain all different kinds of components from Data ingestion to automation.
  • You have experience with a wide range of tools and technologies within the modern data stack: Kafka, Airflow, Dagster, DBT Core, BigQuery, Lambda functions etc..
  • You have experience with general infrastructure / DevOps management technologies: ArgoCD, Kubernetes, Docker, Github, Postgres, GCP etc..
  • You always thrive for applying data engineering best practices: consistency checks, testing data reliability, monitoring on top of ingestion pipelines, no double business logic in the code.

Benefits & conditions

  • A Research and Development Department of 90+ of engineers, product managers and product designers in Berlin
  • Leaders with 8+ years of experience building our promotions engine
  • €1,000 annual learning budget, full LinkedIn Learning access, and free German language courses to boost your skills
  • 30 days of annual leave, plus extra paid days for your birthday and moving day
  • Home office setup budget, a monthly home office allowance
  • Freedom to work from abroad for up to 90 days worldwide!
  • Mental health support with nilo.health and a discounted Urban Sports Club membership
  • 20% company subsidy on your pension contributions
  • Subsidised BVG public transport ticket and a dog-friendly Berlin office where your furry friend is welcome
  • Lease your ideal bike through BusinessBike

About the company

Talon.One is the most powerful incentives engine that unifies loyalty, promotions and gamification into one holistic platform. Backed by enterprise-grade security and scalability, Talon.One empowers companies to build personalized, profitable promotions and loyalty programs using any data. Today, over 250 of the world's most-loved brands including Adidas, Sephora and Carlsberg work with Talon.One to drive deeper engagement and lasting loyalty with their customers.

Apply for this position