Senior Data Engineer
Role details
Job location
Tech stack
Job description
We're looking for an enthusiastic person to join our team as a data engineer. You'll contribute to our data platform, pipelines, and analytics infrastructure that powers insights across our product. You'll make impact for hundreds of thousands of users daily by building and maintaining the robust data systems that turn raw data into reliable, actionable information., As a data engineer within Check, you'll be responsible for developing and maintaining the data pipelines, transformations, and analytics infrastructure that form the backbone of our data platform. Our entire data stack was built from the ground up in recent years with modern technologies. You will be working side-by-side with a team of enthusiastic (in-house) developers who bring years of experience to the table., Our source data flows in from PostgreSQL databases and a range of backend services built in Python and Rust. All data code follows modern development practices, allowing us to maintain a scalable platform and move fast while ensuring reliability. Everything is containerized with Docker and orchestrated through Kubernetes clusters, with Helm as our package manager., * Work in our product team of skilled engineers using the latest, greatest tools
- Run sprints with the data team focused on scalable, maintainable data systems & analytics
- Build and maintain reliable data pipelines that ingest, transform, and deliver data across the platform
- Design and optimize data models and Clickhouse schemas for performance and scalability
- Orchestrate workflows and monitor pipeline health using Airflow, Graphana
- Be responsible for data quality assurance processes, SLAs, and data reliability across the platform
- Collaborate closely with backend, mobile, and product teams to understand data needs and deliver seamless data experiences
- Take ownership of data features and contribute to architectural decisions around the data platform
Requirements
Do you have experience in Terraform?, * HBO, university or similar education in data or technology
- 5+ years of experience as a data engineer or in a similar role
- Strong experience with Python and writing data pipelines
- Expert level understanding of SQL and data modelling concepts
- Hands-on experience with dbt, Airflow, or similar transformation and orchestration tools
- Experience with Data Lakes & columnar data warehouses (Clickhouse experience is a plus)
- Hands-on experience with Infrastructure-As-Code (Terraform) and Kubernetes
- Experience with CI/CD pipelines, Git and containerised deployment using Docker, k8s, Helm
- Ready to grow into Data Lead position, with 2-3 direct reports, * Familiarity with Spatial Data concepts (PostGIS)
- Understanding of Clickhouse's distributed eventual consistency model
- Strong experience in data QA & testing (dbt tests, Soda, GE etc)
- Familiarity with Kafka (MSK) and other streaming technologies/techniques & design patterns
- Rust. Some of our performance-critical services & pipelines are written in it. Interest is welcome; fluency isn't required.