Senior Data Engineer
Role details
Job location
Tech stack
Job description
As a Senior Data Engineer, you will work in a hybrid role: while you will help your squad meet its goals, your primary mandate is the long-term integrity and scalability of our core data infrastructure. Your day-to-day activities will range from ideating and implementing core data platform features, creating a strategic vision and guidance for our data platform and development experience all the way to delivering squad-level features that leverage data to meet squad goals (e.g. sophisticated reverse ETL solutions). This is a highly collaborative role, embedded in a squad with team mates from Data, Tech and Product but also collaborating across squads with other analytics engineers or data scientists to empower their work. This role offers the opportunity for line management or technical mentoring of fellow analytics engineers but doesn't strictly require it.
Responsibilities
- Data platform ownership and vision: define and execute the technical roadmap for our core data platform, ensuring highest levels of reliability, observability, data quality and flexibility.
- Build for self-service: design and implement tooling that empowers Analytics Engineers and Data Scientists to build their own pipelines and models safely and autonomously, removing yourself as a bottleneck.
- Leverage our data: drive business impact within your squad through sophisticated ways of operationalising data in our products.
- Raise the bar: Lead through influence and collaborate with fellow Data team members to grow and improve our analytics and machine learning & AI platform and set technical standards across the organisation., * Read how HIVED raised $42M to transform parcel delivery with AI and all-electric logistics network
- Check the Impact Report 2024
- Keep up with HIVED here
Requirements
We are looking for an ambitious, curious and versatile Senior Data Engineer to drive business impact through a robust and flexible data platform. Our ideal future team mate cares deeply about delivering a world-class, reliable data platform and developer experience that supercharges the work of analysts, analytics engineers and data scientists across the company., * 5+ years of experience in a similar data engineering, analytics engineering or backend engineering role. You have a proven track record of building and scaling data systems in production environments.
- Highly proficient in Python and write maintainable, testable, and efficient code. You are also a SQL expert who understands how to optimize complex queries and design resilient data models.
- Experience or a deep interest in managing "Data Infrastructure as Code." We lean heavily on open-source solutions like Dagster and self-host on GCP via Kubernetes. Familiarity with these, or the ability to navigate K8s environments, is a massive plus.
- Comfortable within the Google Cloud (GCP) ecosystem (or similar) and have experience with data warehouses like BigQuery and cloud storage patterns.
- You advocate for CI/CD, automated testing, and observability. You believe that a data platform should be treated with the same discipline as a core product.
- A clear and bold communicator who knows how to "scale themselves" through precise documentation and written guides while also enjoying direct collaboration across squads.
Technologies we use
- Programming languages: Python, SQL
- Core data platform tools and frameworks: Dagster, dlt and Airbyte, dbt, data-diff, Elementary
- Data lake and warehouse: BigQuery, Iceberg + BigLake
- Infrastructure: Cloud Run, Cloud Storage, GKE (Google Kubernetes Engine), Terraform
Benefits & conditions
- Huge opportunity for learning in a high growth environment, with progression opportunities based on success in the role
- 25 days of holiday allowance plus public holidays
- 1 Birthday Day Off + 2 Tenure-Based Additional Days Off
- Subsidised Private Medical Insurance including dental, vision & mental health therapy
- Bi-annual performance reviews and tailored development plans
- Competitive salary + EMI options scheme
- Annual compensation review
- Team lunch provided once a week
- Quarterly team socials and annual sports day (HIVED Olympics)
- Enhanced maternity/paternity/adoption policy as day 1 right
- Community volunteer days
- Cycle to work scheme
- Dog friendly office and depots
- MacBook Air or Pro (depending on your preference)