Data Engineer - DBT & Snowflake
Primus Connect
London, UK
1 day ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.careerboard.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Compensation
£117,000.0 - £130,000.0
Working hours
Regular working hours
Job source
Tech stack
Adaptable Database Systems
Airflow
Amazon Web Services
Amazon S3
Automation of Tests
Continuous Integration
Data Governance
Extract Transform Load (ETL)
Data Systems
Database Queries
Python (Programming Language)
Operational Databases
+10 more
Cloud Services
SQL Databases
Snowflake
Git
Cloudformation
Data Lakes
Terraform
Software Version Control
Data Pipelines
Databricks
Job description
- Design, build and maintain scalable ETL/ELT data pipelines.
- Develop transformation models and data modelling frameworks using dbt.
- Build and optimise enterprise data solutions using Snowflake and/or Databricks.
- Design cloud-native data lake solutions using Amazon S3.
- Develop production data pipelines using AWS services including Glue, Lambda, Step Functions and/or MWAA (Apache Airflow).
- Build scalable data models to support analytics and business reporting.
- Develop and optimise complex SQL transformations.
- Use Python to develop data engineering solutions and automation.
- Optimise data workloads for performance, scalability and cost.
- Develop dashboards and reporting solutions using Databricks Dashboards, Snowsight or Amazon QuickSight.
- Work closely with Data Architects, Engineers and client stakeholders to deliver production solutions.
- Follow engineering best practices around version control, automated testing and CI/CD.
Requirements
This is a hands-on engineering role suited to someone with at least 3 years’ commercial Data Engineering experience who has delivered production-grade data solutions., * 3+ years’ commercial Data Engineering experience.
- Strong hands-on dbt experience - this is a key requirement.
- Strong SQL skills.
- Strong Python programming experience.
- Commercial experience with Snowflake and/or Databricks.
- Strong experience designing and building ETL/ELT pipelines.
- Commercial experience working within AWS environments.
- Experience building data lake solutions using Amazon S3.
- Experience with AWS data and orchestration services such as Glue, Lambda, Step Functions or MWAA/Airflow.
- Experience designing data pipelines for performance, scalability and reliability.
- Good understanding of data modelling principles.
- Experience with Git and CI/CD.
- Strong communication skills and the ability to work with both technical teams and client stakeholders.
Desirable Experience
Any of the following would be beneficial:
- Databricks certifications.
- Snowflake certifications.
- Consulting or client-facing delivery experience.
- Terraform or CloudFormation.
- Data governance and security knowledge.
- Experience working within Agile delivery teams.
- Databricks Dashboards, Snowsight or Amazon QuickSight.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.careerboard.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
EM
Eli McGarvie
about 3 years ago
BB
Benedikt Bischof
Making Data Warehouses Fast: A Developer’s Story
about 4 years ago
EM
Eli McGarvie
Data Analyst Salary in the UK
about 3 years ago
EM
Eli McGarvie
Highest Paying Tech Companies for Developers
over 3 years ago
EM
Eli McGarvie
Software Engineer Salary London
about 3 years ago
EM
Eli McGarvie
Best Companies to work for in London: Top 25 Companies in 2023
over 3 years ago