Remote Senior Data Engineer - AWS/Databricks/PySpark
WüNDER TALENT
Glengormley, United Kingdom
3 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Senior Compensation
£ 88KJob location
Glengormley, United Kingdom
Tech stack
Airflow
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Cloud Computing
Continuous Integration
Data Cleansing
Data Governance
ETL
Data Security
DevOps
Github
Python
Standard Sql
Software Engineering
SQL Databases
T-SQL
Unstructured Data
Scripting (Bash/Python/Go/Ruby)
Cloud Platform System
Spark
GIT
Data Lake
PySpark
Real Time Data
Terraform
Software Version Control
Data Pipelines
Databricks
Job description
- We architect and build scalable, secure data pipelines using AWS, Databricks and PySpark.
- We design and implement robust ETL and ELT solutions for structured and unstructured data.
- We automate workflows and orchestrate jobs using Airflow and GitHub Actions.
- We integrate data with third-party APIs to support real-time marketing insights.
- We collaborate closely with cross-functional teams including Data Science, Software Engineering and Product.
- We champion best practices in data governance, observability and compliance.
- We contribute to CI/CD pipeline development and infrastructure automation using Terraform and AWS DevOps.
- We provide input into technical decisions, peer reviews and solution design.
Technologies:
- Airflow
- AWS
- Redshift
- Architect
- CI/CD
- Cloud
- Databricks
- DevOps
- ETL
- Git
- GitHub
- Support
- Marketing
- Python
- PySpark
- SQL
- Terraform
- Unity
- GameDev
- Spark, We are looking for a Senior Data Engineer to join a high-impact engineering team delivering scalable data solutions for complex marketing and customer insight use cases. This is a collaborative, forward-thinking environment where you will work on cutting-edge data pipelines, cloud-native platforms and real-time data flows within a modern AWS ecosystem. The role is a hybrid engagement with two days per week onsite in Central London or Glasgow, and the start date is mid-August.
Requirements
- We need proven experience as a Data Engineer in cloud-first environments.
- We need strong commercial knowledge of AWS services such as S3, Glue and Redshift.
- We need advanced PySpark and Databricks experience, including Delta Lake, Unity Catalog and Databricks Jobs.
- We need proficiency in SQL, including T-SQL or SparkSQL, and Python for data transformation and scripting.
- We need hands-on experience with workflow orchestration tools such as Airflow.
- We need strong version control and DevOps exposure, including Git, GitHub Actions and Terraform.
- We need familiarity with data quality tools and metadata/cataloguing such as Great Expectations and Unity Catalog.
- MarTech domain knowledge is beneficial.
- We need the ability to start mid-August.
- We need someone who can work onsite two days per week in Central London or Glasgow in a hybrid setup.