> Markdown version of [/jobs/ext/1868859-data-engineer](https://www.wearedevelopers.com/jobs/ext/1868859-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer

- **Company:** bigspark
- **Location:** Glasgow, UK
- **Experience:** Experienced
- **Salary:** £65,280.0
- **Contract:** Permanent contract
- **Skills:** Clean Code Principles, Java (Programming Language), Artificial Intelligence, Airflow, Amazon Web Services, Amazon S3, Apache HTTP Server, CA Workload Automation Ae, Big Data, BigQuery, Cloud Computing, Computer Programming, Databases, Continuous Integration, Data Vault Modeling, DevOps, Amazon DynamoDB, Github, Identity and Access Management, Python (Programming Language), PostgreSQL, Linux System Administration, MongoDB, MySQL, NoSQL, OpenShift, Simple Data Format, SQL Databases, Data Streaming, Virtualization Technology, Parquet, Snowflake, Apache Spark, Gitlab, Git, Data Lakes, Kubernetes, Apache Flink, Cassandra, Avro, Apache Kafka, Data Management, Data Lakehouse, Terraform, Azure Synapse Analytics, Docker, Jenkins, Databricks
- **Published:** August 1, 2026
- **Apply:** https://www.adzuna.co.uk/jobs/details/5823150672

## About the Role

* 3+ years commercial data engineering experience
 * Strong programming skills in Python, Scala, or Java, with clean coding and testing practices.
 * Big Data & Analytics Platforms: Hands-on experience with Apache Spark (core, SQL, streaming), Databricks, Snowflake, Flink, Beam.
 * Data Lakehouse & Storage Formats: Expert knowledge of Delta Lake, Apache Iceberg, Hudi, and file formats like Parquet, ORC, Avro.
 * Streaming & Messaging: Experience with Kafka (including Schema Registry & Kafka Streams), Pulsar, AWS Kinesis, or Azure Event Hubs.
 * Data Modelling & Virtualisation: Knowledge of dimensional, Data Vault, and semantic modelling; tools like Denodo or Starburst/Trino.
 * Cloud Platforms: Strong AWS experience (Glue, EMR, Athena, S3, Lambda, Step Functions), plus awareness of Azure Synapse, GCP BigQuery.
 * Databases: Proficient with SQL and NoSQL stores (PostgreSQL, MySQL, DynamoDB, MongoDB, Cassandra).
 * Orchestration & Workflow: Experience with Autosys/CA7/Control-M, Airflow, Dagster, Prefect, or managed equivalents.
 * Observability & Lineage: Familiarity with OpenLineage, Marquez, Great Expectations, Monte Carlo, or Soda for data quality.
 * DevOps & CI/CD: Proficient in Git (GitHub/GitLab), Jenkins, Terraform, Docker, Kubernetes (EKS/AKS/GKE, OpenShift).
 * Security & Governance: Experience with encryption, tokenisation (e.g., Protegrity), IAM policies, and GDPR compliance.
 * Linux administration skills and strong infrastructure-as-code experience.

## Description

Were looking for a Data Engineer to developer enterprise-scale data platforms and pipelines that power analytics, AI, and business decision-making. You'll work in a hybrid capacity which may require up to 2 days per week on a client premises.


## Related Videos

- [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis)
- [From event streaming to event sourcing 101](https://www.wearedevelopers.com/videos/91-from-event-streaming-to-event-sourcing-101)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Tomorrow's cloud data platforms - fully managed database-as-a-service (DBaaS)](https://www.wearedevelopers.com/videos/254-tomorrow-s-cloud-data-platforms-fully-managed-database-as-a-service-dbaas)
- [Introducing JSON Structure](https://www.wearedevelopers.com/videos/100219-introducing-json-structure)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)