> Markdown version of [/jobs/ext/3522513-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/3522513-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer

- **Company:** Raytheon
- **Location:** Harlow, UK
- **Experience:** Expert
- **Salary:** £50,000.0 - £90,000.0
- **Contract:** Permanent contract
- **Skills:** Airflow, Amazon Web Services, Amazon S3, Microsoft Azure, Cloud Computing, Extract Transform Load (ETL), Distributed Computing Environment, Hadoop Distributed File System, Python (Programming Language), Microsoft Message Queuing, NoSQL, OpenShift, Cloud Services, Standard Sql, SQL Databases, Unstructured Data, Software Repository, Apache Spark, Pandas, Containerization, Data Lakes, Pyspark, Git Flow, Kubernetes, Storage Technologies, Apache Kafka, Apache Nifi, Video Streaming, Data Pipelines, Docker
- **Published:** September 30, 2026
- **Apply:** https://www.adzuna.co.uk/jobs/details/5898221784

## About the Role

* Active eDV clearance is required for this role.
 * Experience working in an Agile delivery team.
 * Strong analytical skills related to working with unstructured datasets.
 * Python experience, including PySpark, Pandas, and PyArrow.
 * Experience with distributed data processing, including Apache Spark.
 * Experience with data ETL tools and workflows such as Apache Airflow, AWS Step Functions, or Apache NiFi.
 * Experience with cloud services such as AWS, Azure, or GCP.
 * Experience with messaging and streaming technologies such as Kafka, AWS SQS, or other cloud queuing native services.
 * Experience with SQL and NoSQL storage technologies such as HDFS, Iceberg, Elastic, S3, or Data Lake.
 * Experience with containerisation and orchestration technologies such as Docker, Kubernetes, or OpenShift.
 * Experience with testing frameworks and best practices.
 * Experience using code repositories, including branching strategies, pull requests, and merge processes.

## Description

* Build and maintain data processing pipelines.
 * Transform and optimise data for analytical use.
 * Build data pipelines that clean, transform, and aggregate data from disparate sources.
 * Collaborate with stakeholders and other engineers.
 * Contribute to the completion of milestones associated with projects.
 * Contribute to continuous improvement within the team.
 * Collaborate with peers on technical direction within the team.

Technologies:

 * Airflow
 * AWS
 * Azure
 * Cloud
 * Docker
 * ETL
 * GCP
 * Kafka
 * Kubernetes
 * NoSQL
 * OpenShift
 * Python
 * PySpark
 * SQL
 * Security
 * Spark
 * pandas
 * Support