> Markdown version of [/jobs/ext/3101899-principal-data-engineer](https://www.wearedevelopers.com/jobs/ext/3101899-principal-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Principal Data Engineer

- **Company:** Raytheon
- **Location:** Harlow, UK
- **Salary:** £50,000.0 - £90,000.0
- **Contract:** Permanent contract
- **Skills:** Airflow, Amazon Web Services, Amazon S3, Microsoft Azure, Cloud Computing, Extract Transform Load (ETL), Distributed Computing Environment, Hadoop Distributed File System, Python (Programming Language), Microsoft Message Queuing, NoSQL, OpenShift, Cloud Services, Standard Sql, Unstructured Data, Workflow Management Systems, Software Repository, Apache Spark, Pandas, Containerization, Data Lakes, Pyspark, Git Flow, Kubernetes, Apache Kafka, Apache Nifi, Video Streaming, Docker
- **Published:** September 27, 2026
- **Apply:** https://www.adzuna.co.uk/jobs/details/5899595321

## About the Role

* We require candidates to hold active eDV clearance.
 * Experience working in an Agile delivery team.
 * Strong analytical skills related to working with unstructured datasets.
 * Knowledge of Python, including PySpark, Pandas, and PyArrow.
 * Knowledge of distributed data processing, such as Apache Spark.
 * Knowledge of data ETL tools, such as Apache Airflow, AWS Step Functions, or Apache NiFi.
 * Experience with cloud services such as AWS, Azure, or GCP.
 * Knowledge of messaging and streaming technologies such as Kafka, AWS SQS, or other cloud queuing services.
 * Knowledge of SQL and NoSQL storage, such as HDFS, Iceberg, Elastic, S3, or data lakes.
 * Knowledge of containerisation and orchestration tools such as Docker, Kubernetes, or Openshift.
 * Knowledge of testing frameworks and best practices.
 * Familiarity with code repositories, branching strategies, pull requests, and merge processes.
 * We can provide training and development in some areas; candidates do not need expertise in every listed area.

## Description

* Build and maintain data processing pipelines that clean, transform, and aggregate data from disparate sources.
 * Transform and optimise data for analytical use.
 * Collaborate with stakeholders and other engineers.
 * Contribute to the completion of project milestones.
 * Contribute to continuous improvement within the team.
 * Collaborate with peers on the teams technical direction.

Technologies:

 * Airflow
 * AWS
 * Azure
 * Cloud
 * Docker
 * ETL
 * GCP
 * Kafka
 * Kubernetes
 * NoSQL
 * OpenShift
 * Python
 * PySpark
 * SQL
 * Security
 * Spark
 * pandas
 * Support


## Related Videos

- [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis)
- [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered)
- [Advanced Typing in TypeScript](https://www.wearedevelopers.com/videos/496-advanced-typing-in-typescript)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Data Science on Software Data](https://www.wearedevelopers.com/videos/162-data-science-on-software-data)
- [Docker build without Docker](https://www.wearedevelopers.com/videos/100114-docker-build-without-docker)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated)