Senior Data Engineer

• Build and maintain data processing pipelines.
• Transform and optimise data for analytical use.
• Build data pipelines that clean, transform, and aggregate data from disparate sources.
• Collaborate with stakeholders and other engineers.
• Contribute to the completion of milestones associated with projects.
• Contribute to continuous improvement within the team.
• Collaborate with peers on technical direction within the team.

Technologies:

• Airflow
• AWS
• Azure
• Cloud
• Docker
• ETL
• GCP
• Kafka
• Kubernetes
• NoSQL
• OpenShift
• Python
• PySpark
• SQL
• Security
• Spark
• pandas
• Support

• Active eDV clearance is required for this role.
• Experience working in an Agile delivery team.
• Strong analytical skills related to working with unstructured datasets.
• Python experience, including PySpark, Pandas, and PyArrow.
• Experience with distributed data processing, including Apache Spark.
• Experience with data ETL tools and workflows such as Apache Airflow, AWS Step Functions, or Apache NiFi.
• Experience with cloud services such as AWS, Azure, or GCP.
• Experience with messaging and streaming technologies such as Kafka, AWS SQS, or other cloud queuing native services.
• Experience with SQL and NoSQL storage technologies such as HDFS, Iceberg, Elastic, S3, or Data Lake.
• Experience with containerisation and orchestration technologies such as Docker, Kubernetes, or OpenShift.
• Experience with testing frameworks and best practices.
• Experience using code repositories, including branching strategies, pull requests, and merge processes.

We are Raytheon UK, a leading defence and aerospace company operating across the United Kingdom. Our National Security Cyber business delivers mission-critical solutions that safeguard national security 24 hours a day, seven days a week. You will join our experienced Software Engineering function in a cross-functional Agile team based in London, working onsite in a mature agile environment. We offer a competitive salary, contributory pension scheme, life assurance, 25 days holiday plus public holidays, a company bonus scheme, flexible benefits, enhanced sick pay, enhanced family-friendly policies, a 37-hour working week, early Friday finish, volunteering days, and flexible remote, hybrid, or site-based working opportunities depending on the role.