> Markdown version of [/jobs/ext/18058-big-data-engineer](https://www.wearedevelopers.com/jobs/ext/18058-big-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Big Data Engineer - **Company:** Northrop Grumman - **Location:** London, UK - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Airflow, Amazon Web Services, Systems Engineering, Big Data, Cloud Computing, Cloudera Impala, Elasticsearch, Apache Hadoop, Apache Hive, OSI Models, Linux Kernel, Machine Learning, NLTK (NLP Analysis), Open Systems Interconnection (OSI), Power BI, Cloudera, Tableau (Software), TCP/IP, Workflow Management Systems, Data Processing, Computer Networking Systems, HybridCloud, Jupyter, Integration Tests, Apache Nifi, Kibana, Spacy, Data Pipelines - **Published:** May 19, 2026 - **Apply:** https://dejobs.org/x/x/56E395F5275143FB96D710B999CBB9F4/job/ ## About the Role * Strong troubleshooting skills and the ability to resolve complex technical issues. * Hands-on experience with integration testing. * In-depth Linux internals knowledge. * Understanding of TCP/IP and OSI networking models. * Experience with NiFi, Airflow or similar orchestration tools. * Experience designing scalable big data systems with a strong security and compliance focus. * Hybrid cloud experience, particularly with AWS. * Familiarity with data science, machine learning and AI tools. * Experience with big data platforms such as Hive, Impala and Elasticsearch. * Proficiency with Tableau, Kibana or PowerBI. * Strong communication and collaboration skills. Preferred * AWS or other cloud certifications. * Experience with additional orchestration tools. * Experience with Cloudera, Hadoop, CDSW or CML. If you meet most of the requirements but not all, we still encourage you to apply. You may be exactly who we need. Security Clearance Due to the nature of our work, you must be able to meet the nationality and residency requirements for the highest level of UK Government security clearance. You must also be able to gain and maintain this clearance. ## Description As a Big Data Systems Engineer, you will play a crucial role in designing, implementing and maintaining large-scale data systems that support data science, machine learning and AI workloads. You will optimise data pipelines, ensure GDPR and privacy compliance, and work hands-on with modern tools across hybrid cloud environments. Working in our Cyber and Intelligence business, you will help deliver technology at scale for customers with complex and sensitive data requirements. Your work will directly support mission-critical programmes and help protect national security. What You Will Do * Develop and maintain automation scripts for data processing and workflows. * Troubleshoot and resolve technical issues across big data systems, pipelines and integrations. * Conduct integration testing to support the introduction of new tools and technologies. * Apply strong Linux internals knowledge to improve reliability and system performance. * Use your understanding of TCP/IP and OSI models to design and troubleshoot networked systems. * Manage, optimise and support data pipelines using NiFi, Airflow or similar orchestration tools. * Design secure, scalable systems with a strong focus on GDPR and privacy compliance. * Support hybrid cloud environments, including on-premise and AWS resources. * Support data science and AI workloads using tools such as Jupyter, Spacy, Transformers and NLTK. * Work with big data platforms such as Hive, Impala and Elasticsearch. * Implement and maintain BI and visualisation tools including Tableau, Kibana and PowerBI. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Debug a Kubernetes Operator](https://www.wearedevelopers.com/videos/487-debug-a-kubernetes-operator) - [An Applied Introduction to eBPF with Go](https://www.wearedevelopers.com/videos/1075-an-applied-introduction-to-ebpf-with-go) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [Add Location-based Searching to Site with ElasticSearch](https://www.wearedevelopers.com/videos/77-add-location-based-searching-to-site-with-elasticsearch) - [Turning Container security up to 11 with Capabilities](https://www.wearedevelopers.com/videos/718-turning-container-security-up-to-11-with-capabilities) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Software Engineer Salary in The UK](https://www.wearedevelopers.com/magazine/231-software-engineer-salary-in-the-uk) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [Best Companies to work for in London: Top 25 Companies in 2023](https://www.wearedevelopers.com/magazine/187-best-companies-to-work-for-in-london-top-25-companies-in-2023) - [Fullstack Developer Salary UK](https://www.wearedevelopers.com/magazine/251-fullstack-developer-salary-uk)