> Markdown version of [/jobs/ext/2140664-big-data-developer](https://www.wearedevelopers.com/jobs/ext/2140664-big-data-developer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Big Data Developer

- **Company:** xcelyst ltd
- **Location:** London, UK
- **Salary:** £101,537.0
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Agile Methodology, Microsoft Azure, Big Data, Cloudera Impala, Computer Programming, Data Visualization, Data Warehousing, Distributed File Systems, Distributed Data Store, Apache Hadoop, Hadoop Distributed File System, Apache HBase, Apache Hive, Python (Programming Language), Apache Oozie, Systems Development Life Cycle, Scala (Programming Language), Shell Script, Software Engineering, SQL Databases, Sqoop, Qliksense, Data Ingestion, Apache Yarn, Apache Spark, Git, Storage Technologies, Information Technology, Qlikview, Machine Learning Operations, Teamcity, Docker, Jenkins, Programming Languages, Control M
- **Published:** August 20, 2026
- **Apply:** https://www.adzuna.co.uk/jobs/details/5845247251

## About the Role

Master in Computer Science/ software engineering , additional qualification in Finance is desirable
Strong programming skills in one of the mainstream programming languages. Preferred would be Python
Excellent hands-on with Impala, Hadoop as extremely desirable and Spark core and Spark SQL using Scala
Strong knowledge of Big Data querying tools, such as Hive, Impala, Kudu, etc.
Proven understanding of YARN, Sqoop, and at least one orchestration tool like Oozie
Large-scale distributed data analytic platforms and compute environments (Spark, Impala, etc.)
Distributed file systems and storage technologies (HDFS, HBase, Hive)
Hands on with Git, Jenkins, SQL and Linux/Unix shell scripts
Assist in the evaluation of new solutions for integration into the Hadoop Roadmap/Strategy
Experience in Data Modeling and ML pipelines on Big Data landscape
Proven understanding of Control-M (application and data workflow orchestration solution)
Understanding of visualization tools like QlikView/QlikSense and CI/CD profile- Jenkins, TeamCity, Git, Docker, etc.
Very desirable

Knowledge/exposure of Microsoft Azure
Good understanding of the software development lifecycle (SDLC) and agile methodologies

## Description

We are looking for a talented and experienced big data developer with exposure to Market risk domain for one of our Global Investment Banking Clients

· Able to understand and explore the constantly evolving tools within Hadoop ecosystem and apply them appropriately to the relevant problems at hand

· Implementing software components in Python, Java, Scala languages

· Consulting with various data warehousing engagement, handling large data volumes, architecting big data environments

· Designing, developing, testing, tuning, and building a large-scale data processing system, for Data Ingestion and Data products that allow the Client to improve quality, velocity, and monetization

· Architecting and crafting new features or improvements

· Full ownership and delivery accountability of the assigned Epics/Stories/Tasks


## Related Videos

- [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [Docker build without Docker](https://www.wearedevelopers.com/videos/100114-docker-build-without-docker)
- [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)

## Related Articles

- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [7 Most Popular Web Developer Jobs in Europe](https://www.wearedevelopers.com/magazine/163-7-most-popular-web-developer-jobs-in-europe)