Big Data Developer

xcelyst ltd

London, UK

14 days ago

Apply on www.adzuna.co.uk

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Compensation

£101,537.0

Working hours

Regular working hours

Job source

www.adzuna.co.uk

Tech stack

Java (Programming Language) Agile Methodology Microsoft Azure Big Data Cloudera Impala Computer Programming Data Visualization Data Warehousing Distributed File Systems Distributed Data Store Apache Hadoop Hadoop Distributed File System

+24 more

Apache HBase Apache Hive Python (Programming Language) Apache Oozie Systems Development Life Cycle Scala (Programming Language) Shell Script Software Engineering SQL Databases Sqoop Qliksense Data Ingestion Apache Yarn Apache Spark Git Storage Technologies Information Technology Qlikview Machine Learning Operations Teamcity Docker Jenkins Programming Languages Control M

Job description

We are looking for a talented and experienced big data developer with exposure to Market risk domain for one of our Global Investment Banking Clients

· Able to understand and explore the constantly evolving tools within Hadoop ecosystem and apply them appropriately to the relevant problems at hand

· Implementing software components in Python, Java, Scala languages

· Consulting with various data warehousing engagement, handling large data volumes, architecting big data environments

· Designing, developing, testing, tuning, and building a large-scale data processing system, for Data Ingestion and Data products that allow the Client to improve quality, velocity, and monetization

· Architecting and crafting new features or improvements

· Full ownership and delivery accountability of the assigned Epics/Stories/Tasks

Requirements

Master in Computer Science/ software engineering , additional qualification in Finance is desirable Strong programming skills in one of the mainstream programming languages. Preferred would be Python Excellent hands-on with Impala, Hadoop as extremely desirable and Spark core and Spark SQL using Scala Strong knowledge of Big Data querying tools, such as Hive, Impala, Kudu, etc. Proven understanding of YARN, Sqoop, and at least one orchestration tool like Oozie Large-scale distributed data analytic platforms and compute environments (Spark, Impala, etc.) Distributed file systems and storage technologies (HDFS, HBase, Hive) Hands on with Git, Jenkins, SQL and Linux/Unix shell scripts Assist in the evaluation of new solutions for integration into the Hadoop Roadmap/Strategy Experience in Data Modeling and ML pipelines on Big Data landscape Proven understanding of Control-M (application and data workflow orchestration solution) Understanding of visualization tools like QlikView/QlikSense and CI/CD profile- Jenkins, TeamCity, Git, Docker, etc. Very desirable

Knowledge/exposure of Microsoft Azure Good understanding of the software development lifecycle (SDLC) and agile methodologies