Data Engineer (Platform)

Morgan McKinley

West Haddon, United Kingdom

3 days ago

Role details

Contract type

Temporary contract

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Languages

English

Experience level

Senior

Job location

Remote

West Haddon, United Kingdom

Tech stack

Agile Methodologies

Airflow

Amazon Web Services (AWS)

Apache HTTP Server

JIRA

Cloud Computing

Cloudera Impala

Continuous Integration

Hadoop

Scrum

Power BI

Cloudera

Amazon Web Services (AWS)

Spark

GIT

Job description

Our client is looking for a Senior Data Engineer to support the Platform team. The team maintains a Cloudera Data Platform (CDP) on AWS, powering analytics for the business units. This is a hands-on, senior-level role, ideal for someone with recent Cloud-era experience, ready to maintain production systems while the platform is gradually decommissioned., * Keep the platform stable while decommissioning work is planned.

Respond quickly to production, security and compliance tickets .
Perform routine maintenance, small upgrades and workflow fixes .
Collaborate in Agile ceremonies and actively engage with the team.

Requirements

Hands-on experience with Cloudera Data Platform (CDP) on AWS or recent Hadoop administration on similar platforms.
AWS administration and platform management experience.
Strong experience in Spark, Airflow, Apache Ranger, Impala (AWS CDK is a plus).
Agile experience with Scrum , and tools including Jira, Slack .
Familiarity with PowerBI, CI/CD and Git is helpful .