Hadoop Platform Engineer
Role details
Job location
Tech stack
Job description
Explore the latest tech industry news, market trends and expert insights from Lorien's specialists. Guides and Reports Download our latest in-depth research to navigate the ever-evolving technology and talent recruitment markets. Case Studies Discover how Lorien's agile workforce and talent solutions drive success and innovation for clients. Career Advice Browse the latest career tips and advice. Advance your professional journey within tech and digital roles. Podcasts and Webinars Access our expert-led podcasts and webinars covering key trends and challenges in tech recruitment. Salary Survey Our 2025 UK Digital & Tech Salary Survey is your guide to UK salaries. Discover daily rates and hiring trends in the technology and digital market., As a Hadoop Platform Engineer, you'll play a key role in supporting, maintaining, and modernising our on-premise HDFS-based Data Lake and associated Hadoop ecosystem components. You will also help drive the strategic migration of our Hadoop workloads to the cloud, contributing to enterprise-wide simplification and transformation initiatives.
You'll work across our data engineering community, ensuring our platforms remain robust, secure, and high-performing as we transition to the next generation of data capabilities.
What You'll Be Doing
- Managing and maintaining large-scale Hadoop clusters across on-prem environments
- Supporting and optimising our HDFS-based Data Lake and adjacent platform components
- Working with technologies including Hadoop, Spark, HDFS, YARN, Hive, Oozie, and related tooling
- Partnering with engineering teams to deliver scalable, high-quality data solutions
- Contributing to our cloud migration strategy, helping move legacy workloads into modern cloud platforms
- Driving platform simplification and engineering excellence across distributed systems
- Supporting enterprise data transformation activities that enable the bank's strategic objectives
- Ensuring stability, performance, and security of critical data services
Requirements
- Strong hands-on experience with Hadoop ecosystem tools (HDFS, Spark, Hive, Oozie, YARN, etc.)
- Experience operating and supporting large, complex, distributed clusters
- Understanding of data engineering principles and data platform design
- Experience with on-prem Hadoop environments and ideally cloud-based data platforms
- Exposure to cloud technologies (AWS, Azure, or GCP)
- Ability to troubleshoot complex platform issues across networking, compute, and storage layers
- A proactive mindset and desire to contribute to large-scale transformation work
- Open to applicants from a variety of industries and backgrounds
Benefits & conditions
Search our live tech jobs, register with our Talent Network and together we'll find your next exciting career move.
Discover Job Seekers Area Job Search Ready to advance your tech career? Search the latest tech job vacancies and find your next opportunity with Lorien. Contractors Discover Lorien's Contractor Portal for expert contracting support, timesheet management, and more. Featured Employers Meet our featured employers: We connect top tech talent with global organisations offering exciting opportunities. Candidate FAQs Have a question for us? View our frequently asked questions for answers to our top candidate enquiries.
Employers
Discover how our recruitment services and workforce solutions can transform your business.
