Lead Cloudera/Hadoop Migration Engineer

Intone Networks
United States
25 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours
Job source

Tech stack

Airflow Amazon Web Services Bash Shell Big Data Cloud Database Information Systems Data Transmissions Data Security DevOps Apache Hadoop Hadoop Distributed File System Apache Hive
+13 more
Python (Programming Language) Apache Oozie Migration Manager Cloudera Shell Script Software Engineering Data Import/Export Data Ingestion Apache Spark Information Technology Terraform Data Pipelines Amazon Elastic Mapreduce (EMR)

Requirements

It is a senior tech lead position Bachelor’s Degree in Computer Science, Information Technology, Information Systems, or related field. 10+ years of experience with enterprise and application design patterns that are applied on Hadoop and Big data platforms in aws. The ideal candidate will possess deep expertise in both on-premises Hadoop ecosystems and modern cloud-native big data solutions on AWS. Hands-on experience with Cloudera Hadoop stack (HDFS, Hive, Spark, Oozie, Python) Proficiency in writing, maintaining, and troubleshooting shell scripts (Bash or similar) for automation and operational support. Migration to AWS will need - Analyze existing Cloudera Hadoop architecture, workflows, and data pipelines. Develop a comprehensive migration strategy to transfer data, processing logic, and applications to AWS services. Design target architecture using AWS big data services such as Amazon EMR, Airflow, Glue, Lambda. Evaluate and select appropriate AWS tools for data ingestion, storage, processing, and analytics. Oversee the migration process, including data transfer, application re-platforming, and validation. Ensure the new architecture meets performance, scalability, reliability, and security requirements. Collaborate with developers, data engineers, DevOps, and stakeholders to ensure a seamless migration. Create detailed technical documentation and migration runbooks. Mentor team members on AWS big data best practices. Strong understanding of data security, compliance, and governance in the cloud. Proven track record of migrating or modernizing big data workloads to AWS. Experience with cloud automation and Infrastructure as Code (e.g. Terraform). AWS certifications (e.g., AWS Certified Solutions Architect, AWS Certified Big Data - Specialty) are highly desirable.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · WWC Europe 2026

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · WWC Europe 2026

4:36 min

Hiring passionate software engineers to tackle unprecedented scaling challenges

Dana Lawson Dana Lawson +1 · WWC Europe 2026

3:18 min

Scaling global network engineering through DevOps culture

Stuart Clark · LIVE

1:44 min

Career transition into cloud native and data management

Michael Cade · LIVE

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · WWC 2024

Videos

See all

Related articles

See all