Software Engineer - Hadoop & AWS Migration

Innovative IT Solutions Inc
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Remote

Tech stack

Java
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Big Data
Cloud Engineering
Computer Programming
DevOps
Distributed Systems
Hadoop
Hadoop Distributed File System
MapReduce
HBase
Hive
Identity and Access Management
Python
Software Engineering
Sqoop
Data Processing
Apache Yarn
Spark
GIT
Cloudformation
Kubernetes
Amazon Web Services (AWS)
Kafka
Data Management
Amazon Web Services (AWS)
Docker
Jenkins

Requirements

  • 10+ years of software engineering experience with strong expertise in Big Data technologies.
  • Hands-on experience with the Hadoop ecosystem, including:
  • Hadoop (HDFS)
  • Spark
  • Hive
  • MapReduce
  • YARN
  • HBase
  • Sqoop
  • Kafka
  • Strong experience with AWS services such as:
  • Amazon EMR
  • S3
  • EC2
  • AWS Glue
  • Lambda
  • IAM
  • CloudFormation
  • Redshift (preferred)
  • Experience migrating Hadoop-based applications and data platforms to AWS.
  • Strong programming skills in Java, Scala, or Python.
  • Experience with CI/CD pipelines and DevOps tools such as Git, Jenkins, Docker, and Kubernetes.
  • Strong understanding of distributed systems, cloud architecture, and scalable data processing.
  • Excellent analytical, troubleshooting, and problem-solving skills.
  • Strong communication and leadership abilities.

Apply for this position