Big data Developer-Full time-Hybrid

Visionary Innovative Technology Solutions LLC
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Tech stack

Amazon Web Services (AWS)
Amazon Web Services (AWS)
Big Data
Continuous Integration
Information Engineering
Data Systems
Data Warehousing
Hadoop
Cloud Services
Data Processing
Snowflake
PySpark
Data Analytics
Data Pipelines

Job description

  • Design, develop, and maintain scalable big data solutions using Hadoop and AWS services.
  • Build and optimize data pipelines using PySpark/Scala.
  • Gather and analyze business requirements and translate them into technical solutions.
  • Ensure high-quality delivery through design, development, validation, and support activities.
  • Collaborate with cross-functional teams and stakeholders for project execution.
  • Contribute to system design, architecture, and estimation processes.
  • Implement CI/CD pipelines for data engineering workflows.
  • Ensure adherence to organizational standards, processes, and best practices.
  • Troubleshoot and resolve data processing and performance issues.
  • Support digital transformation initiatives through innovative data solutions.

Requirements

We are looking for an experienced Big Data Developer with strong expertise in AWS cloud and the Hadoop ecosystem. The ideal candidate will have hands-on experience with PySpark, data engineering, and building scalable data pipelines to support enterprise analytics and data-driven initiatives., * 6-8 years of experience in Big Data and Data Engineering.

  • Strong hands-on experience with PySpark and Hadoop ecosystem.
  • Experience with AWS Cloud services (EKS, S3, EMR, etc.).
  • Good knowledge of Snowflake and data warehousing concepts.
  • Experience in building scalable and efficient data pipelines.
  • Understanding of CI/CD processes and system design principles.
  • Strong analytical and problem-solving skills.
  • Excellent communication and stakeholder management abilities.
  • Ability to work in fast-paced, deadline-driven environments.

Apply for this position