Big data Developer-Full time-Hybrid
Visionary Innovative Technology Solutions LLC
yesterday
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Tech stack
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Big Data
Continuous Integration
Information Engineering
Data Systems
Data Warehousing
Hadoop
Cloud Services
Data Processing
Snowflake
PySpark
Data Analytics
Data Pipelines
Job description
- Design, develop, and maintain scalable big data solutions using Hadoop and AWS services.
- Build and optimize data pipelines using PySpark/Scala.
- Gather and analyze business requirements and translate them into technical solutions.
- Ensure high-quality delivery through design, development, validation, and support activities.
- Collaborate with cross-functional teams and stakeholders for project execution.
- Contribute to system design, architecture, and estimation processes.
- Implement CI/CD pipelines for data engineering workflows.
- Ensure adherence to organizational standards, processes, and best practices.
- Troubleshoot and resolve data processing and performance issues.
- Support digital transformation initiatives through innovative data solutions.
Requirements
We are looking for an experienced Big Data Developer with strong expertise in AWS cloud and the Hadoop ecosystem. The ideal candidate will have hands-on experience with PySpark, data engineering, and building scalable data pipelines to support enterprise analytics and data-driven initiatives., * 6-8 years of experience in Big Data and Data Engineering.
- Strong hands-on experience with PySpark and Hadoop ecosystem.
- Experience with AWS Cloud services (EKS, S3, EMR, etc.).
- Good knowledge of Snowflake and data warehousing concepts.
- Experience in building scalable and efficient data pipelines.
- Understanding of CI/CD processes and system design principles.
- Strong analytical and problem-solving skills.
- Excellent communication and stakeholder management abilities.
- Ability to work in fast-paced, deadline-driven environments.