Software Engineer-Bigdata & Hadoop Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+21 more
Job description
We are seeking a highly motivated Hadoop Engineer with strong development skills and hands-on experience in Big Data platforms. The ideal candidate will be responsible for supporting, maintaining, automating, and enhancing large-scale Hadoop and cloud-based ecosystems and contributing to software development initiatives., This Sr Software Engineer role is for an individual with excellent software engineering with hands-on development experience and a strong foundation in computer science, full-stack development and AI/ML technologies. This role involves software initiatives, leveraging modern programming languages, cloud platforms, APIs and Generative AI to deliver scalable, high-quality business solutions.
- Perform engineering and administration duties for Big Data platforms built on open-source technologies such as Hadoop, Spark, and HBase
- Design, develop, and implement automation solutions, tools and products to improve operational efficiency, platform reliability, and system scalability.
- Write clean, efficient, and maintainable code based on business and technical requirements, and support the testing, deployment, and validation of software solutions.
- Build and enhance front-end applications using HTML, CSS, JavaScript, and SQL, applying strong UI/UX principles.
- Develop and maintain back-end services using Python, Java, and related technologies, including API design and integration.
- Leverage Generative AI (GenAI) to drive innovative solutions, improve productivity, testing, and automation.
- Collaborate with cross-functional teams to translate business requirements into efficient technical solutions and tools.
- Excellent interpersonal, verbal, and written communication skills.
This is a hybrid position. Expectations of days in office will be confirmed by your hiring manager.
Requirements
2+ years of relevant work experience and a Bachelors degree, OR 5+ years of relevant work experience
Preferred Qualifications:
3 or more years of work experience with a Bachelor’s Degree or more than 2 years of work experience with an Advanced Degree (e.g. Masters, MBA, JD, MD)
Bachelor’s degree, 3+ years of relevant work experience 2+ year of experience with Big Data technologies (Hadoop, Spark) is required. Expertise in one or more programming languages Python or Java required. Hands-on experience in software engineering with strong coding skills Solid foundation in computer science fundamentals and data structures
Proficiency in programming languages such as Python or JAVA and relevant AI libraries such as TensorFlow, PyTorch, etc. Strong experience developing front-end (HTML, CSS, JavaScript) and back-end services Demonstrated use of Generative AI in development and testing workflows Experience with LLMs and frameworks such as LangChain or LangGraph Working knowledge of Linux fundamentals and system concepts (CPU, memory, storage, networking)
Experience with cloud platforms (AWS/Google Cloud Platform) is a plus
Benefits & conditions
The estimated salary range for this position is $110,700.00 to $ 171,800.00 USD per year, which may include potential sales incentive payments (if applicable). Salary may vary depending on job-related factors which may include knowledge, skills, experience, and location. In addition, this position may be eligible for bonus and equity.Visa has a comprehensive benefits package for which this position may be eligible that includes Medical, Dental, Vision, 401(k), FSA/HSA, Life Insurance, Paid Time Off, and Wellness Program.
About the company
Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be paid.
At Visa, you’ll have the opportunity to create impact at scale - tackling meaningful challenges, growing your skills and seeing your contributions impact lives around the world.
Join Visa and do work that matters - to you, to your community, and to the world. Progress starts with you.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.dice.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
How to Become an AI Engineer
Is Software Engineering Over-Saturated?
Top Big Data Technologies That You Need to Know
Data Engineer Salary UK