Software Engineer-Bigdata & Hadoop Engineer

Visa Inc.
United States
26 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Compensation
$110,700.0 - $171,800.0
Working hours
Regular working hours
Job source

Tech stack

Clean Code Principles HTML Java (Programming Language) JavaScript (Programming Language) Application Programming Interfaces (APIs) Artificial Intelligence Amazon Web Services Big Data Cascading Style Sheets (CSS) Cloud Computing Data Structures Design of User Interfaces
+21 more
Apache Hadoop Apache HBase Python (Programming Language) Machine Learning Open Source Technology Tensorflow Software Engineering Software Systems SQL Databases Google Cloud Pytorch System Availability Large Language Models Apache Spark Generative AI Backend Information Technology Front End Software Development Api Design Software Coding Programming Languages

Job description

We are seeking a highly motivated Hadoop Engineer with strong development skills and hands-on experience in Big Data platforms. The ideal candidate will be responsible for supporting, maintaining, automating, and enhancing large-scale Hadoop and cloud-based ecosystems and contributing to software development initiatives., This Sr Software Engineer role is for an individual with excellent software engineering with hands-on development experience and a strong foundation in computer science, full-stack development and AI/ML technologies. This role involves software initiatives, leveraging modern programming languages, cloud platforms, APIs and Generative AI to deliver scalable, high-quality business solutions.

  • Perform engineering and administration duties for Big Data platforms built on open-source technologies such as Hadoop, Spark, and HBase
  • Design, develop, and implement automation solutions, tools and products to improve operational efficiency, platform reliability, and system scalability.
  • Write clean, efficient, and maintainable code based on business and technical requirements, and support the testing, deployment, and validation of software solutions.
  • Build and enhance front-end applications using HTML, CSS, JavaScript, and SQL, applying strong UI/UX principles.
  • Develop and maintain back-end services using Python, Java, and related technologies, including API design and integration.
  • Leverage Generative AI (GenAI) to drive innovative solutions, improve productivity, testing, and automation.
  • Collaborate with cross-functional teams to translate business requirements into efficient technical solutions and tools.
  • Excellent interpersonal, verbal, and written communication skills.

This is a hybrid position. Expectations of days in office will be confirmed by your hiring manager.

Requirements

2+ years of relevant work experience and a Bachelors degree, OR 5+ years of relevant work experience

Preferred Qualifications:

3 or more years of work experience with a Bachelor’s Degree or more than 2 years of work experience with an Advanced Degree (e.g. Masters, MBA, JD, MD)

Bachelor’s degree, 3+ years of relevant work experience 2+ year of experience with Big Data technologies (Hadoop, Spark) is required. Expertise in one or more programming languages Python or Java required. Hands-on experience in software engineering with strong coding skills Solid foundation in computer science fundamentals and data structures

Proficiency in programming languages such as Python or JAVA and relevant AI libraries such as TensorFlow, PyTorch, etc. Strong experience developing front-end (HTML, CSS, JavaScript) and back-end services Demonstrated use of Generative AI in development and testing workflows Experience with LLMs and frameworks such as LangChain or LangGraph Working knowledge of Linux fundamentals and system concepts (CPU, memory, storage, networking)

Experience with cloud platforms (AWS/Google Cloud Platform) is a plus

Benefits & conditions

The estimated salary range for this position is $110,700.00 to $ 171,800.00 USD per year, which may include potential sales incentive payments (if applicable). Salary may vary depending on job-related factors which may include knowledge, skills, experience, and location. In addition, this position may be eligible for bonus and equity.Visa has a comprehensive benefits package for which this position may be eligible that includes Medical, Dental, Vision, 401(k), FSA/HSA, Life Insurance, Paid Time Off, and Wellness Program.

About the company

Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be paid.

At Visa, you’ll have the opportunity to create impact at scale - tackling meaningful challenges, growing your skills and seeing your contributions impact lives around the world.

Join Visa and do work that matters - to you, to your community, and to the world. Progress starts with you.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:21 min

Projecting external HTML content using default and named slots

Rowdy Rabouw Rowdy Rabouw · WWC 2022

1:52 min

Structuring and scaling the backend engineering team

Stefan Lingler Stefan Lingler +1 · Coffee With Developers

2:35 min

Preventing remote code execution in PyTorch models

Balázs Kiss · WWC 2023

2:37 min

Optimizing technical profiles for AI sourcing and recruitment

Mina Golesorkhi Mina Golesorkhi · WWC Europe 2026

6:12 min

Streaming HTML content natively using declarative processing instructions

Chris Heilmann +2 · LIVE

3:14 min

Structuring career paths and localized data architectures

Ulrich Wurstbauer +1 · LIVE

Videos

See all

Related articles

See all