Java Backend Developer

We are seeking a highly skilled Java Spark Developer with strong experience in designing and developing large-scale distributed data processing applications. The ideal candidate will have expertise in Java, Apache Spark, Hadoop ecosystem, SQL, and Cloud technologies (AWS/Azure/GCP). The candidate will be responsible for building scalable data pipelines, optimizing Spark applications, and collaborating with cross-functional teams to deliver high-performance data solutions., · Design, develop, and maintain scalable big data applications using Java and Apache Spark.

· Build and optimize batch and real-time data processing pipelines.

· Develop Spark applications using Spark Core, Spark SQL, DataFrames, and Spark Streaming.

· Work with large datasets stored in HDFS, Hive, S3, Delta Lake, or Snowflake.

· Implement data transformation, cleansing, and aggregation processes.

· Optimize Spark jobs for performance, memory utilization, and resource management.

· Develop REST APIs and microservices using Spring Boot where required.

· Collaborate with Data Engineers, Architects, Business Analysts, and DevOps teams.

· Troubleshoot production issues and perform root cause analysis.

· Implement CI/CD pipelines and automated deployment processes.

· Ensure data quality, security, and compliance with enterprise standards.

· Participate in code reviews and follow best coding practices.

· Bachelor’s degree in Computer Science, Information Technology, or related field.

· 5+ years of Java development experience.

· 3+ years of hands-on Apache Spark experience.

· Strong proficiency in:

o Java 8/11/17

o Apache Spark

o Spark SQL

o Hadoop Ecosystem (HDFS, Hive)

o SQL and Database Development

· Experience with:

o Spring Boot and Microservices

o Kafka or other messaging platforms

o RESTful APIs

o Git, Maven, Jenkins

o Linux/Unix environments

· Strong understanding of distributed computing concepts.

· Experience tuning and optimizing Spark jobs.

Preferred Qualifications

· Experience with cloud platforms:

o AWS (EMR, S3, Glue, Lambda)

o Azure Databricks

o Google Cloud Dataproc

· Experience with:

o Databricks

o Delta Lake

o Snowflake

o Airflow

o Kubernetes and Docker

· Exposure to Scala or Python.

· Banking, Financial Services, Insurance, Retail, or E-commerce domain experience.

Technical Skills

Programming Languages

· Java

· SQL

· Python (Preferred)

· Scala (Preferred)

Big Data Technologies

· Apache Spark

· Spark SQL

· Spark Streaming

· Hadoop

· Hive

Cloud & Data Platforms

· AWS EMR

· Databricks

· Snowflake

· Delta Lake

DevOps & Tools

· Git

· Jenkins

· Maven

· Docker

· Kubernetes

Pulled from the full job description

• 401(k), * 401(k)