Scala/Spark Developer - Big Data

Infinite Computer Solutions Inc

Hanover, NJ, United States

19 days ago

Apply on www.careerjet.com

Prepare application

Role details

Contract type

Temporary to permanent

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

7 years minimum

Compensation

$189,592.0

Working hours

Regular working hours

Job source

www.careerjet.com

Tech stack

Java (Programming Language) Application Programming Interfaces (APIs) Airflow Big Data Cloud Computing Cloudera Impala Continuous Integration Data Validation Extract Transform Load (ETL) Data Transformation Data Systems Apache Hadoop

+9 more

Apache Hive Python (Programming Language) Scala (Programming Language) SQL Databases Scripting Freeform SQL Apache Spark Data Lakes Apache Kafka

Job description

Design and develop scalable data-processing applications using Scala and Apache Spark.
Build, maintain, and optimize large-scale data/ETL pipelines.
Work extensively with Hadoop ecosystem technologies, including Hive and Impala.
Develop complex SQL queries and data transformations.
Use Python for data processing, scripting, and automation.
Analyze performance bottlenecks and optimize Spark jobs for scalability and performance.
Perform data validation, troubleshooting, and production support.
Work with large volumes of structured and semi-structured financial data.
Collaborate with architects, analysts, and business teams to implement data solutions., What will you be doing? Barclays Services Corp. seeks Java Developer - Markets Post Trade in Whippany, NJ (multiple positions available): Develop and Enhance Big Data System us…
6 days ago, Job Title: Hadoop Developer Location: Whippany, NJ Duration: 6+ Months - Contract Experience: Minimum Years’ experience: 7 - 12+ Years - is a MUST Work Authorization’s (VISA T…
1 month ago +

Requirements

Required Skills: Spark, Scala, Hadoop (Hive/Impala), SQL, Python. Nice to Have: Kafka, Airflow, Cloud platforms, CI/CD, Data Lake technologies. Preferred: Banking/Financial Services experience, particularly Trading, Capital Markets, Tax, Risk, or Regulatory data.