> Markdown version of [/jobs/ext/4628764-senior-apache-spark-developer](https://www.wearedevelopers.com/jobs/ext/4628764-senior-apache-spark-developer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Apache Spark Developer

- **Company:** Artech
- **Location:** Hoboken, NJ, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Amazon Web Services, Amazon S3, Application Frameworks, Code Review, Continuous Integration, Data Infrastructure, Data Systems, Distributed Computing Environment, Distributed Data Store, Distributed Systems, Apache Hive, Enterprise Messaging Systems, Object-Oriented Software Development, Performance Tuning, Software Engineering, SQL Databases, Data Streaming, Systems Integration, Data Processing, Cloud Platform System, Apache Spark, Apache Kafka, Data Management, Databricks
- **Published:** November 7, 2026
- **Apply:** https://www.thejobnetwork.com/job/2e39036e-2667-49b3-af97-180ed067626b/senior-apache-spark-developer

## About the Role

* 5 years of hands-on development experience with Apache Spark.
 * Strong expertise in Spark SQL, Structured Streaming, DataFrames/Datasets, performance tuning, and optimization.
 * Experience integrating Spark with Apache Kafka.
 * Strong development skills in Java and Python.
 * Experience designing and supporting large-scale distributed systems.
 * Solid understanding of software engineering principles, object-oriented design, and testing practices.
 * Experience working with relational and distributed data platforms.
 * Bachelor's Degree
 * Prior work experience at client or in client's Industry

Applicants must be able to work directly for Artech on W2

Preferred Skills & Qualifications

 * Databricks experience (SQL).
 * AWS experience, including services such as S3, EMR, Glue, Lambda, ECS/EKS.
 * Experience supporting large-scale cloud migration initiatives.
 * Experience with lakehouse architectures and modern data platform patterns.
 * Experience handling multi-terabyte or petabyte-scale datasets.
 * Financial services or regulated industry experience.

## Description

We are seeking a highly skilled individual to help build and expand our next-generation data processing platform. This role will focus on designing and developing distributed data processing solutions using Apache Spark while leveraging an existing enterprise Kafka ecosystem. The successful candidate will play a critical role in scaling our data processing capabilities, enabling cloud adoption, and supporting strategic migration initiatives involving Databricks and AWS. This position offers the opportunity to work on high-volume, mission-critical data platforms processing large-scale real-time and batch workloads., * Build streaming and batch data solutions leveraging Apache Kafka and Apache Spark.

 * Develop reusable frameworks and components supporting enterprise data engineering initiatives.
 * Support migration efforts from on-premises data platforms to Databricks and AWS.
 * Collaborate with architects and platform engineers to implement cloud-native data solutions.
 * Optimize Spark jobs for performance, scalability, reliability, and operational efficiency.
 * Participate in system design, code reviews, testing, and production support activities.
 * Implement CI/CD, monitoring, and observability practices for distributed data applications.
 * Troubleshoot and resolve complex issues across Spark, Kafka, Databricks, and cloud environments and with other enterprise messaging systems.