> Markdown version of [/jobs/ext/3780753-scala-sparks-developer](https://www.wearedevelopers.com/jobs/ext/3780753-scala-sparks-developer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Scala Sparks Developer

- **Company:** Ztek Consulting
- **Location:** New York, NY, United States
- **Contract:** Contract
- **Skills:** Amazon Web Services, Microsoft Azure, Big Data, Cloud Computing, Code Review, Data Governance, Extract Transform Load (ETL), Data Transformation, Data Warehousing, Distributed Systems, Apache Hadoop, Apache HBase, Apache Hive, Python (Programming Language), Data Streaming, Systems Integration, Unstructured Data, Data Processing, Scripting, Google Cloud, Apache Spark, Caching, Apache Kafka, Spark Streaming, Machine Learning Operations, Data Pipelines
- **Published:** October 16, 2026
- **Apply:** https://www.dice.com/job-detail/cc429333-4eda-41ac-b51d-dd3243202b0c

## About the Role

* Strong experience in Scala and Apache Spark (Spark Core, Spark SQL, DataFrames, RDDs).
 * Proficiency in Python for data manipulation, scripting, and automation.
 * Proven experience with distributed computing concepts and large-scale data processing.
 * Knowledge of ETL development, data warehousing, and data modeling techniques.
 * Familiarity with Big Data ecosystems such as Hadoop, Hive, Kafka, or HBase is a plus.
 * Excellent communication and collaboration skills.

Preferred Qualifications

 * Experience with cloud platforms such as AWS, Google Cloud Platform, or Azure (particularly with Spark services).
 * Familiarity with streaming data processing using Spark Streaming or Structured Streaming.
 * Knowledge of data governance, security, and compliance practices.
 * Basic understanding of machine learning workflows is advantageous.

## Description

* Develop, test, and maintain scalable data processing pipelines using Scala and Apache Spark.
 * Implement data transformation and ETL workflows to handle structured and unstructured data.
 * Utilize Python for data processing, scripting, and integrating Spark workflows.
 * Optimize performance of Spark applications through tuning, partitioning, and caching strategies.
 * Participate in code reviews, design discussions, and ensure adherence to best practices.
 * Document workflows, architecture, and solutions for internal knowledge sharing.