> Markdown version of [/jobs/ext/4392718-data-engineer-databricks-pyspark](https://www.wearedevelopers.com/jobs/ext/4392718-data-engineer-databricks-pyspark). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer - Databricks/PySpark

- **Company:** Smart IT Frame
- **Location:** New York, NY, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Amazon Web Services, Amazon S3, BigQuery, Continuous Integration, Information Engineering, Extract Transform Load (ETL), Python (Programming Language), SQL Databases, Google Cloud, Apache Spark, Git, Pytest, Data Lakes, Pyspark, Data Pipelines, Databricks
- **Published:** October 5, 2026
- **Apply:** https://www.dice.com/job-detail/78032b38-ecb2-4e89-9272-7feb71383663

## About the Role

* 7+ years of Data Engineering experience
 * 4+ years hands-on with Databricks & Spark/PySpark
 * Strong Python, SQL, Delta Lake
 * Experience with AWS (S3, Glue) and Google Cloud Platform (BigQuery, GCS)
 * Strong ETL/ELT, Spark optimization & data pipeline development
 * Experience with CI/CD, Git, pytest
 * Excellent communication and technical documentation skills
 * Consulting/project delivery experience