Data Engineer - Databricks/PySpark
Smart IT Frame
New York, NY, United States
29 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
4 years minimum
Working hours
Regular working hours
Job source
Tech stack
Amazon Web Services
Amazon S3
BigQuery
Continuous Integration
Information Engineering
Extract Transform Load (ETL)
Python (Programming Language)
SQL Databases
Google Cloud
Apache Spark
Git
Pytest
+4 more
Data Lakes
Pyspark
Data Pipelines
Databricks
Requirements
- 7+ years of Data Engineering experience
- 4+ years hands-on with Databricks & Spark/PySpark
- Strong Python, SQL, Delta Lake
- Experience with AWS (S3, Glue) and Google Cloud Platform (BigQuery, GCS)
- Strong ETL/ELT, Spark optimization & data pipeline development
- Experience with CI/CD, Git, pytest
- Excellent communication and technical documentation skills
- Consulting/project delivery experience
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦