Azure Databricks Engineer

eTek IT Services, Inc.
New York, United States
3 months ago
Apply on dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Airflow Amazon Web Services Amazon S3 Microsoft Azure BigQuery Data as a Services Information Engineering Extract Transform Load (ETL) Python (Programming Language) Cloud Services SQL Databases Google Cloud
+9 more
Snowflake Apache Spark Containerization Pyspark Git Flow Kubernetes Apache Kafka Docker Databricks

Requirements

  • 12+ years of professional data engineering experience.
  • Strong Python, SQL, and Spark (PySpark) skills, and/or Kafka.
  • Snowflake (Snowpipe, Tasks, Streams) as a complementary warehouse.
  • Databricks (Delta formats, workflows, cataloging) or equivalent Spark platforms.
  • Hands-on experience building ETL/ELT with Prefect (or Airflow), dbt, Spark, and/or Kafka.
  • Experience onboarding datasets to cloud data platforms (storage, compute, security, governance).
  • Familiarity with Azure/AWS/Google Cloud Platform data services (e.g., S3/ADLSS; Redshift/BigQuery; Glue/ADF).
  • Git-based workflows CI/CD and containerization with Docker (Kubernetes a plus).

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dice.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · World Congress 2025

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · World Congress 2024

Videos

See all

Related articles

See all