Databricks/Spark Data Engineer

Javen Technologies, Inc
Chicago, United States of America
yesterday

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate

Job location

Chicago, United States of America

Tech stack

Agile Methodologies
Airflow
Amazon Web Services (AWS)
Azure
Cloud Computing
Data Architecture
Information Engineering
Data Governance
ETL
Standard Sql
SQL Databases
Data Streaming
Feature Engineering
Spark
Data Lake
PySpark
Collibra
Data Management
Machine Learning Operations
Data Pipelines
Databricks
Control M

Requirements

  • 3+ years of experience in data engineering, data platforms, or related roles
  • Hands-on experience with Databricks, Apache Spark (PySpark), and Delta Lake
  • Strong SQL and data modeling skills (relational and dimensional)
  • Experience building and supporting data pipelines in a cloud environment (AWS or Azure)
  • Experience with ELT/ETL tools (e.g., Fivetran, custom ingestion frameworks)
  • Familiarity with data orchestration tools (Airflow, Control-M)
  • Experience working in Agile development environments

Preferred Qualifications:

  • Experience in financial services or regulated environments (e.g., banking, risk, regulatory reporting)
  • Knowledge of data governance frameworks and tools (e.g., Collibra)
  • Experience with real-time or streaming data pipelines
  • Exposure to machine learning pipelines and feature engineering in Databricks
  • Cloud certifications (AWS, Azure, or Databricks)

Technical Skills:

  • Databricks (Lakehouse architecture, notebooks, jobs, Unity Catalog)
  • Spark / PySpark
  • SQL (advanced querying and optimization)

Apply for this position