Senior Data Engineer - Databricks

Robotics Technologies LLC
Madison, WI, United States
5 days ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

Unity 3d Amazon Web Services Microsoft Azure Cloud Computing Extract Transform Load (ETL) Data Warehousing Python (Programming Language) Standard Sql SQL Databases Data Processing Apache Spark Data Lakes
+4 more
Pyspark Data Pipelines Sql Tuning Databricks

Job description

We are looking for an experienced Data Engineer with expertise in Databricks, PySpark, Python, SQL, and cloud technologies to build and maintain scalable data pipelines and ETL/ELT solutions., * Develop data pipelines using Databricks and PySpark.

  • Build ETL/ELT workflows using Python and SQL.
  • Work with Apache Spark, Delta Lake, and Unity Catalog.
  • Integrate data from multiple sources.
  • Optimize data processing and SQL performance.
  • Implement data quality and validation processes.
  • Work with AWS, Azure, or GCP cloud platforms.

Requirements

  • Databricks & Apache Spark
  • PySpark & Python
  • SQL
  • ETL/ELT Pipelines
  • Delta Lake & Unity Catalog
  • AWS / Azure / GCP
  • Data Modeling & Data Warehousing

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Loading talks and stories from around this role…