Data Engineer - Databricks & ADF
Robotics Technologies LLC
Atlanta, GA, United States
6 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.indeed.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
Tech stack
Microsoft Azure
Big Data
Extract Transform Load (ETL)
Data Transformation
Data Mining
Data Warehousing
Python (Programming Language)
Standard Sql
SQL Databases
Data Processing
Azure Data Factory
Data Lakes
+3 more
Pyspark
Data Pipelines
Databricks
Job description
We are looking for a Data Engineer with experience in Databricks and Azure Data Factory (ADF) to develop, maintain, and optimize data pipelines and ETL processes., * Develop and maintain ETL/ELT pipelines using Azure Data Factory (ADF).
- Work with Databricks for data processing and transformation.
- Write and optimize SQL queries for data extraction and transformation.
- Work with PySpark or Python for large-scale data processing.
- Integrate data from multiple sources into data warehouses or data lakes.
- Monitor, troubleshoot, and optimize data pipelines.
- Collaborate with teams to ensure data quality and reliability.
Requirements
- Experience with Databricks and Azure Data Factory (ADF).
- Strong understanding of ETL/ELT concepts.
- Good knowledge of SQL and data transformations.
- Basic experience with Python or PySpark.
- Understanding of Azure cloud services and data lake concepts.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.indeed.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦