WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Back

Azure Databricks / Python Data Engineer

Rapsys Technologies
Fort Worth, United States
4 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
www.dice.com

Tech stack

Agile Methodology Continuous Integration Information Engineering Extract Transform Load (ETL) Data Warehousing Apache Hive Key Management PostgreSQL NoSQL Redis Azure Data Lake Software Engineering
+13 more
SQL Databases Data Ingestion Azure Data Factory GitHub Copilot Generative AI Data Lakes Pyspark Kubernetes Restful APIs Stream Processing Azure Synapse Analytics Data Pipelines Databricks

Requirements

  • Strong Azure Databricks
  • Advanced Python development
  • PySpark & Spark SQL
  • Delta Lake & ADLS Gen2
  • Strong ETL/ELT & Data Engineering experience
  • Azure Data Factory (ADF)
  • SQL & data pipeline development
  • Data ingestion, quality, validation & governance
  • Databricks job, cluster & workflow optimization
  • Batch & near real-time data processing
  • Hands-on experience with GenAI tools such as GitHub Copilot
  • Strong software design, testing & CI/CD experience
  • Git / GitHub Actions & Agile

Additional Skills Azure Key Vault | Azure Monitor | App Insights | Data Modeling | Data Warehousing | Azure Synapse | PostgreSQL | Kubernetes | Redis | REST APIs | NoSQL

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

Moments

Explore playlists

3:33 min

Refactoring data science workflows using Rapids QDF and Pandas

Paul Graham Paul Graham · LIVE

2:37 min

Comparing traditional SQL tables versus NoSQL non-tabular databases

Stanimira Vlaeva · JS Congress

3:55 min

Demonstrating semantic routing thresholds with the Redis vector library

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:05 min

Enhancing Databricks tooling for software engineering workflows

Alan Mazankiewicz · LIVE

3:16 min

Terminology differences between relational and NoSQL databases

Tim Faulkes · LIVE

Videos

See all
PySpark - Combining Machine Learning & Big Data thumbnail
43:26
LIVE • almost 6 years ago

PySpark - Combining Machine Learning & Big Data

Ayon Roy

Leveraging Real time data in FSIs thumbnail
41:51
LIVE • almost 3 years ago

Leveraging Real time data in FSIs

Tim Faulkes

Reducing LLM Calls with Vector Search Patterns - Raphael De Lio (Redis) thumbnail
34:39
about 1 year ago

Reducing LLM Calls with Vector Search Patterns - Raphael De Lio (Redis)

Fully Orchestrating Databricks from Airflow thumbnail
39:14
LIVE • almost 5 years ago

Fully Orchestrating Databricks from Airflow

Alan Mazankiewicz

Data Science in Retail thumbnail
58:21
LIVE • over 3 years ago

Data Science in Retail

Julian Joseph

Empowering Retail Through Applied Machine Learning thumbnail
22:41
World Congress 2024 • about 2 years ago

Empowering Retail Through Applied Machine Learning

Christoph Fassbach, Daniel Rohr

Related articles

See all