TELECOMMUTE Databricks Developer

Shiro Technologies

United States

2 days ago

Apply on www.dice.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

8 years minimum

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Agile Methodology Microsoft Azure Big Data Cloud Computing Security Continuous Integration Information Engineering Data Governance Extract Transform Load (ETL) Distributed Data Store Github Python (Programming Language) Performance Tuning

+12 more

Azure Data Lake Software Engineering SQL Databases Data Processing Freeform SQL Azure Data Factory Apache Spark Data Lakes Information Technology Software Version Control Data Pipelines Databricks

Job description

Design, develop, and maintain scalable data pipelines and ETL workflows using Databricks.

Build and optimize Delta Lake architectures and data models.

Develop high-quality, reusable Python code for data processing and automation.

Write and optimize complex SQL queries for large datasets.

Implement and manage solutions on Microsoft Azure, including Azure Data Lake, Azure Data Factory, and related services.

Collaborate with data engineers, analysts, and business stakeholders to understand requirements and deliver high-quality solutions.

Ensure data quality, reliability, and performance across all data pipelines.

Troubleshoot production issues and perform root-cause analysis.

Follow best practices for version control, CI/CD, and cloud security.

Requirements

We are seeking an experienced Mid-Senior Databricks Developer with 8-10+ years of industry experience to design, develop, and optimize large-scale data solutions. The ideal candidate will have strong expertise in Databricks, Python, SQL, and Microsoft Azure cloud services.

A minimum of a Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field is required., Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.

8-10+ years of experience in data engineering or software development.

Strong hands-on experience with Databricks, including notebooks, jobs, clusters, and Delta Lake.

Advanced proficiency in Python for data engineering.

Strong expertise in SQL, including performance tuning.

Solid experience with Microsoft Azure cloud services.

Experience working with large-scale distributed data systems.

Strong problem-solving skills and ability to work independently.

Preferred Skills

Experience with CI/CD tools such as Azure DevOps and GitHub Actions.

Knowledge of Spark performance optimization.

Experience with data governance and security frameworks.

Familiarity with Agile methodologies.