> Markdown version of [/jobs/ext/2572728-databricks-developer](https://www.wearedevelopers.com/jobs/ext/2572728-databricks-developer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Databricks Developer - **Company:** Laiba Technologies LLC - **Location:** Columbus, OH, United States - **Contract:** Permanent contract - **Skills:** Agile Methodology, Airflow, Amazon Web Services, Business Analytics Applications, Microsoft Azure, Cloud Database, Continuous Integration, Information Engineering, Data Governance, Extract Transform Load (ETL), Data Transformation, Apache Hive, Python (Programming Language), Standard Sql, SQL Databases, Data Streaming, Data Logging, Data Processing, Google Cloud, Azure Data Factory, Apache Spark, Caching, Git, Data Lakes, Pyspark, Deployment Automation, Apache Kafka, Machine Learning Operations, Stream Processing, Data Pipelines, Databricks - **Published:** August 18, 2026 - **Apply:** https://www.dice.com/job-detail/d2c1529f-4437-4ec7-b734-4038da60198f ## About the Role * Strong hands-on experience with Databricks * Strong Python programming skills * Strong in communication and proactive. * Expertise in Apache Spark, PySpark, and Spark SQL- Strong SQL and data transformation skills * Experience with Delta Lake and lakehouse concepts- Knowledge of ETL/ELT and data pipeline design * Experience with AWS, Azure, or Google Cloud Platform- Familiarity with Git, CI/CD, and Agile practices * Good problem-solving and communication skills Preferred Skills:- * Experience with Airflow, Azure Data Factory, or Databricks Workflows * Knowledge of Kafka or streaming frameworks * Experience with MLflow or analytics platforms * Understanding of data governance and security best practices ## Description Summary: We are looking for a Lead Databricks Developer with strong experience in Python and Apache Spark to design, develop, and optimize scalable data pipelines and cloud-based data solutions. The ideal candidate will have hands-on expertise in Databricks, PySpark, SQL, and modern data engineering practices., Design, develop, and maintain ETL/ELT pipelines using Databricks and PySpark- Build scalable batch and real-time data processing solutions using Apache Spark- Develop data transformation workflows using Python, PySpark, and Spark SQL- Implement Delta Lake solutions and optimize data processing performance- Create and manage Databricks notebooks, jobs, and workflows- Ensure data quality, validation, logging, and exception handling- Optimize Spark performance using partitioning, caching, and tuning techniques- Collaborate with cross-functional teams to gather requirements and deliver solutions- Support CI/CD, deployment automation, and production releases- Troubleshoot and resolve issues in data pipelines and platform processes ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Dev Digest 162: AI careers, MCP, AWS best practices & floppy sweaters](https://www.wearedevelopers.com/magazine/571-dev-digest-162-ai-careers-mcp-aws-best-practices-floppy-sweaters)