> Markdown version of [/jobs/ext/1754847-databricks-engineer](https://www.wearedevelopers.com/jobs/ext/1754847-databricks-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# DataBricks Engineer

- **Company:** Elite
- **Location:** Plano, TX, United States
- **Contract:** Permanent contract
- **Skills:** Big Data, Databases, Continuous Integration, Data Architecture, Data Validation, Information Engineering, Data Governance, Extract Transform Load (ETL), Data Transformation, Data Warehousing, Apache Hadoop, Apache Hive, Performance Tuning, Role-Based Access Control, SQL Databases, Grafana, Apache Spark, Data Lakes, Pyspark, Infrastructure Automation Frameworks, Data Lineage, Data Management, Data Pipelines, Amazon Elastic Mapreduce (EMR), Legacy Systems, Databricks
- **Published:** July 21, 2026
- **Apply:** https://www.dice.com/job-detail/6eeb39a2-e867-42bb-90cb-d45b6a5c51fc

## About the Role

* Databricks & Data Engineering Strong experience with Databricks Lakehouse Platform.
 * Hands-on experience with Delta Lake, Medallion Architecture, and Databric Expertise in PySpark and Spark SQL.
 * Experience working with large-scale data processing and performance tuning Unity Catalog Strong understanding of: Unity Catalog setup and administration.
 * Strong understanding of Unity Catalog setup and administration Fine-grained access control (RBAC). Data lineage and audit capabilities.
 * Data governance and security implementation.
 * Spark Declarative Pipelines (SDP) Hands-on experience implementing and maintaining SDP pipelines.
 * Knowledge of pipeline orchestration, monitoring, and optimization.
 * Experience building reusable and scalable data transformation framework Data Validation & Quality Experience designing and implementing data validation frameworks.
 * Data reconciliation between source and target systems. Validation of migrated datasets to ensure accuracy and completeness.
 * Experience with data quality monitoring and observability tools.
 * Migration Experience Proven experience in migratingPySparkworkloads from AWS EMR to Databricks.
 * Mive-based ETL jobs to Databricks. Legacy data warehouses and Hadoop ecosystems to Databricks.

## Description

We are seeking an experienced Databricks Engineer with strong expertise in migration of PySpark/Hive workloads from AWS EMR or legacy platforms data platforms while ensuring data quality, security, and scalability, * Design, develop, and maintain scalable data pipelines using Databricks Implement and manage Unity Catalog for centralized data governanance

 * Develop and optimize Spark Declarative Pipelines (SDP) and moderatePerform end-to-end data validation, reconciliation, and quality assurance.
 * Lead migration projects involving:
 * PySpark jobs from AWS EMR to Databricks Hive-based ETL workloads to Databricks and Delta Lake.
 * Legacy data platforms to Databricks Lakehouse architecture.
 * Convert and optimize Hive SQL, Spark SQL, and PySpark workloads forImple and automation for validation and PySparkjobs from AWS EMR to Databricks.
 * Hive-based ETL workloads to Databricks and Delta Lake.
 * Legacy data platforms to Databricks Lakehouse architecture.
 * Convert and optimize Hive SQL, Spark SQL, and PySpark workloads for Database Implement data quality frameworks and automation for validation and reconcilation Work closely with architects, business stakeholders, and data consumers to | Optimize Databricks jobs for performance, reliability, and cost efficiency.
 * Manage CI/CD processes and infrastructure automation for Databricks deplo Ensure compliance with enterprise data security, governance.


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [5 steps for running a Kubernetes environment at scale](https://www.wearedevelopers.com/videos/88-5-steps-for-running-a-kubernetes-environment-at-scale)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)