Lead Data Engineer - Databricks
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+6 more
Job description
We are seeking an experienced Lead Data Engineer to design and implement scalable, secure, and high-performance data lakehouse solutions. The ideal candidate should have strong expertise in Databricks, Medallion Architecture, Azure/AWS cloud platforms, SQL, PySpark, Python, and Databricks Auto Loader.
Requirements
-
Strong experience with Databricks architecture and Lakehouse solutions. \n
-
Hands-on expertise in Medallion Architecture. \n
-
Proficiency in SQL, PySpark, and Python. \n
-
Practical experience with Databricks Auto Loader. \n
-
Experience with Azure Databricks or AWS Databricks. \n
-
Strong understanding of Apache Spark, Delta Lake, and ETL/ELT pipelines. \n
-
Experience in data pipeline optimization and production-grade data engineering. \n
-
Knowledge of data governance, security, and scalable architecture design. \n
-
Strong communication, analytical, and problem-solving skills. \n, * Databricks certification preferred. \n
-
Experience with Unity Catalog and data governance. \n
-
Knowledge of Delta Live Tables (DLT) or Lakeflow Declarative Pipelines. \n
-
Experience with CI/CD, Git, and infrastructure-as-code tools. \n
-
Experience with cloud migration and enterprise data platform modernization. \n
-
Previous experience leading technical teams or defining data architecture standards.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦