Lead Data Engineer - Databricks

CELEBAL TECHNOLOGIES AMERICAS, INC.
Grand Rapids, MI, United States
2 days ago
Apply on www.thejobnetwork.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours

Tech stack

Amazon Web Services Microsoft Azure Continuous Integration Data Architecture Information Engineering Data Governance Extract Transform Load (ETL) Python (Programming Language) SQL Databases Enterprise Data Management Apache Spark Git
+6 more
Data Lakes Pyspark Infrastructure Automation Frameworks Cloud Migration Data Pipelines Databricks

Job description

We are seeking an experienced Lead Data Engineer to design and implement scalable, secure, and high-performance data lakehouse solutions. The ideal candidate should have strong expertise in Databricks, Medallion Architecture, Azure/AWS cloud platforms, SQL, PySpark, Python, and Databricks Auto Loader.

Requirements

  • Strong experience with Databricks architecture and Lakehouse solutions. \n

  • Hands-on expertise in Medallion Architecture. \n

  • Proficiency in SQL, PySpark, and Python. \n

  • Practical experience with Databricks Auto Loader. \n

  • Experience with Azure Databricks or AWS Databricks. \n

  • Strong understanding of Apache Spark, Delta Lake, and ETL/ELT pipelines. \n

  • Experience in data pipeline optimization and production-grade data engineering. \n

  • Knowledge of data governance, security, and scalable architecture design. \n

  • Strong communication, analytical, and problem-solving skills. \n, * Databricks certification preferred. \n

  • Experience with Unity Catalog and data governance. \n

  • Knowledge of Delta Live Tables (DLT) or Lakeflow Declarative Pipelines. \n

  • Experience with CI/CD, Git, and infrastructure-as-code tools. \n

  • Experience with cloud migration and enterprise data platform modernization. \n

  • Previous experience leading technical teams or defining data architecture standards.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.thejobnetwork.com
Prepare application

Good distractions

Loading talks and stories from around this role…