TELECOMMUTE Lead Data Engineer / Architect
Cleo Consulting
yesterday
Role details
Contract type
Temporary contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Remote
Tech stack
Amazon Web Services (AWS)
Azure
Big Data
Cloud Computing
Data Architecture
Data Infrastructure
Data Structures
Performance Tuning
SQL Databases
Google Cloud Platform
Sql Optimization
Spark
Data Lake
PySpark
Data Pipelines
Databricks
Job description
- We are seeking a high-caliber Lead Data Engineer / Architect to take ownership of designing and scaling our enterprise Lakehouse architecture on Databricks. In this role, you will drive data platform standards, lead engineering decisions, optimize performance/costs, and mentor engineering teams., * Architecture & Scaling: Design, build, and scale production-grade enterprise Lakehouse architectures on Databricks.
- Data Modeling: Implement robust data modeling strategies across cloud platforms using the Medallion Architecture (Bronze, Silver, Gold).
- Leadership & Standards: Drive data platform engineering standards, make critical technical decisions, and mentor engineering teams.
- Optimization: Manage and execute end-to-end performance tuning and cost optimization strategies in Spark and Databricks environments.
Requirements
- Databricks & Spark: Deep expertise in Databricks, Apache Spark (PySpark / Scala), and Delta Lake.
- Data Pipelines: Proven track record building large-scale data processing workflows and enterprise data pipelines.
- Cloud Infrastructure: Strong hands-on experience with major cloud platforms (Azure, AWS, or Google Cloud Platform).
- Advanced SQL: Exceptional SQL capability for processing complex, massive-scale data structures., * If you meet the 14+ years experience criteria and have deep Databricks expertise, please shoot your updated resume directly to