TELECOMMUTE Lead Data Engineer / Architect

Cleo Consulting

United States

2 months ago

Role details

Contract type

Temporary contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

8 years minimum

Working hours

Regular working hours

Job source

dice.com

Tech stack

Amazon Web Services Microsoft Azure Big Data Cloud Computing Data Architecture Data Infrastructure Data Structures Performance Tuning SQL Databases Google Cloud Sql Optimization Apache Spark

+4 more

Data Lakes Pyspark Data Pipelines Databricks

Job description

We are seeking a high-caliber Lead Data Engineer / Architect to take ownership of designing and scaling our enterprise Lakehouse architecture on Databricks. In this role, you will drive data platform standards, lead engineering decisions, optimize performance/costs, and mentor engineering teams., * Architecture & Scaling: Design, build, and scale production-grade enterprise Lakehouse architectures on Databricks.
Data Modeling: Implement robust data modeling strategies across cloud platforms using the Medallion Architecture (Bronze, Silver, Gold).
Leadership & Standards: Drive data platform engineering standards, make critical technical decisions, and mentor engineering teams.
Optimization: Manage and execute end-to-end performance tuning and cost optimization strategies in Spark and Databricks environments.

Requirements

Databricks & Spark: Deep expertise in Databricks, Apache Spark (PySpark / Scala), and Delta Lake.
Data Pipelines: Proven track record building large-scale data processing workflows and enterprise data pipelines.
Cloud Infrastructure: Strong hands-on experience with major cloud platforms (Azure, AWS, or Google Cloud Platform).
Advanced SQL: Exceptional SQL capability for processing complex, massive-scale data structures., * If you meet the 14+ years experience criteria and have deep Databricks expertise, please shoot your updated resume directly to