Principal Data Engineer - Azure Databricks

Flexton Inc
Milpitas, United States of America
3 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Milpitas, United States of America

Tech stack

Data analysis
Data Architecture
Information Engineering
ETL
Data Transformation
Distributed Computing Environment
Hive
Python
Azure
Enterprise Data Management
Data Ingestion
Azure
Data Lake
PySpark
Data Lakehouse
Databricks

Job description

Seeking a highly skilled Principal Azure Data Engineer to lead the design, architecture, and delivery of enterprise-scale Data Lakehouse solutions on Azure Databricks. This is a senior-level role within the Analytics organization, responsible for building scalable and secure analytics platforms by ingesting data from multiple enterprise systems, transforming it into trusted and governed data products, and enabling business-critical analytics across Procurement, Vendor Management, and Inventory domains.

Requirements

The ideal candidate will possess deep hands-on engineering expertise, strong business domain knowledge, and proven technical program management capabilities to drive complex cross-functional initiatives., * 10+ years of experience in data engineering, analytics engineering, or enterprise data platforms.

  • Strong hands-on experience with Azure Databricks and modern cloud data architectures.
  • Expertise in data ingestion, data transformation, and enterprise analytics solutions.
  • Strong expertise in PySpark, Spark SQL, and Delta Lake.
  • Proven experience designing and implementing enterprise-scale Data Lakehouse architectures.
  • Strong experience building and managing data products with embedded governance and security.
  • Hands-on expertise with:
  • Azure Databricks
  • PySpark
  • Spark SQL
  • Python
  • Delta Lake
  • Data Lakehouse architecture
  • Azure Data Factory
  • Azure Data Lake Storage (ADLS)
  • Strong understanding of data modeling, ETL/ELT, and distributed data processing.
  • Experience working with procurement, inventory, vendor support, or supply chain analytics domains.
  • Domain knowledge in Procurement, Supply Chain, or Inventory Management.
  • Experience managing cross-functional delivery in an agile environment.
  • Excellent communication and stakeholder management skills, with the ability to present technical solutions and program updates to senior leadership and business stakeholders.

Apply for this position