Data Engineer Lead

TechDigital Corporation
Fremont, CA, United States
1 day ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours

Tech stack

Microsoft Azure Continuous Integration Data Governance Data Systems Python (Programming Language) Microsoft Software SQL Azure Power BI Reduced Instruction Set Computing SQL Databases Data Streaming Management of Software Versions
+10 more
Scripting Azure Data Factory Apache Spark Microsoft Fabric Data Lakes Apache Kafka Data Management Terraform Azure Synapse Analytics Databricks

Job description

  • Design and implementation of enterprise-grade data solutions using Azure and Microsoft Fabric.
  • Design and implement data Lakehouse Solutions leveraging OneLake, Delta Lake, and Direct Lake mode in Power BI.
  • Define and enforce data engineering best practices, including CI/CD, versioning, testing, and monitoring.
  • Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to translate business needs into technical solutions.
  • Drive data governance, security, and compliance across all data assets.
  • Mentor and guide data engineers, fostering a culture of innovation and excellence.
  • Evaluate and integrate new tools and technologies to enhance data capabilities.
  • Own the data lifecycle, from ingestion and transformation to consumption and visualization

Requirements

Microsoft Product Family, Microsoft Windows Azure, Hubs, ARM (Advanced RISC Machine), SQL (Structured Query Language), Python Programming/Scripting Language, Power BI, Best Practices, Testing, Continuous Integration, * Microsoft Fabric.

  • Microsoft Azure: Azure Data Factory, Azure Synapse, Azure Databricks, Azure SQL, Event Hub
  • Data streaming (e.g., Azure Event Hubs, Kafka)
  • infrastructure-as-code (e.g., Terraform, ARM templates)
  • SQL, Python, and Spark.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…