Data Engineer Lead
TechDigital Corporation
Fremont, CA, United States
1 day ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.careerbuilder.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source
Tech stack
Microsoft Azure
Continuous Integration
Data Governance
Data Systems
Python (Programming Language)
Microsoft Software
SQL Azure
Power BI
Reduced Instruction Set Computing
SQL Databases
Data Streaming
Management of Software Versions
+10 more
Scripting
Azure Data Factory
Apache Spark
Microsoft Fabric
Data Lakes
Apache Kafka
Data Management
Terraform
Azure Synapse Analytics
Databricks
Job description
- Design and implementation of enterprise-grade data solutions using Azure and Microsoft Fabric.
- Design and implement data Lakehouse Solutions leveraging OneLake, Delta Lake, and Direct Lake mode in Power BI.
- Define and enforce data engineering best practices, including CI/CD, versioning, testing, and monitoring.
- Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to translate business needs into technical solutions.
- Drive data governance, security, and compliance across all data assets.
- Mentor and guide data engineers, fostering a culture of innovation and excellence.
- Evaluate and integrate new tools and technologies to enhance data capabilities.
- Own the data lifecycle, from ingestion and transformation to consumption and visualization
Requirements
Microsoft Product Family, Microsoft Windows Azure, Hubs, ARM (Advanced RISC Machine), SQL (Structured Query Language), Python Programming/Scripting Language, Power BI, Best Practices, Testing, Continuous Integration, * Microsoft Fabric.
- Microsoft Azure: Azure Data Factory, Azure Synapse, Azure Databricks, Azure SQL, Event Hub
- Data streaming (e.g., Azure Event Hubs, Kafka)
- infrastructure-as-code (e.g., Terraform, ARM templates)
- SQL, Python, and Spark.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.careerbuilder.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦