Principal Data Engineer
Mountain LTD
Houston, TX, United States
5 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
Tech stack
Artificial Intelligence
Microsoft Azure
Cloud Computing
Data Governance
Extract Transform Load (ETL)
Data Transformation
Apache Hadoop
Apache Hive
Python (Programming Language)
Meta-Data Management
Power BI
Azure Data Lake
+13 more
Data Streaming
Qliksense
Azure Data Factory
Sql Optimization
Apache Spark
Data Lakes
Information Technology
Qlikview
Apache Kafka
Cloud Migration
Stream Analytics
Data Pipelines
Databricks
Job description
- Lead delivery of data analytics solutions with emphasis on Azure data lake architecture, Databricks engineering, governance, and operational performance in a high-volume environment.
- Architect and implement scalable Azure-based data lake solutions.
- Establish roadmaps across Qlik Replicate, Databricks Delta Live Tables, and Unity Catalog.
- Lead data transformation pipelines using Delta Live Tables and Structured Streaming.
- Optimize Databricks resources for performance and cost.
- Use Unity Catalog for governance, lineage, and metadata management.
- Establish data governance, security, and quality policies; monitor production pipeline performance.
- Mentor teams and translate technical challenges into executive-level actions.
Requirements
- 15-17 years IT experience with cloud-based analytics delivery.
- Proficiency in Azure: ADF, ADLS, Databricks, Stream Analytics, Delta Live Tables, Synapse.
- Advanced SQL plus Python, Scala, or Spark SQL.
- Experience with scalable ETL pipelines, data workflow optimization, and cloud migration.
- Azure Data Engineering or Databricks certification preferred.
- Nice to have: Hadoop, Kafka, Spark, Power BI/QlikSense, AI/ML/NLP/GenAI
About the company
System One, and its subsidiaries including Mountain Ltd., are leaders in delivering outsourced services and workforce solutions across North America. We help clients get work done more efficiently and economically, without compromising quality. System One not only serves as a valued partner for our clients, but we offer eligible employees health and welfare benefits coverage options including medical, dental, vision, spending accounts, life insurance, voluntary plans, as well as participation in a 401(k) plan.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.dice.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦