DATA ENGINEER
TechniPros, LLC
Overland Park, KS, United States
3 months ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
Tech stack
Microsoft Azure
Data Deduplication
Data Governance
Data Security
Data Warehousing
Performance Tuning
Query Optimization
Standard Sql
Data Processing
Snowflake
Apache Spark
Pyspark
+3 more
Data Lineage
Data Pipelines
Databricks
Job description
We are looking for a skilled Data Engineer with strong experience in Azure, Databricks, and Snowflake. The candidate will be responsible for building and maintaining scalable data pipelines, optimizing data processing, and ensuring data quality and governance across enterprise platforms., * Design, develop, and maintain large-scale data pipelines using Azure and Databricks.
- Work with Snowflake for data warehousing and data modeling.
- Develop and optimize PySpark and Spark-based data processing solutions.
- Ensure pipeline reliability through validation, deduplication, backfills, and idempotency handling.
- Implement data governance, PII handling, data lineage, and Unity Catalog standards.
- Perform performance tuning, troubleshooting, and optimization for Spark workloads.
- Collaborate with cross-functional teams to support scalable and secure data solutions.
- Monitor and improve data quality, compliance, and operational efficiency.
Requirements
- Strong experience with Azure services such as ADF and ADLS.
- Hands-on experience with Databricks, PySpark, and Spark optimization.
- Strong Snowflake experience including data modeling and warehousing.
- Excellent SQL coding and query optimization skills.
- Experience building scalable and governed enterprise data pipelines.
- Knowledge of data governance and pipeline monitoring.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on dice.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
BB
Benedikt Bischof
about 4 years ago
DS
Dhannush Subramani
Top Big Data Technologies That You Need to Know
about 4 years ago
AJ
Austin Joy
What Are The Top Skills Required For Azure Developers?
over 4 years ago
EM
Eli McGarvie
Data Engineer Salary UK
about 3 years ago
EM
Eli McGarvie
Highest Paying Tech Companies for Developers
over 3 years ago
CH
Chris Heilmann
Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production
almost 2 years ago