DATA ENGINEER

TechniPros, LLC
Overland Park, KS, United States
3 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Microsoft Azure Data Deduplication Data Governance Data Security Data Warehousing Performance Tuning Query Optimization Standard Sql Data Processing Snowflake Apache Spark Pyspark
+3 more
Data Lineage Data Pipelines Databricks

Job description

We are looking for a skilled Data Engineer with strong experience in Azure, Databricks, and Snowflake. The candidate will be responsible for building and maintaining scalable data pipelines, optimizing data processing, and ensuring data quality and governance across enterprise platforms., * Design, develop, and maintain large-scale data pipelines using Azure and Databricks.

  • Work with Snowflake for data warehousing and data modeling.
  • Develop and optimize PySpark and Spark-based data processing solutions.
  • Ensure pipeline reliability through validation, deduplication, backfills, and idempotency handling.
  • Implement data governance, PII handling, data lineage, and Unity Catalog standards.
  • Perform performance tuning, troubleshooting, and optimization for Spark workloads.
  • Collaborate with cross-functional teams to support scalable and secure data solutions.
  • Monitor and improve data quality, compliance, and operational efficiency.

Requirements

  • Strong experience with Azure services such as ADF and ADLS.
  • Hands-on experience with Databricks, PySpark, and Spark optimization.
  • Strong Snowflake experience including data modeling and warehousing.
  • Excellent SQL coding and query optimization skills.
  • Experience building scalable and governed enterprise data pipelines.
  • Knowledge of data governance and pipeline monitoring.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dice.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:33 min

Integrating internal APIs and maintaining data sovereignty

Mahran Meißner Mahran Meißner · WWC Europe 2026

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · WWC Europe 2026

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · WWC Europe 2026

2:46 min

Transforming data architecture from on-premise to cloud

Sandhya Menon Sandhya Menon · WWC Europe 2026

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

Videos

See all

Related articles

See all