> Markdown version of [/jobs/ext/2028467-data-engineer](https://www.wearedevelopers.com/jobs/ext/2028467-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer

- **Company:** TechniPros, LLC
- **Location:** Madison, WI, United States (Remote available)
- **Contract:** Permanent contract
- **Skills:** Microsoft Azure, Big Data, Cloud Database, Computer Programming, Data Architecture, Data Integration, Extract Transform Load (ETL), Data Warehousing, DevOps, Apache Hive, Performance Tuning, SQL Databases, Cloud Platform System, Azure Data Factory, Database Optimization, Data Lakes, Pyspark, Azure Synapse Analytics, Data Pipelines, Databricks
- **Published:** August 11, 2026
- **Apply:** https://www.dice.com/job-detail/ae1cc9cd-2aad-4d3d-9a7a-bf2cb221ed23

## About the Role

* Strong experience in PySpark.
 * Hands-on experience with Microsoft Azure.
 * Expertise in Azure Data Factory (ADF).
 * Strong knowledge of ETL/ELT development.
 * Experience designing scalable data pipelines.
 * Strong SQL programming and database optimization skills.
 * Experience with Data Warehousing concepts and implementation.
 * Experience in data integration and performance tuning.
 * Knowledge of cloud-based data engineering best practice.

Preferred Skills:

 * Experience with Azure Databricks.
 * Knowledge of Delta Lake, Spark SQL, and Azure Synapse Analytics.
 * Familiarity with CI/CD pipelines and DevOps practices.
 * Experience working in Agile/Scrum environments.

## Description

We are looking for a skilled Data Engineer to join our team . The ideal candidate will have strong experience in PySpark, Microsoft Azure, Azure Data Factory (ADF), SQL, and Data Warehousing. This role focuses on designing scalable data pipelines, building enterprise ETL/ELT solutions, and delivering high-quality data integration across cloud-based platforms., * Design, develop, and optimize scalable data pipelines.

 * Build, maintain, and enhance ETL/ELT workflows using Azure Data Factory (ADF).
 * Process, transform, and optimize large datasets using PySpark.
 * Develop efficient data integration solutions across multiple enterprise systems.
 * Create scalable and reliable cloud-based data engineering solutions on Microsoft Azure.
 * Optimize SQL queries, data warehouse performance, and data processing workflows.
 * Ensure data quality, reliability, consistency, and governance.
 * Troubleshoot production issues and optimize pipeline performance.
 * Collaborate with cross-functional teams including business analysts, data scientists, and application developers.
 * Support continuous improvements in data architecture and engineering best practices.


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)