> Markdown version of [/jobs/ext/3541883-azure-data-engineer](https://www.wearedevelopers.com/jobs/ext/3541883-azure-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Azure Data Engineer

- **Company:** Concent Software Solution LLC
- **Location:** Dallas, TX, United States
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Microsoft Azure, Code Review, Continuous Integration, Information Engineering, Extract Transform Load (ETL), Data Warehousing, Apache Hive, Python (Programming Language), Key Management, SQL Azure, NoSQL, Performance Tuning, Azure Data Lake, Software Engineering, Unstructured Data, Data Processing, Data Ingestion, Azure Data Factory, GitHub Copilot, Apache Spark, Generative AI, Containerization, Data Lakes, Star Schema, Data Management, Stream Processing, Azure Synapse Analytics, Data Pipelines, Databricks
- **Published:** September 30, 2026
- **Apply:** https://www.dice.com/job-detail/1e690bab-0525-4e7a-bb4a-b0e46abb469e

## About the Role

Primary Skills (Must Have)

Azure Databricks

Python

Py Spark

Delta Lake

Spark SQL

Data Engineering

ETL/ELT Development

Azure Data Lake Storage (ADLS Gen2)

SQL

Azure Platform Skills

Azure Databricks

Azure Data Factory (ADF)

Azure Storage Accounts

Azure Key Vault

Azure Monitor

Azure App Insights

Azure Networking Concepts

Secondary Skills

Data Modeling (Star Schema, Snowflake Schema)

DataWarehousing Concepts

Performance Tuning and Optimization

REST API Integration

NoSQL Databases

Azure Synapse Analytics

Advanced Python development (building production grade services, APIs, or data platforms)
Cloud native development Azure Databricks
Strong experience with software design, testing, and CI/CD pipelines

## Description

Design, develop, and maintain scalable data pipelines using Azure Databricks and Python.

Build and optimize ETL/ELT workflows for structured and unstructured data.

Develop high-performance data processing solutions using Py Spark and Spark SQL.

Design and implement data lake architecture leveraging Delta Lake.

Create and manage data ingestion frameworks from multiple enterprise sources.

Implement data quality, validation, governance, and monitoring mechanisms.

Must have hands on experience using Gen AI tools like GitHub CoPilot

Optimize Databricks jobs, clusters, notebooks, and workflows for performance and cost efficiency.

Collaborate with business analysts, data scientists, architects, and application teams to deliver enterprise data solutions.

Support batch and near real-time data processing requirements.

Participate in architecture discussions, code reviews, and best-practice implementation.

Ensure secure, scalable, and reliable cloud data solutions aligned with organizational standards.


## Related Videos

- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)
- [Fully Orchestrating Databricks from Airflow](https://www.wearedevelopers.com/videos/336-fully-orchestrating-databricks-from-airflow)
- [Hacking MSSQL on Cloud. All of them. How I became sysadmin on Azure, AWS, GCP and Alibaba.](https://www.wearedevelopers.com/videos/100339-hacking-mssql-on-cloud-all-of-them-how-i-became-sysadmin-on-azure-aws-gcp-and-alibaba)
- [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis)
- [Automated MS SQL Server database deployments with dacpacs and Azure DevOps](https://www.wearedevelopers.com/videos/334-automated-ms-sql-server-database-deployments-with-dacpacs-and-azure-devops)
- [Azure-Well Architected Framework - designing mission critical workloads in practice](https://www.wearedevelopers.com/videos/1529-azure-well-architected-framework-designing-mission-critical-workloads-in-practice)

## Related Articles

- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)