> Markdown version of [/jobs/ext/2568776-senior-data-engineer-azure-databricks](https://www.wearedevelopers.com/jobs/ext/2568776-senior-data-engineer-azure-databricks). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer (Azure Databricks)

- **Company:** UST Inc
- **Location:** Alpharetta, GA, United States
- **Experience:** Expert
- **Salary:** $92,000.0 - $138,000.0
- **Contract:** Temporary contract
- **Skills:** Airflow, Performance Tuning, Power BI, Data Streaming, Azure Service Bus, Apache Spark, Apache Kafka, Terraform, Databricks
- **Published:** August 21, 2026
- **Apply:** https://diversityjobs.com/main/sendform/8/8/28176/1/18019769?backUrl=%2Fcareer%2F18019769%2FSenior-Data-Engineer-Azure-Databricks-Georgia-Alpharetta

## About the Role

* 5+ years building batch and/or streaming pipelines with Spark

 * (Nice to have) Performance tuning: broadcast joins, AQE, skew mitigation, shuffle optimization

 * (Nice to have) Structured Streaming and Auto Loader for incremental ingestion

 * (Nice to have) OPTIMIZE, Z ORDER, VACUUM and retention policies

 * (Nice to have) Compaction and small files mitigation strategies

 * Nice to have (optional)

 * Scala, dbt, Kafka/Event Hubs, ADF/Airflow, Terraform, Power BI, data mesh concepts, SCD patterns

 * Total experience: 8+ years



## Related Videos

- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Infrastructure as Code: The Developer's Secret Weapon](https://www.wearedevelopers.com/videos/1221-infrastructure-as-code-the-developer-s-secret-weapon)
- [Beyond Dashboards: Fixing Text-to-SQL with Semantic RAG](https://www.wearedevelopers.com/videos/2036-beyond-dashboards-fixing-text-to-sql-with-semantic-rag)
- [Data Analytics with Microsoft Fabric: End-to-End Use Case with Data Agents](https://www.wearedevelopers.com/videos/1547-data-analytics-with-microsoft-fabric-end-to-end-use-case-with-data-agents)
- [Implementing Feature Environments with AWS and Terraform](https://www.wearedevelopers.com/videos/531-implementing-feature-environments-with-aws-and-terraform)

## Related Articles

- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)