> Markdown version of [/jobs/ext/2442736-sr-data-engineer](https://www.wearedevelopers.com/jobs/ext/2442736-sr-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Sr. Data Engineer

- **Company:** Sunbelt Rentals Inc
- **Location:** Fort Mill, SC, United States
- **Experience:** Expert
- **Salary:** $130,315.0 - $179,183.0
- **Contract:** Permanent contract
- **Skills:** Microsoft Azure, Cloud Computing, Code Review, Information Engineering, Data Governance, Data Infrastructure, Data Transformation, Python (Programming Language), Key Management, Pair Programming, DataOps, SQL Databases, Data Streaming, Azure Service Bus, Azure Data Factory, Apache Spark, Data Lakes, Information Technology, Apache Kafka, Machine Learning Operations, Databricks
- **Published:** August 20, 2026
- **Apply:** https://diversityjobs.com/main/sendform/8/8/28176/1/18007710?backUrl=%2Fcareer%2F18007710%2FSr-Data-Engineer-South-Carolina-Fort-Mill

## About the Role

* 5+ years of data engineering experience, with at least 2 years working extensively with Databricks
 * Strong proficiency in Python and SQL, with experience writing production-grade Spark code
 * Hands-on experience building and managing Kafka-based streaming pipelines
 * Deep familiarity with Delta Lake, Delta Live Tables, and the Databricks ecosystem (Unity Catalog, Workflows, MLflow)
 * Experience with IoT data patterns - high-frequency telemetry ingestion, device state management, time-series data
 * Solid understanding of cloud infrastructure (Azure preferred) and infrastructure-as-code concepts
 * Strong communication skills with the ability to lead technical discussions and translate requirements into architecture

Preferred Qualifications

 * Experience with Geotab or similar fleet telematics platforms
 * Databricks Certified Data Engineer Associate or Professional certification
 * Familiarity with Azure Key Vault, Event Hubs, or Azure Data Factory
 * Experience with dbt for data transformation
 * Bachelor's degree in computer science, Information Technology, Data Engineering, or equivalent experience.

## Description

* Design, build, and maintain end-to-end IoT data pipelines from edge devices into Databricks using the medallion architecture (Bronze/Silver/Gold)
 * Lead the development and optimization of streaming ingestion pipelines using Apache Kafka and Databricks Structured Streaming
 * Define and enforce data engineering best practices, including pipeline design patterns, data quality frameworks, and schema governance
 * Architect and manage Delta Lake tables, including partitioning strategies, Z-ordering, and vacuuming for performance and cost efficiency
 * Collaborate with infrastructure and cloud teams to configure and manage Databricks clusters, Unity Catalog, and Delta Live Tables
 * Mentor junior and mid-level data engineers through code reviews, pair programming, and technical guidance
 * Partner with data scientists and analysts to ensure processed data meets downstream analytical and ML requirements
 * Troubleshoot production pipeline failures and drive root cause analysis and resolution
 * Evaluate and introduce new tools and technologies to continuously improve the data platform


## Related Videos

- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source)
- [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads)
- [Enabling intelligent logistics automation: home-grown Industrial IoT platform at Austrian Post](https://www.wearedevelopers.com/videos/2018-enabling-intelligent-logistics-automation-home-grown-industrial-iot-platform-at-austrian-post)
- [Tracking vehicles at scale](https://www.wearedevelopers.com/videos/1999-tracking-vehicles-at-scale)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)