> Markdown version of [/jobs/ext/4549334-senior-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/4549334-senior-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior / Lead Data Engineer

- **Company:** HRC Global Services
- **Location:** Dahlonega, GA, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Data Analysis, Application Frameworks, Microsoft Azure, Cloud Engineering, Information Engineering, Data Governance, Extract Transform Load (ETL), Data Systems, Distributed Systems, Industry Standard Architecture, PostgreSQL, Machine Learning, Performance Tuning, Query Optimization, DataOps, SQL Databases, Data Streaming, Data Ingestion, Azure Data Factory, Apache Spark, Git, Data Lakes, Pyspark, Collibra, Real Time Data, Apache Kafka, Data Management, Physical Data Models, Terraform, Data Pipelines, Serverless Computing, Databricks
- **Published:** November 3, 2026
- **Apply:** https://www.thejobnetwork.com/job/c197be7d-bd17-4741-a584-fe9a046af4e5/senior-lead-data-engineer

## About the Role

We are seeking an experienced Senior / Lead Data Engineer with 8+ years of hands-on expertise in building scalable, high-performance data platforms within the Azure ecosystem.

This role is ideal for a technically strong data engineering professional who has deep experience with Azure Databricks, Apache Spark, modern lakehouse architectures, and large-scale data pipelines. You will play a key role in designing end-to-end data solutions, influencing architectural decisions, and ensuring reliable, secure, and high-quality data systems., * 8+ years of hands-on data engineering experience in enterprise environments

 * Strong expertise in Azure Data Platform, including:
 + Azure Databricks
 + Azure Data Factory (preferred)
 + Azure Functions
 * Advanced proficiency in Apache Spark (PySpark)
 * Strong command of SQL, query optimization, and performance tuning
 * In-depth knowledge of ETL/ELT frameworks, orchestration, and scheduling
 * Hands-on experience with Delta Lake (ACID transactions, optimization, schema evolution)
 * Strong background in data modelling (normalized, dimensional, and lakehouse models)
 * Experience with batch and real-time/streaming data processing (Kafka, Event Hub, or similar)
 * Solid understanding of cloud-native architectures, distributed systems, and data engineering best practices
 * Ability to design end-to-end technical solutions and evaluate architectural trade-offs
 * Excellent analytical, problem-solving, and communication skills
 * Proven ability to collaborate across teams and lead technical discussions

Preferred / Nice-to-Have Skills

 * Experience with CI/CD pipelines using Azure DevOps and Git
 * Familiarity with Infrastructure as Code (Terraform, ARM templates)
 * Exposure to data governance and cataloging tools such as Azure Purview
 * Experience supporting BI, analytics, or machine learning workloads on Databricks

## Description

* Architect, design, and implement scalable data platforms on Microsoft Azure and Databricks
 * Build and optimize data ingestion, transformation, and processing pipelines for batch and real-time data
 * Develop high-performance workflows using ADLS, Delta Lake, and Apache Spark (PySpark)
 * Design, build, and maintain complex ETL/ELT pipelines with strong reliability and performance standards
 * Create and manage conceptual, logical, and physical data models for analytics and operational use cases
 * Work with relational and lakehouse systems including PostgreSQL and Delta Lake
 * Define and enforce data governance, security, data quality, and architectural best practices
 * Collaborate with data architects, data scientists, analysts, and business stakeholders to translate requirements into scalable solutions
 * Troubleshoot production issues and continuously optimize platform performance
 * Mentor junior engineers and contribute to engineering standards, reusable frameworks, and best practices