Lead Data Engineer

OPEN QUEUE LLC
Atlanta, GA, United States
4 days ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$75,000.0 - $100,000.0
Working hours
Regular working hours

Tech stack

Artificial Intelligence Microsoft Azure Data Architecture Data Warehousing Machine Learning Systems Integration Azure Data Factory Microsoft Fabric Data Lakes Pyspark Databricks

Requirements

We are looking for an experienced Lead Azure Data Engineer with strong expertise in designing and architecting enterprise-scale solutions on the Azure Data Platform. The ideal candidate should have hands-on experience with Azure Databricks, ADF, PySpark, data lakes, data warehouses, and modern data architecture., * 5+ years of experience as an Azure Data Engineer.

  • 7+ years of overall experience working on the Azure Data Platform.
  • Design and architect scalable, secure, and highly available Azure data solutions.
  • Strong experience with Azure Databricks and PySpark.
  • Experience integrating multiple data sources with Data Warehouses and Data Lakes.
  • Design and implement data lakes and data warehouses supporting Reporting, AI, and Machine Learning initiatives.
  • Strong understanding of data modeling and data architecture concepts.
  • Knowledge and understanding of Unity Catalog.
  • Knowledge of Azure Cloud Security, governance, and best practices.
  • Understanding of Data Mesh is a plus.
  • Good understanding of Microsoft Fabric and Copilot.
  • Evaluate technology options and clearly communicate their pros and cons.
  • Collaborate with clients to understand business requirements and translate them into technical Azure solutions.
  • Identify and implement automation opportunities to improve operational efficiency.
  • Conduct knowledge-sharing and training sessions for clients and internal teams.
  • Experience with estimation and solution design on Azure Cloud.
  • Life Sciences domain experience - Healthcare, Pharma, Med-Tech, Medical Devices, or Manufacturing - is a plus.

Benefits & conditions

  • $144,000-210,000 per year Cargill’s size and scale allows us to make a positive impact in the world. Our purpose is to nourish the world in a safe, responsible and sustainable way. Cargill is a family comp…

  • 15 days ago +

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

3:24 min

The governance failures of centralized data lakes

Mario Meir-Huber · LIVE

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

6:24 min

Distributed data lakes and containerized computing clusters

Ulrich Wurstbauer +1 · LIVE

3:14 min

Structuring career paths and localized data architectures

Ulrich Wurstbauer +1 · LIVE

Videos

See all

Related articles

See all