Lead Data engineer

Vsg Business Solutions
Charlotte, NC, United States
26 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours

Tech stack

Artificial Intelligence Airflow Amazon Web Services Microsoft Azure Big Data BigQuery Cloud Computing Code Review Continuous Integration Information Engineering Data Infrastructure Data Integration
+30 more
Extract Transform Load (ETL) Data Warehousing Database Design Dimensional Modeling Distributed Data Store Python (Programming Language) Machine Learning Meta-Data Management SQL Databases Enterprise Data Management Snowflake Apache Spark Database Performance Git Cloudformation Microsoft Fabric Data Lakes Kubernetes Data Lineage Collibra Apache Kafka Data Management Machine Learning Operations Video Streaming Terraform Stream Processing Stream Analytics Data Pipelines Docker Databricks

Job description

  • Lead the design, development, and implementation of scalable data pipelines and data integration solutions.
  • Architect and maintain enterprise data platforms, data lakes, and data warehouses.
  • Build and optimize batch and real-time data processing frameworks.
  • Collaborate with business stakeholders, analysts, data scientists, and application teams to understand data requirements.
  • Develop and maintain ETL/ELT processes ensuring data accuracy, consistency, and reliability.
  • Implement data quality, governance, lineage, and monitoring frameworks.
  • Optimize data models, database performance, and query execution.
  • Drive cloud data platform adoption and modernization initiatives.
  • Ensure compliance with security, regulatory, and data privacy standards.
  • Lead code reviews, technical design sessions, and architecture discussions.
  • Mentor and guide data engineers while driving engineering best practices.
  • Support production systems, troubleshoot complex data issues, and implement preventive measures., Position: Data Lead / Senior Data Engineer Type of hire: FTC or FTE Location: Atlanta or Charlotte (Hybrid so local candidates only). JD: We are seeking a seasoned Data Lea…
  • 21 hours ago
  • Apply easily, Position: Data Lead / Senior Data Engineer Location: Atlanta, GA or Charlotte, NC (Hybrid so local candidates only). Contract JD: We are seeking a seasoned Data Lead / Seni…
  • 4 days ago +

Requirements

We are seeking an experienced Lead Data Engineer to design, develop, and optimize scalable data platforms and pipelines that support enterprise analytics, reporting, machine learning, and business intelligence initiatives. The ideal candidate will have strong expertise in modern data engineering technologies, cloud platforms, data warehousing, and big data ecosystems, along with proven leadership experience in driving data engineering projects and mentoring teams., * Experience in Data Engineering, Data Warehousing, or Big Data technologies.

  • Strong proficiency in Python and SQL.
  • Hands-on experience with Apache Spark, Databricks, Kafka, and Airflow.
  • Strong experience in ETL/ELT development and data pipeline orchestration.
  • Expertise in cloud platforms such as AWS, Azure, or GCP.
  • Experience with data warehouses including Snowflake, Redshift, Synapse, or BigQuery.
  • Strong understanding of data modeling, dimensional modeling, and database design principles.
  • Experience with CI/CD, Git, Docker, and Kubernetes.
  • Knowledge of Data Lake, Lakehouse, and modern data architecture patterns.
  • Strong problem-solving, analytical, and leadership skills.
  • Experience working in Agile/Scrum environments.

Preferred Skills

  • Experience with Data Mesh, Data Fabric, or modern distributed data architectures.
  • Exposure to AI/ML data pipelines and MLOps frameworks.
  • Knowledge of metadata management, data lineage, and data governance tools.
  • Experience with Infrastructure as Code (Terraform, CloudFormation, etc.).
  • Hands-on experience with streaming technologies and real-time analytics.
  • Cloud certifications (AWS, Azure, or GCP).
  • Databricks, Snowflake, or other relevant data platform certifications.
  • Experience leading geographically distributed teams.
  • Familiarity with Master Data Management (MDM) solutions.
  • Excellent stakeholder management and communication skills.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · WWC Europe 2026

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · WWC 2025

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · WWC 2024

2:34 min

Docker sandbox architecture and microVM environment integration

Manuel de la Peña Manuel de la Peña · WWC Europe 2026

Videos

See all

Related articles

See all