> Markdown version of [/jobs/ext/1728624-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/1728624-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Data engineer - **Company:** Vsg Business Solutions - **Location:** Charlotte, NC, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Airflow, Amazon Web Services, Microsoft Azure, Big Data, BigQuery, Cloud Computing, Code Review, Continuous Integration, Information Engineering, Data Infrastructure, Data Integration, Extract Transform Load (ETL), Data Warehousing, Database Design, Dimensional Modeling, Distributed Data Store, Python (Programming Language), Machine Learning, Meta-Data Management, SQL Databases, Enterprise Data Management, Snowflake, Apache Spark, Database Performance, Git, Cloudformation, Microsoft Fabric, Data Lakes, Kubernetes, Data Lineage, Collibra, Apache Kafka, Data Management, Machine Learning Operations, Video Streaming, Terraform, Stream Processing, Stream Analytics, Data Pipelines, Docker, Databricks - **Published:** July 16, 2026 - **Apply:** https://www.careerjet.com/jobad/us0707282ec5b558bda23044ce9ea69aec ## About the Role We are seeking an experienced Lead Data Engineer to design, develop, and optimize scalable data platforms and pipelines that support enterprise analytics, reporting, machine learning, and business intelligence initiatives. The ideal candidate will have strong expertise in modern data engineering technologies, cloud platforms, data warehousing, and big data ecosystems, along with proven leadership experience in driving data engineering projects and mentoring teams., * Experience in Data Engineering, Data Warehousing, or Big Data technologies. * Strong proficiency in Python and SQL. * Hands-on experience with Apache Spark, Databricks, Kafka, and Airflow. * Strong experience in ETL/ELT development and data pipeline orchestration. * Expertise in cloud platforms such as AWS, Azure, or GCP. * Experience with data warehouses including Snowflake, Redshift, Synapse, or BigQuery. * Strong understanding of data modeling, dimensional modeling, and database design principles. * Experience with CI/CD, Git, Docker, and Kubernetes. * Knowledge of Data Lake, Lakehouse, and modern data architecture patterns. * Strong problem-solving, analytical, and leadership skills. * Experience working in Agile/Scrum environments. Preferred Skills * Experience with Data Mesh, Data Fabric, or modern distributed data architectures. * Exposure to AI/ML data pipelines and MLOps frameworks. * Knowledge of metadata management, data lineage, and data governance tools. * Experience with Infrastructure as Code (Terraform, CloudFormation, etc.). * Hands-on experience with streaming technologies and real-time analytics. * Cloud certifications (AWS, Azure, or GCP). * Databricks, Snowflake, or other relevant data platform certifications. * Experience leading geographically distributed teams. * Familiarity with Master Data Management (MDM) solutions. * Excellent stakeholder management and communication skills. ## Description * Lead the design, development, and implementation of scalable data pipelines and data integration solutions. * Architect and maintain enterprise data platforms, data lakes, and data warehouses. * Build and optimize batch and real-time data processing frameworks. * Collaborate with business stakeholders, analysts, data scientists, and application teams to understand data requirements. * Develop and maintain ETL/ELT processes ensuring data accuracy, consistency, and reliability. * Implement data quality, governance, lineage, and monitoring frameworks. * Optimize data models, database performance, and query execution. * Drive cloud data platform adoption and modernization initiatives. * Ensure compliance with security, regulatory, and data privacy standards. * Lead code reviews, technical design sessions, and architecture discussions. * Mentor and guide data engineers while driving engineering best practices. * Support production systems, troubleshoot complex data issues, and implement preventive measures., Position: Data Lead / Senior Data Engineer Type of hire: FTC or FTE Location: Atlanta or Charlotte (Hybrid so local candidates only). JD: We are seeking a seasoned Data Lea… + 21 hours ago + Apply easily, Position: Data Lead / Senior Data Engineer Location: Atlanta, GA or Charlotte, NC (Hybrid so local candidates only). Contract JD: We are seeking a seasoned Data Lead / Seni… + 4 days ago + ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) - [Docker build without Docker](https://www.wearedevelopers.com/videos/100114-docker-build-without-docker) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)