> Markdown version of [/jobs/ext/2038831-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/2038831-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Lead Data Engineer

- **Company:** American CyberSystems
- **Location:** Charlotte, NC, United States
- **Experience:** Expert
- **Salary:** $145,600.0 - $166,400.0
- **Contract:** Permanent contract
- **Skills:** Airflow, BigQuery, Cloud Engineering, Cloud Storage, Databases, Continuous Integration, Data Control, Information Engineering, Data Governance, Data Migration, Data Systems, DevOps, Graph Database, Design of User Interfaces, Apache Hadoop, Hadoop Distributed File System, Apache Hive, Python (Programming Language), Node.Js, NoSQL, SQL Databases, Data Streaming, Web Applications, Parquet, Google Cloud, ReactJS, Apache Spark, Git, Pyspark, Kubernetes, Apache Flink, Apache Kafka, Spark Streaming, Data Management, Data Lakehouse, Data Pipelines, Docker, Jenkins
- **Published:** August 12, 2026
- **Apply:** https://public-rest34.bullhornstaffing.com/rest-services/2WXP1S/query/JobBoardPost?where=id=1022481&fields=id,title,publishedCategory(id,name),address(city,state),employmentType,dateLastPublished,publicDescription,isOpen,isPublic,isDeleted

## About the Role

* 10+ years of experience in data engineering including hands-on experience working with Hadoop and Google Cloud data solutions .
 * Hands-on experience developing data flows using Kafka, Flink, and Spark streaming.
 * Experience with Data Lakehouse architecture and design.
 * Experience with Python, pySpark, Apache Kafka, Airflow, and SQL, GPC Cloud Storage, BigQuery, Data Proc, Cloud Composer.
 * NoSQL databases such as columnar databases, graph databases, document databases, KV stores, and associated data formats.

Desired Qualifications:

 * Proven skills with data migration from on-prem to a cloud native environment
 * Proven experience working with the Hadoop ecosystem capabilities such as Hive, HDFS, Parquet, Iceberg, and Delta Tables
 * Design and implementation of highly scalable and modular data pipelines with built-in data controls for automating data governance
 * Familiarity of GenAI frameworks such as Langchain and Langraph to develop agent-based data capabilities
 * Dev Ops and CI/CD deployments including Git, Jenkins, Docker, and Kubernetes
 * Web based UI development using React and Node JS is a plus

## Description

As a Data Engineer you will be:
Day to Day Responsibilities

 * Creating/supporting Spark based processing, Kafka streaming
 * Developing data flows using Kafka, Flink, and Spark streaming
 * Designing and implementing of highly scalable and modular data pipelines with built-in data controls for automating data governance


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis)
- [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews)

## Related Articles

- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)
- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)