> Markdown version of [/jobs/ext/2736758-principal-data-engineer](https://www.wearedevelopers.com/jobs/ext/2736758-principal-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Principal Data Engineer

- **Company:** Cornerstone Barricades
- **Location:** Charlotte, NC, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Application Programming Interfaces (APIs), Amazon Web Services, Amazon S3, Continuous Integration, Information Engineering, Data Governance, Relational Databases, IBM InfoSphere DataStage, Distributed Computing Environment, Python (Programming Language), PostgreSQL, MongoDB, NoSQL, Object-Oriented Software Development, Performance Tuning, Standard Sql, Software Deployment, Data Streaming, Talend, Parquet, Real Time Systems, Data Ingestion, Snowflake, Apache Spark, Spring-boot, Backend, Git, Event Driven Architecture, Data Lakes, Kubernetes, Apache Flink, Apache Kafka, Data Management, Front End Software Development, Api Design, Restful APIs, Data Pipelines, Docker, Amazon Redshift, Microservices
- **Published:** September 5, 2026
- **Apply:** https://ividtek.betterteam.com/principal-data-engineer-1/apply/standard

## About the Role

* 10-12+ years experience in Java/backend or data engineering
 * Hands-on experience building real-time data pipelines (Kafka, Spark Streaming/Flink)
 * Solid knowledge of relational databases (Redshift, PostgreSQL, Snowflake) and NoSQL databases (MongoDB or similar)
 * Strong Kafka and event-driven architecture experience
 * Strong Microservices experience (Spring Boot, REST APIs)
 * Experience in API development and API consumption
 * Hands-on Spark experience (batch and streaming)
 * Strong SQL and data modeling skills
 * AWS experience (S3, Glue, EMR, Redshift)
 * Experience in regulated/data governance environments
 * CI/CD, Git, Docker/Kubernetes familiarity

Preferred:

 * Scala or Python experience
 * Talend/DataStage exposure
 * Data lake experience (Iceberg/Parquet)
 * Frontend/API integration exposure
 * Experience supporting large-scale production systems

Mandatory Screening Criteria:
Candidates must have hands-on experience building real-time/event-driven data pipelines using Kafka and Spark/Flink, along with strong microservices and API development experience.

## Description

Principal-level Java engineer to design and build enterprise-grade, real-time and batch data processing systems using Java, Spark, Kafka, and Microservices architecture. Strong focus on event-driven pipelines, API development (build + consume), and high-volume streaming platforms., * Architect, design, and implement enterprise-grade Java-based data platforms and distributed processing systems

 * Build and maintain production-ready Spark applications (Java) for batch and real-time processing
 * Design and evolve Kafka-based event streaming and ingestion pipelines
 * Develop and consume REST APIs within microservices architecture
 * Lead architecture ensuring scalability, reliability, and regulatory compliance
 * Apply strong object-oriented design and engineering practices
 * Mentor engineers on performance tuning and production readiness
 * Design and implement MDM solutions (match, merge, survivorship logic)
 * Ensure data quality, observability, and system stability
 * Support production deployments and operational handoffs


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)
- [NoSQL Data Modeling for Front-end Developers](https://www.wearedevelopers.com/videos/297-nosql-data-modeling-for-front-end-developers)
- [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews)

## Related Articles

- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated)