> Markdown version of [/jobs/ext/3622455-data-engineer](https://www.wearedevelopers.com/jobs/ext/3622455-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer

- **Company:** RIVAGO INFOTECH INC.
- **Location:** Charlotte, NC, United States
- **Contract:** Permanent contract
- **Skills:** Big Data, BigQuery, Code Review, Cyber Security, Data Cleansing, Data Deduplication, Data Infrastructure, Github, Apache Hadoop, Apache Hive, Information Systems Security Architecture Professional, Python (Programming Language), Enterprise Messaging Systems, SonarQube, Toolchain, Software Vulnerability Management, Data Processing, Google Cloud, Large Language Models, Sonatype, Software Security, Veracode, Gitlab, Data Lakes, Pyspark, Information Technology, Data Analytics, Apache Kafka, Checkmarx, Video Streaming, Cloud Migration, Restful APIs, Data Pipelines, Devsecops, Jenkins, Servicenow, Static Application Security Testing, Golang, Programming Languages, Dynamic Application Security Testing
- **Published:** October 8, 2026
- **Apply:** https://www.disabledperson.com/jobs/75894301-data-engineer

## About the Role

* Programming Languages: Proficiency in Python and Go (Golang).
 * Big Data & Streaming Technologies: Hands-on experience with PySpark, Apache Hadoop, Apache Hive, and Apache Kafka (both batch and real-time/event-driven data pipelines).
 * Google Cloud Platform (GCP): Proven experience with BigQuery, GCP Data Lake architectures, and GCP data services.
 * Data Processing & Architecture: Demonstrated experience building data quality validation, cross-source deduplication, data enrichment, and schema standardization pipelines.
 * Tools & Integration: Experience integrating data pipelines with enterprise REST APIs, messaging systems, and security/ITSM platforms.

Preferred Skills & Nice-to-Haves

 * Prior domain experience in Vulnerability Management, Application Security, or Cyber Security Data Analytics.
 * Familiarity with Code Scanning / SAST / DAST tools (e.g., Checkmarx) and ServiceNow modules (Vulnerability Response / SecOps / Snow AR).
 * Experience handling enterprise-scale code repository metadata (GitHub/GitLab pipelines).
 * Financial services or highly regulated enterprise environment experience.

Preferred Qualifications

 * Certified Information Systems Security Professional (CISSP), Certified Application Security Engineer (CASE), or CSSLP.
 * Experience working in a large enterprise banking environment with multiple business units.
 * Familiarity with DevSecOps toolchains (Jenkins, GitHub Actions, SonarQube, Veracode, Checkmarx, Snyk).

## Description

* Pipeline Development & Optimization: Design and implement robust batch and real-time streaming pipelines using PySpark, Hadoop, Hive, and Apache Kafka to process large volumes of security vulnerability findings.
 * Data Cleansing & Deduplication: Implement advanced data quality, enrichment (severity, criticality scoring), and deduplication logic comparing multiple scanning feeds (e.g., LLM scanners vs. Checkmarx/Snow AR) to eliminate duplicate findings.
 * Cloud Migration & Data Lake Integration: Ingest and process data within Google Cloud Platform (GCP) leveraging GCP Data Lake, BigQuery, and modern cloud storage/compute frameworks, facilitating the transition from on-premise processing to GCP.
 * Extensible Scanning Framework: Build a modular, pluggable framework that enables the security team to integrate, evaluate, and compare output results from newly introduced LLM/security scanner models (e.g., Mythos, Codex, Astra) within days.
 * ServiceNow & Remediation Workflows: Format, validate, and deliver clean, actionable data to downstream systems.