Data Engineer

• Pipeline Development & Optimization: Design and implement robust batch and real-time streaming pipelines using PySpark, Hadoop, Hive, and Apache Kafka to process large volumes of security vulnerability findings.
• Data Cleansing & Deduplication: Implement advanced data quality, enrichment (severity, criticality scoring), and deduplication logic comparing multiple scanning feeds (e.g., LLM scanners vs. Checkmarx/Snow AR) to eliminate duplicate findings.
• Cloud Migration & Data Lake Integration: Ingest and process data within Google Cloud Platform (GCP) leveraging GCP Data Lake, BigQuery, and modern cloud storage/compute frameworks, facilitating the transition from on-premise processing to GCP.
• Extensible Scanning Framework: Build a modular, pluggable framework that enables the security team to integrate, evaluate, and compare output results from newly introduced LLM/security scanner models (e.g., Mythos, Codex, Astra) within days.
• ServiceNow & Remediation Workflows: Format, validate, and deliver clean, actionable data to downstream systems.

• Programming Languages: Proficiency in Python and Go (Golang).
• Big Data & Streaming Technologies: Hands-on experience with PySpark, Apache Hadoop, Apache Hive, and Apache Kafka (both batch and real-time/event-driven data pipelines).
• Google Cloud Platform (GCP): Proven experience with BigQuery, GCP Data Lake architectures, and GCP data services.
• Data Processing & Architecture: Demonstrated experience building data quality validation, cross-source deduplication, data enrichment, and schema standardization pipelines.
• Tools & Integration: Experience integrating data pipelines with enterprise REST APIs, messaging systems, and security/ITSM platforms.

Preferred Skills & Nice-to-Haves

• Prior domain experience in Vulnerability Management, Application Security, or Cyber Security Data Analytics.
• Familiarity with Code Scanning / SAST / DAST tools (e.g., Checkmarx) and ServiceNow modules (Vulnerability Response / SecOps / Snow AR).
• Experience handling enterprise-scale code repository metadata (GitHub/GitLab pipelines).
• Financial services or highly regulated enterprise environment experience.

Preferred Qualifications

• Certified Information Systems Security Professional (CISSP), Certified Application Security Engineer (CASE), or CSSLP.
• Experience working in a large enterprise banking environment with multiple business units.
• Familiarity with DevSecOps toolchains (Jenkins, GitHub Actions, SonarQube, Veracode, Checkmarx, Snyk).