AI Response Evaluator for Cyber Security Threat Intelligence

ONE STOP COLLECTIBLE CORP
United States
4 days ago
Apply on startup.jobs
Prepare application

Role details

Contract type
Permanent contract
Employment type
Part-time (≤ 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Training Data Artificial Intelligence Cyber Security Cisco Nexus Switches Software Vulnerability Management Reinforcement Learning Cyber Threat Analysis Cybercrime

Job description

We are seeking a highly skilled and motivated individual to join our team as an AI Response Evaluator with a focus on Cyber Security Threat Intelligence. This position is at the forefront of integrating Artificial Intelligence with Cyber Security to enhance threat intelligence and incident response capabilities. The successful candidate will be involved in evaluating AI-generated prompts using reinforcement learning with human feedback to grade and improve AI quality. This role is an exceptional opportunity to work at the cutting edge nexus of AI and Cyber Security, contributing to the development of smarter, more efficient systems capable of defending against the ever-evolving cyber threat landscape., Evaluate AI-generated prompt responses for accuracy, relevance, and effectiveness in the context of Cyber Security Threat Intelligence.

  • Use reinforcement learning with human feedback to grade AI prompt responses and guide the AI’s learning process for improved performance.

  • Collaborate with cybersecurity professionals and data scientists to refine AI models based on real-world cyber threat intelligence and incident data.

  • Participate in the continuous improvement of AI training processes, including the selection of training data and feedback mechanisms.

  • Stay abreast of the latest developments in cyber security threats, tactics, techniques, and procedures (TTPs) to ensure the AI’s outputs are relevant and up-to-date.

  • Provide insights and feedback on the AI’s performance and potential areas for enhancement in detecting and responding to cyber threats.

Requirements

SANS GCIH (GIAC Certified Incident Handler)

  • SANS GCTI (GIAC Cyber Threat Intelligence)

  • Other relevant certifications in information security incident handling, vulnerability management, and threat intelligence are highly desirable (e.g., CISSP, CEH, OSCP).

Required Experience:

Candidates should have significant (multiple years) of experience in at least one of the following areas:

  • Analyzing, triaging, and responding to cyber security incidents and investigations, particularly in response to recent vulnerabilities. This includes knowledge of threat actor group tactics, techniques, and procedures (TTPs) and how to detect and defend against them.

  • Assessing Cyber Threat Intelligence and determining applicable risk for an organization via threat modeling. This involves understanding threat actor group TTPs and how to detect and defend against them.

  • Identifying, managing, and remediating vulnerabilities, especially in response to well-known vulnerabilities exploited by threat actor groups.

*Base pay is determined by multiple factors, including the area of expertise, years of experience, and skillset needed for the project. Pay rates vary during the project lifecycle. For example, rates for onboarding are lower.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on startup.jobs
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

4:34 min

Motivational categories behind modern cybercriminal activities

Mauro Verderosa · LIVE

2:20 min

Architecting language translation with focused training data

Jaroslaw Kutylowski Jaroslaw Kutylowski +1 · World Congress 2023

4:11 min

Introduction to cloud-native application developer security

Micah Silverman · World Congress 2022

1:44 min

Coordinating security mitigations with the CISA clearinghouse

Adrian Mouat Adrian Mouat · World Congress 2026 Europe

2:11 min

Securing heterogeneous legacy payment infrastructure against AI

Michele Zuccala Michele Zuccala +4 · World Congress 2026 Europe

1:45 min

Addressing active AI incident remediation and broad ecosystem support

Matthew Brady Matthew Brady · World Congress 2026 Europe

Videos

See all

Related articles

See all