Security Engineer - AI Evaluator

• Use your domain expertise to create expert-level training questions and scenarios based on real security engineering and offensive security workflows
• Review and evaluate AI-generated responses for accuracy and relevance to real-world penetration testing, malware analysis, and threat hunting practices
• Provide structured written feedback to help improve AI model performance
• Complete tasks at your own pace with no set schedule or minimum hour requirement, F-1 students who are eligible for CPT or OPT may be eligible for projects on Handshake AI. Work with your Designated School Official to determine your eligibility. If your school requires a CPT course, Handshake AI may not meet your school’s requirements. STEM OPT is not supported. for more information on what types of work authorizations are supported on Handshake AI.

Do you have experience in Vulnerability management architecture design?, * 3+ years of professional experience in security engineering or offensive security, in a role such as Security Engineer, Penetration Tester, Red Team Engineer, Malware Analyst, Threat Hunter, or Offensive Security Engineer

• Hands-on experience with one or more of the following: Burp Suite, Nmap, Wireshark, Metasploit Framework, BloodHound, Impacket, Nessus, or Hashcat
• Strong written communication skills, attention to detail, and the ability to work independently in a remote, asynchronous environment

3.83.8 out of 5 stars Remote Up to $80 an hour - Contract

Handshake is looking for experienced security engineering and offensive security professionals to support AI research through flexible, part-time contract work. This is not a traditional job - you’ll draw on your hands-on expertise in penetration testing, threat hunting, malware analysis, and red team operations to evaluate AI-generated content and provide feedback that helps AI better understand real-world security workflows and attack techniques.

This is an ongoing, project-based opportunity you can take on alongside anything else you have going on.