> Markdown version of [/jobs/ext/482028-security-engineer-ai-evaluator](https://www.wearedevelopers.com/jobs/ext/482028-security-engineer-ai-evaluator). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Security Engineer - AI Evaluator

- **Company:** Handshake
- **Location:** United States (Remote available)
- **Experience:** Experienced
- **Salary:** $166,400.0
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Software System Penetration Testing, Burp Suite, Nmap, Red Team (Cyber Security), Wireshark, Software Vulnerability Management, Malware, Metasploit, Cybercrime, Nessus
- **Published:** June 8, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=8c44798d916383dd

## About the Role

Do you have experience in Vulnerability management architecture design?, * 3+ years of professional experience in security engineering or offensive security, in a role such as Security Engineer, Penetration Tester, Red Team Engineer, Malware Analyst, Threat Hunter, or Offensive Security Engineer

 * Hands-on experience with one or more of the following: Burp Suite, Nmap, Wireshark, Metasploit Framework, BloodHound, Impacket, Nessus, or Hashcat
 * Strong written communication skills, attention to detail, and the ability to work independently in a remote, asynchronous environment

## Description

* Use your domain expertise to create expert-level training questions and scenarios based on real security engineering and offensive security workflows
 * Review and evaluate AI-generated responses for accuracy and relevance to real-world penetration testing, malware analysis, and threat hunting practices
 * Provide structured written feedback to help improve AI model performance
 * Complete tasks at your own pace with no set schedule or minimum hour requirement, F-1 students who are eligible for CPT or OPT may be eligible for projects on Handshake AI. Work with your Designated School Official to determine your eligibility. If your school requires a CPT course, Handshake AI may not meet your school's requirements. STEM OPT is not supported. for more information on what types of work authorizations are supported on Handshake AI.


## Related Videos

- [Enhancing Workload Security in Kubernetes](https://www.wearedevelopers.com/videos/356-enhancing-workload-security-in-kubernetes)
- [Let’s write an exploit using AI](https://www.wearedevelopers.com/videos/1004-let-s-write-an-exploit-using-ai)
- [Full Spectrum File Uploads](https://www.wearedevelopers.com/videos/870-full-spectrum-file-uploads)
- [Security Pitfalls for Software Engineers](https://www.wearedevelopers.com/videos/726-security-pitfalls-for-software-engineers)
- [Checkmate: 5 Real Incidents That Can End a Software Company](https://www.wearedevelopers.com/videos/100126-checkmate-5-real-incidents-that-can-end-a-software-company)
- [Training Bots on Deliveroo Data, Alexa Can Swear and Mushroom Electronics - Julia Kordick](https://www.wearedevelopers.com/videos/1839-training-bots-on-deliveroo-data-alexa-can-swear-and-mushroom-electronics-julia-kordick)

## Related Articles

- [9 Ways to Make Money Hacking](https://www.wearedevelopers.com/magazine/333-9-ways-to-make-money-hacking)
- [Dev Digest 134 - Where pixels sing?](https://www.wearedevelopers.com/magazine/477-dev-digest-134-where-pixels-sing)
- [Understanding and Mitigating Common Web Vulnerabilities](https://www.wearedevelopers.com/magazine/565-understanding-and-mitigating-common-web-vulnerabilities)
- [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated)
- [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)
- [The 12 Best Jobs for Software Engineers](https://www.wearedevelopers.com/magazine/401-the-12-best-jobs-for-software-engineers)