Software Engineer - AI Evaluator (Remote)

• Schedule: Flexible and asynchronous, with no minimum hour requirement. Many contributors work approximately 5-20 hours per week when assigned to an active project
• Duration: The Handshake AI program runs year-round, with projects opening periodically across different areas of expertise. Placement depends on current project needs, with opportunities to be considered for future projects as they become available

Work authorization information

F-1 students who are eligible for CPT or OPT may be eligible for projects on Handshake AI. Work with your Designated School Official to determine your eligibility. If your school requires a CPT course, Handshake AI may not meet your school’s requirements. STEM OPT is not supported. See our Help Center article for more information on what types of work authorizations are supported on Handshake AI.

Do you have experience in Writing skills?, This opportunity is designed for professionals currently working (or recently working) in roles such as:

• Software Engineer or Senior Software Engineer
• Backend, Frontend, or Full-Stack Engineer
• Systems Engineer or Application Developer

This is not a traditional full-time role. You’ll apply once and, if qualified, be considered for part-time, project-based work as new projects become available.

What You’ll Do

This project involves using your software engineering experience to design job-related coding questions and review AI-generated responses for correctness, efficiency, clarity, and alignment with real-world engineering practices.

Applicants will be required to pass a coding assessment as part of the selection process., We’re looking for professionals with:

• 4+ years of professional software engineering experience (internships excluded)
• Strong hands-on coding experience in at least one major programming language (e.g., Python, Java, C++, JavaScript, Go, etc.)
• Experience writing, reviewing, and debugging production-level code
• Comfortable working independently and following detailed technical guidelines
• Strong written communication skills and attention to detail

3.83.8 out of 5 stars Pittsburgh, PA Remote Up to $100 an hour - Contract

Handshake is seeking experienced Software Engineers to support AI research through flexible, hourly contract work. This is not a traditional full-time SWE role. You’ll use your real-world software development experience to evaluate AI-generated code and technical content, provide structured feedback, and help improve how AI understands programming tasks, system design, and engineering best practices.