> Markdown version of [/jobs/ext/482025-senior-software-engineer-llm-evaluation-us-canada-weu-based](https://www.wearedevelopers.com/jobs/ext/482025-senior-software-engineer-llm-evaluation-us-canada-weu-based). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Software Engineer - LLM Evaluation (US/Canada/WEU based)

- **Company:** G CONSULTING, LLC
- **Location:** United States (Remote available)
- **Experience:** Expert
- **Contract:** Temporary contract
- **Skills:** Java (Programming Language), JavaScript (Programming Language), Artificial Intelligence, C++ (Programming Language), Software Quality, Software Debugging, Python (Programming Language), Machine Learning, Software Architecture, Software Engineering, Rust (Programming Language), ReactJS, Large Language Models, Api Design, Golang
- **Published:** June 8, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=7ce13a0767328e81

## About the Role

Do you have experience in Software engineering?, * Python

 * JavaScript
 * Java
 * C++Rust, * Several years of software engineering experience (3 years or more)
 * Strong expertise in building full-stack applications and deploying scalable, production-grade software using modern languages and tools.
 * Deep understanding of software architecture, design, development, debugging, and code quality/review assessment.
 * Excellent oral and written communication skills for clear, structured evaluation rationales.

Engagement Details

 * Commitment: flexible engagement, minimum 10 hrs/week, up to 40 hrs/week

## Description

As a Software Engineering evaluator, you will create cutting-edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers. This includes curating code examples, providing precise solutions, and making corrections in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go; evaluating and refining AI-generated code for efficiency, scalability, and reliability; and working with cross-functional teams to enhance enterprise-level AI-driven coding solutions.

What Does a Typical Day Look Like?

 * Working on AI model training initiatives by curating code examples, building solutions, and correcting code in Python, JavaScript (including ReactJS), C/C++, Java, Rust, and Go.
 * Evaluate and refine AI-generated code to ensure that it is efficient, scalable, and reliable.
 * Collaborate withcross-functionalteamsto enhance AI-driven coding solutions against industry performance benchmarks.
 * Build agents that can verify the quality of the code and identify error patterns.
 * Hypothesize on steps in the software engineering cycle (prototyping, architecture design, API design, production implementation, launch, experiments, monitoring, operational maintenance) and evaluate model capabilities on them
 * Design verification mechanisms that can automatically verify a solution to a software engineering task.


## Related Videos

- [Evals vs. Evil - AI and Package Security - Laurie Voss](https://www.wearedevelopers.com/videos/2131-evals-vs-evil-ai-and-package-security-laurie-voss)
- [API Design - Getting Started](https://www.wearedevelopers.com/videos/33-api-design-getting-started)
- [Watch Tests Go Brrrr! : Getting Started with Cypress in ReactJS](https://www.wearedevelopers.com/videos/282-watch-tests-go-brrrr-getting-started-with-cypress-in-reactjs)
- [Go with the Flow: Stop the Leaks Before Your Memory's a Waterfall!](https://www.wearedevelopers.com/videos/100073-go-with-the-flow-stop-the-leaks-before-your-memory-s-a-waterfall)
- [Command and Conquer: How we let an LLM control our Software](https://www.wearedevelopers.com/videos/2056-command-and-conquer-how-we-let-an-llm-control-our-software)
- [Rest API Antipatterns](https://www.wearedevelopers.com/videos/100208-rest-api-antipatterns)

## Related Articles

- [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)
- [Where To Find Software Engineering Jobs](https://www.wearedevelopers.com/magazine/396-where-to-find-software-engineering-jobs)
- [The 12 Best Jobs for Software Engineers](https://www.wearedevelopers.com/magazine/401-the-12-best-jobs-for-software-engineers)
- [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)
- [Are Software Engineer Wages Being Pushed Down? A Report on Tech Salaries](https://www.wearedevelopers.com/magazine/417-are-software-engineer-wages-being-pushed-down-a-report-on-tech-salaries)