AI Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+8 more
Job description
We’re looking for experienced software engineers to help evaluate and improve next-generation AI systems. In this role, you’ll use your software engineering expertise to create challenging, realistic tasks that test how well AI models can solve complex programming problems. You’ll design reinforcement learning environments where AI agents interact with real software projects and tools to diagnose and solve engineering challenges. Assignments may include debugging, implementing new features, refactoring existing code, and improving performance. You’ll also create reproducible environments, reliable verification systems, and reference solutions that accurately evaluate an AI agent’s reasoning, tool usage, and software engineering capabilities. Prior AI or machine learning experience is not required. Strong software engineering expertise is the most important qualification. Responsibilities
- Create realistic software engineering tasks for AI model evaluation.
- Develop reinforcement learning environments using Model Context Protocol (MCP) tools.
- Design tasks involving bug fixes, feature implementation, refactoring, and performance optimization.
- Build deterministic verification and testing processes to evaluate solutions.
- Develop high-quality reference or golden solutions for benchmarking.
- Ensure environments are reproducible, reliable, and representative of real-world engineering workflows.
- Analyze complex codebases and identify meaningful engineering challenges.
- Document tasks, solutions, and evaluation criteria clearly., Senior Software Engineer Job Type: Contractor (~15 hours/week) Location: Remote Job Summary We are seeking experienced Senior Software Engineers to support an AI training pr…
- 18 hours ago
- Apply easily +
Requirements
- Strong proficiency in one or more of C++, Python, Java, Go, TypeScript, or Rust.
- Solid understanding of algorithms, data structures, and software engineering fundamentals.
- Demonstrated experience debugging complex software issues.
- Strong experience developing features and refactoring existing codebases.
- Experience with performance optimization and scalability.
- Excellent written and verbal communication skills.
- Strong attention to detail and ability to produce reliable, high-quality work.
- Ability to work independently and collaborate effectively in a remote environment.
Preferred Qualifications
- Experience working with large-scale or distributed codebases.
- Familiarity with AI, machine learning, or agent-based systems.
- Experience with rigorous code reviews and software development best practices.
- Familiarity with developer tools, APIs, testing frameworks, or automated evaluation systems.
Benefits & conditions
- $60-$120/hour depending on experience and expertise.
- Flexible schedule.
- Fully remote.
- Opportunity to contribute to the development and evaluation of advanced AI systems.
- Work on challenging, real-world software engineering problems.
- No prior AI experience required.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Navigating the AI Shift
What is Agentic Programming and Why Should Developers Care?
The 12 Best Jobs for Software Engineers
What is Software Engineering in the Age of AI?