WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Back

LLM Evaluation Engineer

CYNET SYSTEMS INC.
Los Angeles, CA, United States
3 months ago
Apply on dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
dice.com

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Software Applications Programming Tools Software Engineering Systems Integration Large Language Models Multi-Agent Systems

Job description

  • Evaluate Claude for Desktop capabilities, including Cowork, Code, CLI, and APIs.
  • Conduct hands-on testing, prototyping, and technical validation.
  • Assess integration patterns, security considerations, and scalability.
  • Provide clear findings, recommendations, and technical feedback.

Requirements

  • Senior-level engineering or software development experience.
  • Demonstrated, hands-on experience with Claude (Anthropic) tooling and APIs.
  • Strong background in API integration, developer tooling, and CLI-based workflows.
  • Experience evaluating AI/LLM platforms in an enterprise environment., * Experience with AI developer platforms, copilots, or agent frameworks.
  • Familiarity with desktop application integrations and enterprise controls.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dice.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

Moments

Explore playlists

5:30 min

Building components of a real-world LLM lifecycle

Maxim Salnikov Maxim Salnikov · LIVE

2:30 min

Evaluating and selecting an AI pair programming tool

Alexander Trusheim Alexander Trusheim +1 · World Congress 2025

3:00 min

Designing data ingestion architecture with system integration

Eldert Grootenboer +1 · World Congress 2023

2:26 min

Comparing single-shot prompts and multi-agent systems

Dr. Alexander Wachtel Dr. Alexander Wachtel +1 · World Congress 2025

2:13 min

Enhancing personal developer productivity with AI tools

Eric Bowman Eric Bowman · World Congress 2026 Europe

1:38 min

Empowering developers through continuous learning and modern programming tools

Katrin Lehmann Katrin Lehmann +1 · World Congress 2025

Videos

See all
AI Agents & Agentic AI thumbnail
26:53
Europe 2026 Virtual • 2 months ago

AI Agents & Agentic AI

Xavier Sala Presas

AI Pair Programming with GitHub Copilot at SAP: Looking Back, Looking Forward! thumbnail
30:30
World Congress 2025 • about 1 year ago

AI Pair Programming with GitHub Copilot at SAP: Looking Back, Looking Forward!

Alexander Trusheim, Sumeet Shetty

Designing and Deploying Distributed Multimodal Multi-Agent Systems with Google's AI Stac thumbnail
54:24
Europe 2026 Virtual • 2 months ago

Designing and Deploying Distributed Multimodal Multi-Agent Systems with Google's AI Stac

Saoussen Chaabnia

Three years of putting LLMs into Software - Lessons learned thumbnail
26:30
World Congress 2025 • about 1 year ago

Three years of putting LLMs into Software - Lessons learned

Simon A.T. Jiménez

LLMs in the wild: Building an AI agent that survives production thumbnail
28:06
World Congress 2026 Europe • about 2 months ago

LLMs in the wild: Building an AI agent that survives production

Steven Mi, Giampaolo Casolla

Exploring AI: Opportunities and Risks in Development thumbnail
35:01
LIVE • over 1 year ago

Exploring AI: Opportunities and Risks in Development

Angie Jones, Kent C Dobbs, Liran Tal, Chris Heilmann

Related articles

See all