Evaluation

Autonomy evaluations for Claude Opus 4 / Claude Sonnet 4 (RSP)

METR data deduplication threshold, SWE-bench Verified hard subset, Internal AI Research Evaluation Suites 1 and 2 (kernel optimization, quadruped locomotion, novel compiler), internal researcher surveys

Autonomy & self-improvement Anthropic

Ask about this evaluation

How it was run

Open a release to see the setup, scoring, and other details that the lab published. Only fields the lab actually disclosed are shown.

Claude Opus 4, Claude Sonnet 4 May 2025

Anthropic

rich detail 21 method fields published

See how this test was run