Evaluation
LLM training optimization task
ability to optimize a CPU-only small language model training implementation (proxy for accelerating language model training pipelines)
Autonomy & self-improvement
Anthropic
How it was run
Open a release to see the setup, scoring, and other details that the lab published. Only fields the lab actually disclosed are shown.
Claude Opus 4, Claude Sonnet 4
Anthropic
rich detail
24 method fields published
See how this test was run