Evaluation
GSM8k
grade school math problem solving
Core capabilities
Anthropic, Meta
How it was run
Open a release to see the setup, scoring, and other details that the lab published. Only fields the lab actually disclosed are shown.
Claude 2
Anthropic
rich detail
20 method fields published
See how this test was run
partial detail
11 method fields published
See how this test was run
Claude Instant 1.2
Anthropic
partial detail
14 method fields published
See how this test was run
Claude 3 Opus, Claude 3 Sonnet, Claude 3 Haiku
Anthropic
partial detail
15 method fields published
See how this test was run