Evaluation
Needle In A Haystack
long-context information retrieval
Core capabilities
Anthropic
How it was run
Open a release to see the setup, scoring, and other details that the lab published. Only fields the lab actually disclosed are shown.
Claude 3 Opus, Claude 3 Sonnet, Claude 3 Haiku
Anthropic
rich detail
18 method fields published
See how this test was run
Claude 3.5 Sonnet
Anthropic
rich detail
16 method fields published
See how this test was run