Claude 3 Opus, Claude 3 Sonnet, Claude 3 Haiku
Anthropic
partial detail 17 method fields published
Evaluation
Factual accuracy internal benchmark (100Q Hard, Easy-Medium QA, Multi-factual)
internal benchmark comparing model answers to ground truth on questions of different formats and obscurity (100Q Hard, Easy-Medium QA, Multi-factual); tracks correct, incorrect, and unsure responses
How it was run
Open a release to see the setup, scoring, and other details that the lab published. Only fields the lab actually disclosed are shown.