Claude 3 Opus, Claude 3 Sonnet, Claude 3 Haiku
Anthropic
partial detail 17 method fields published
Evaluation
Human preference evaluations on expert knowledge and core capabilities (Claude 3)
head-to-head human preference win rates (Claude 3 Sonnet vs Claude 2 and Claude Instant) on common use cases, non-English tasks, and expert-knowledge domains
How it was run
Open a release to see the setup, scoring, and other details that the lab published. Only fields the lab actually disclosed are shown.