Gemini 1.0
Google DeepMind — Gemini
rich detail 11 method fields published
Evaluation
MGSM (multilingual math)
multilingual math reasoning (translated GSM8K)
How it was run
Open a release to see the setup, scoring, and other details that the lab published. Only fields the lab actually disclosed are shown.
Claude 3 Opus, Claude 3 Sonnet, Claude 3 Haiku
Anthropic
rich detail 18 method fields published
See how this test was run
Llama 3
Meta
partial detail 12 method fields published