Gemini 1.5
Google DeepMind — Gemini
partial detail 7 method fields published
Evaluation
GPQA (graduate-level science QA; Gemini 1.5)
GPQA (Rein et al., 2023): graduate-level science problems; 1.5 Pro +5.8% over 1.0 Ultra; Flash +11.6%
How it was run
Open a release to see the setup, scoring, and other details that the lab published. Only fields the lab actually disclosed are shown.