Skip to content
Inside the Frontier

Evaluation

LMSYS Chatbot Arena

Elo ratings from blind side-by-side evaluations by human raters on the Chatbot Arena; evaluated models are the Gemma 2 Instruction Tuned 2B, 9B and 27B

Core capabilities Google DeepMind — Gemma
Ask about this evaluation

How it was run

Open a release to see the setup, scoring, and other details that the lab published. Only fields the lab actually disclosed are shown.

Gemma 2
Google DeepMind — Gemma

partial detail 19 method fields published

See how this test was run
Gemma 3
Google DeepMind — Gemma

partial detail 21 method fields published

See how this test was run