Skip to content
Inside the Frontier

Evaluation

Representational harms benchmark evaluation (WinoBias/BBQ)

representational harms benchmarked against academic datasets such as WinoBias and BBQ; safety benchmark results additionally reported on BBQ, BOLD, Winogender, Winobias, RealToxicity and TruthfulQA

Bias & fairness Google DeepMind — Gemma
Ask about this evaluation

How it was run

Open a release to see the setup, scoring, and other details that the lab published. Only fields the lab actually disclosed are shown.

Gemma 1
Google DeepMind — Gemma

rich detail 18 method fields published

See how this test was run
Gemma 2
Google DeepMind — Gemma

rich detail 18 method fields published

See how this test was run