Gemma 3
Google DeepMind — Gemma
rich detail 21 method fields published
Evaluation
Standard benchmarks (IT zero-shot)
zero-shot benchmark performance of final IT models compared to Gemma 2, Gemini 1.5 and Gemini 2.0 (Table 6); appendix Table 18 adds internal and external IT benchmarks including Natural2Code (Gemini 1.0 internal held-out dataset), BBEH (BIG-Bench Extra Hard) and ECLeKTic
How it was run
Open a release to see the setup, scoring, and other details that the lab published. Only fields the lab actually disclosed are shown.