Skip to content

Evaluation

Gemini 2.5 quantitative evaluation vs other large language models

Quantitative evaluation comparing Gemini 2.X family to Gemini 1.5 and to other LLMs (Table 3, Table 4); pass@1 single-attempt settings; semantic-similarity and model-based decontamination; internal non-public benchmarks (e.g., HiddenMath)

General benchmark suites Google DeepMind — Gemini

How it was run

Open a release to see the setup, scoring, and other details that the lab published. Only fields the lab actually disclosed are shown.

Gemini 2.5
Google DeepMind — Gemini

rich detail 16 method fields published

See how this test was run