Evaluation

Visual Spatial Reasoning (VSR) evaluation

Visual Spatial Reasoning (VSR) benchmark framed as a QA classification task with True/False answers: model determines whether a statement about the spatial relationship of objects in the image is correct

Multimodal Google DeepMind — Gemma

Ask about this evaluation

How it was run

Open a release to see the setup, scoring, and other details that the lab published. Only fields the lab actually disclosed are shown.

PaliGemma 2 Dec 2024

Google DeepMind — Gemma

rich detail 22 method fields published

See how this test was run