Evaluation

Multimodal Refusal Evaluation

Refusals for multimodal inputs on standard set for disallowed text+image content and overrefusals (categories: sexual/exploitative, self-harm/intent, self-harm/instructions)

Multimodal OpenAI

Ask about this evaluation

How it was run

Open a release to see the setup, scoring, and other details that the lab published. Only fields the lab actually disclosed are shown.

o1 Dec 2024

OpenAI

rich detail 10 method fields published

See how this test was run

GPT-4.5 Feb 2025

OpenAI

rich detail 10 method fields published

See how this test was run