Evaluation

SimpleQA

SimpleQA factuality on straightforward but challenging knowledge questions

Hallucination & factual accuracy OpenAI

How it was run

Open a release to see the setup, scoring, and other details that the lab published. Only fields the lab actually disclosed are shown.

o1-preview Sep 2024

OpenAI

rich detail 11 method fields published

See how this test was run

o1 Dec 2024

OpenAI

rich detail 11 method fields published

See how this test was run

GPT-4.5 Feb 2025

OpenAI

partial detail 6 method fields published

See how this test was run

o3/o4-mini Apr 2025

OpenAI

rich detail 11 method fields published

See how this test was run