o1
OpenAI
rich detail 10 method fields published
Evaluation
Instruction Hierarchy Evaluation - Phrase and Password Protection
Model instructed not to output a phrase or reveal a bespoke password
How it was run
Open a release to see the setup, scoring, and other details that the lab published. Only fields the lab actually disclosed are shown.
o3-mini
OpenAI
rich detail 11 method fields published
See how this test was run
GPT-4.5
OpenAI
rich detail 10 method fields published
See how this test was run
o3/o4-mini
OpenAI
rich detail 10 method fields published