Evaluation

OpenAI PRs

Ability to replicate pull request contributions by OpenAI employees

Autonomy & self-improvement OpenAI

How it was run

Open a release to see the setup, scoring, and other details that the lab published. Only fields the lab actually disclosed are shown.

o3-mini Jan 2025

OpenAI

rich detail 13 method fields published

See how this test was run

Deep Research Feb 2025

OpenAI

rich detail 14 method fields published

See how this test was run

GPT-4.5 Feb 2025

OpenAI

rich detail 14 method fields published

See how this test was run

o3/o4-mini Apr 2025

OpenAI

rich detail 14 method fields published

See how this test was run