Claude 3.5 Sonnet
Anthropic
rich detail 18 method fields published
Evaluation
Internal agentic coding evaluation (Claude 3.5 Sonnet)
agentic coding: understand an open-source codebase and implement a pull request
How it was run
Open a release to see the setup, scoring, and other details that the lab published. Only fields the lab actually disclosed are shown.