Llama 3
Meta
partial detail 12 method fields published
Evaluation
Python code generation (HumanEval, MBPP, HumanEval+, MBPP EvalPlus)
pass@1 on HumanEval, MBPP, HumanEval+ (enhanced tests), and MBPP EvalPlus base v0.2.0 (378 well-formed problems)
How it was run
Open a release to see the setup, scoring, and other details that the lab published. Only fields the lab actually disclosed are shown.