Llama 3
Meta
partial detail 8 method fields published
Evaluation
Multi-programming language code generation (MultiPL-E)
MultiPL-E benchmark (translations of HumanEval and MBPP problems) across a subset of popular programming languages
How it was run
Open a release to see the setup, scoring, and other details that the lab published. Only fields the lab actually disclosed are shown.