Llama 3
Meta
partial detail 10 method fields published
Evaluation
Discoverable memorization measurement
Discoverable memorization (Nasr et al. 2023): sample prompts and ground truths at different frequencies of occurrence in training data using a rolling hash; report memorization rates for extraction attempts (n=50, n=1000)
How it was run
Open a release to see the setup, scoring, and other details that the lab published. Only fields the lab actually disclosed are shown.