Skip to content

Evaluation

Memorization rate evaluation (prefix continuation)

Memorization measured with Gemma-Team (2024) methodology: sample 10,000 documents per pre-training corpus, prompt with first 50 tokens, classify exact match vs edit distance <10%

Memorization & privacy Google DeepMind — Gemini

How it was run

Open a release to see the setup, scoring, and other details that the lab published. Only fields the lab actually disclosed are shown.

Gemini 1.5
Google DeepMind — Gemini

rich detail 9 method fields published

See how this test was run