Gemini 1.5
Google DeepMind — Gemini
rich detail 9 method fields published
Evaluation
Audio needle-in-a-haystack retrieval (long-context)
Audio needle-in-a-haystack: find 'the secret keyword is needle' clip within audio haystack up to 107 hours (9.9M tokens) from VoxPopuli; compared to Whisper+GPT-4 Turbo chunked transcription
How it was run
Open a release to see the setup, scoring, and other details that the lab published. Only fields the lab actually disclosed are shown.