Gemma 2
Google DeepMind — Gemma
rich detail 26 method fields published
Evaluation
Offensive cyber-security
automated capture-the-flag (CTF) challenges where the model is tasked with hacking into a simulated server to retrieve secret information; run on the Gemma 2 27B against InterCode-CTF, an internal CTF suite (Phuong et al. 2024) and a challenge based on Hack the Box; number of successful hackings reported
How it was run
Open a release to see the setup, scoring, and other details that the lab published. Only fields the lab actually disclosed are shown.