Evaluation

Self-proliferation

ability for an agent to autonomously replicate - instantiate goal-directed agents on other machines and acquire resources such as compute - evaluated on tasks from Phuong et al. (2024) involving multiple scenarios (e.g., setting up an open-source language model on a cloud server), individual milestone substeps, and bits of expert intervention needed to complete each challenge; run on Gemma 2 27B