Evaluation

Inter-Rater Reliability (IRR) of human evaluations

Gwet's AC2 inter-rater reliability across three annotators on the 7-point Likert helpfulness task

Other documented tests Meta

Ask about this evaluation

How it was run

Open a release to see the setup, scoring, and other details that the lab published. Only fields the lab actually disclosed are shown.

Llama 2 Jul 2023

Meta

partial detail 11 method fields published

See how this test was run