Add --examples Argument for Fine-Grained Task Evaluation in lm-evaluation-harness. This feature is the first step towards efficient multi-prompt evaluation with PromptEval [1,2]#2520
Open
felipemaiapolo wants to merge 6 commits intoEleutherAI:mainfrom mirianfsilva:examples-arg
+78-13
