MCPcopy
hub / github.com/EleutherAI/lm-evaluation-harness / validation_docs

Method validation_docs

lm_eval/api/task.py:190–195  ·  view source on GitHub ↗

:return: Iterable[obj] A iterable of any object, that doc_to_text can handle

(self)

Source from the content-addressed store, hash-verified

188 return []
189
190 def validation_docs(self) -> Iterable:
191 """
192 :return: Iterable[obj]
193 A iterable of any object, that doc_to_text can handle
194 """
195 return []
196
197 def test_docs(self) -> Iterable:
198 """

Callers 12

fewshot_docsMethod · 0.95
fewshot_contextMethod · 0.95
eval_docsMethod · 0.95
mainFunction · 0.45
get_prompts.pyFile · 0.45
make_table_tasks.pyFile · 0.45
test_doc_to_textMethod · 0.45
test_mmlu_prompt_renderingFunction · 0.45
test_doc_to_textMethod · 0.45
test_create_choicesMethod · 0.45
test_doc_to_targetMethod · 0.45
test_construct_requestsMethod · 0.45

Calls

no outgoing calls

Tested by 6

test_doc_to_textMethod · 0.36
test_mmlu_prompt_renderingFunction · 0.36
test_doc_to_textMethod · 0.36
test_create_choicesMethod · 0.36
test_doc_to_targetMethod · 0.36
test_construct_requestsMethod · 0.36