MCPcopy Create free account
hub / github.com/OpenSparseLLMs/MoM / process_results

Method process_results

lm-eval-harness/lm_eval/api/task.py:511–521  ·  view source on GitHub ↗

Take a single document and the LM results and evaluates, returning a dict where keys are the names of submetrics and values are the values of the metric for that one document :param doc: The document as returned from training_docs, validation_docs, or test_docs.

(self, doc, results)

Source from the content-addressed store, hash-verified

509
510 @abc.abstractmethod
511 def process_results(self, doc, results):
512 """Take a single document and the LM results and evaluates, returning a
513 dict where keys are the names of submetrics and values are the values of
514 the metric for that one document
515
516 :param doc:
517 The document as returned from training_docs, validation_docs, or test_docs.
518 :param results:
519 The results of the requests created in construct_requests.
520 """
521 pass
522
523 @abc.abstractmethod
524 def aggregation(self):

Callers 2

evaluateFunction · 0.45
process_resultsMethod · 0.45

Calls

no outgoing calls

Tested by

no test coverage detected