MCPcopy Create free account
hub / github.com/OpenSparseLLMs/MoM / aggregation

Method aggregation

lm-eval-harness/lm_eval/api/task.py:524–530  ·  view source on GitHub ↗

:returns: {str: [metric_score] -> float} A dictionary where keys are the names of submetrics and values are functions that aggregate a list of metric scores

(self)

Source from the content-addressed store, hash-verified

522
523 @abc.abstractmethod
524 def aggregation(self):
525 """
526 :returns: {str: [metric_score] -> float}
527 A dictionary where keys are the names of submetrics and values are
528 functions that aggregate a list of metric scores
529 """
530 pass
531
532 @abc.abstractmethod
533 def higher_is_better(self):

Callers 1

evaluateFunction · 0.45

Calls

no outgoing calls

Tested by

no test coverage detected