MCPcopy Create free account
hub / github.com/OpenBitSys/BitDistiller / aggregation

Method aggregation

test/general/lm_eval/base.py:646–652  ·  view source on GitHub ↗

:returns: {str: [metric_score] -> float} A dictionary where keys are the names of submetrics and values are functions that aggregate a list of metric scores

(self)

Source from the content-addressed store, hash-verified

644
645 @abstractmethod
646 def aggregation(self):
647 """
648 :returns: {str: [metric_score] -> float}
649 A dictionary where keys are the names of submetrics and values are
650 functions that aggregate a list of metric scores
651 """
652 pass
653
654 @abstractmethod
655 def higher_is_better(self):

Callers 1

evaluateFunction · 0.45

Calls

no outgoing calls

Tested by

no test coverage detected