MCPcopy Create free account
hub / github.com/InternScience/SciReason / __init__

Method __init__

opencompass/datasets/custom.py:23–30  ·  view source on GitHub ↗
(self, options)

Source from the content-addressed store, hash-verified

21class OptionSimAccEvaluator(BaseEvaluator):
22
23 def __init__(self, options) -> None:
24 super().__init__()
25 if not all((isinstance(i, str) and i.isupper() and len(i) == 1)
26 for i in options):
27 raise ValueError(
28 f'Each options should be single upper letter, got {options}')
29
30 self.options = options
31
32 def match_any_label(self, pred, test_item):
33 from rapidfuzz.distance import Levenshtein as L

Callers 1

__init__Method · 0.45

Calls

no outgoing calls

Tested by

no test coverage detected