MCPcopy Create free account
hub / github.com/OpenBitSys/BitDistiller / _squad_agg

Function _squad_agg

test/general/lm_eval/tasks/squad.py:40–43  ·  view source on GitHub ↗
(key, items)

Source from the content-addressed store, hash-verified

38
39
40def _squad_agg(key, items):
41 predictions, references = zip(*items)
42
43 return _squad_metric(predictions=predictions, references=references).get(key, 0)
44
45
46class SQuAD2(Task):

Callers

nothing calls this directly

Calls 1

_squad_metricFunction · 0.85

Tested by

no test coverage detected