MCPcopy Create free account
hub / github.com/OpenBitSys/BitDistiller / construct_requests

Method construct_requests

test/general/lm_eval/tasks/glue.py:193–197  ·  view source on GitHub ↗
(self, doc, ctx)

Source from the content-addressed store, hash-verified

191 return " {}".format({0: "True", 1: "Neither", 2: "False"}[doc["label"]])
192
193 def construct_requests(self, doc, ctx):
194 ll_true, _ = rf.loglikelihood(ctx, " True")
195 ll_neither, _ = rf.loglikelihood(ctx, " Neither")
196 ll_false, _ = rf.loglikelihood(ctx, " False")
197 return ll_true, ll_neither, ll_false
198
199 def process_results(self, doc, results):
200 gold = doc["label"]

Callers

nothing calls this directly

Calls 1

loglikelihoodMethod · 0.45

Tested by

no test coverage detected