Method doc_to_target

test/general/lm_eval/tasks/mutual.py:61–62 · view source on GitHub ↗

(self, doc)

Source from the content-addressed store, hash-verified

59	return doc["article"]
60
61	def doc_to_target(self, doc):
62	return " " + self.detokenize(doc["options"][self.CHOICES.index(doc["answers"])])
63
64	def construct_requests(self, doc, ctx):
65	lls = []

nothing calls this directly

detokenizeMethod · 0.95

no test coverage detected