MCPcopy Create free account
hub / github.com/OpenBitSys/BitDistiller / construct_requests

Method construct_requests

test/general/lm_eval/base.py:619–630  ·  view source on GitHub ↗

Uses RequestFactory to construct Requests and returns an iterable of Requests which will be sent to the LM. :param doc: The document as returned from training_docs, validation_docs, or test_docs. :param ctx: str The context string, generated by fewsho

(self, doc, ctx)

Source from the content-addressed store, hash-verified

617
618 @abstractmethod
619 def construct_requests(self, doc, ctx):
620 """Uses RequestFactory to construct Requests and returns an iterable of
621 Requests which will be sent to the LM.
622
623 :param doc:
624 The document as returned from training_docs, validation_docs, or test_docs.
625 :param ctx: str
626 The context string, generated by fewshot_context. This includes the natural
627 language description, as well as the few shot examples, and the question
628 part of the document for `doc`.
629 """
630 pass
631
632 @abstractmethod
633 def process_results(self, doc, results):

Callers 1

evaluateFunction · 0.45

Calls

no outgoing calls

Tested by

no test coverage detected