Take a single document and the LM results and evaluates, returning a dict where keys are the names of submetrics and values are the values of the metric for that one document :param doc: The document as returned from training_docs, validation_docs, or test_docs.
(self, doc, results)
| 631 | |
| 632 | @abstractmethod |
| 633 | def process_results(self, doc, results): |
| 634 | """Take a single document and the LM results and evaluates, returning a |
| 635 | dict where keys are the names of submetrics and values are the values of |
| 636 | the metric for that one document |
| 637 | |
| 638 | :param doc: |
| 639 | The document as returned from training_docs, validation_docs, or test_docs. |
| 640 | :param results: |
| 641 | The results of the requests created in construct_requests. |
| 642 | """ |
| 643 | pass |
| 644 | |
| 645 | @abstractmethod |
| 646 | def aggregation(self): |