MCPcopy Create free account
hub / github.com/InternScience/SciReason / _score

Method _score

opencompass/tasks/openicl_eval.py:87–104  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

85 self._score()
86
87 def _score(self):
88 # Load and preprocess test data
89 test_set = self._load_and_preprocess_test_data()
90 # Load predictions
91 pred_dicts, pred_strs = self._load_predictions()
92
93 # Process predictions
94 pred_strs = self._process_predictions(pred_strs)
95
96 # Evaluate predictions
97 result = self._evaluate_predictions(
98 pred_strs,
99 test_set,
100 pred_dicts,
101 )
102
103 # Save results
104 self._save_results(result)
105
106 def _load_and_preprocess_test_data(self):
107 """Load test dataset and apply postprocessing if needed."""

Callers 1

runMethod · 0.95

Calls 5

_load_predictionsMethod · 0.95
_process_predictionsMethod · 0.95
_evaluate_predictionsMethod · 0.95
_save_resultsMethod · 0.95

Tested by

no test coverage detected