MCPcopy Create free account
hub / github.com/THUDM/AgentTuning / get_data

Method get_data

AgentBench.old/src/task.py:187–188  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

185 return {"EM": lambda outputs, targets: len([1 for o, t in zip(outputs, targets) if o == t]) / min(len(outputs), len(targets))}
186
187 def get_data(self) -> Dataset[T_INPUT, T_TARGET]:
188 raise NotImplementedError
189
190 def predict_single(self, session: Session, data_item: T_INPUT) -> T_OUTPUT:
191 raise NotImplementedError

Callers 1

evaluateMethod · 0.95

Calls

no outgoing calls

Tested by

no test coverage detected