MCPcopy Create free account
hub / github.com/THUDM/AgentTuning / evaluate

Method evaluate

AgentBench.old/src/tasks/composite_task.py:32–39  ·  view source on GitHub ↗
(self, agent: Agent)

Source from the content-addressed store, hash-verified

30 self.tasks.append(sub_task)
31
32 def evaluate(self, agent: Agent) -> Dict[str, Dict[str, Any]]:
33 print(f"Evaluating Composite Task '{self.name}' ...")
34 results = {}
35 for task in self.tasks:
36 result = task.evaluate(agent)
37 results[task.name] = result
38 self.save_metrics_all(results)
39 return results
40
41 def _sub_output_dir(self, sub_task: Task) -> str:
42 target_category = sub_task.category or sub_task.name or "default"

Callers

nothing calls this directly

Calls 1

save_metrics_allMethod · 0.80

Tested by

no test coverage detected