MCPcopy Create free account
hub / github.com/SkyworkAI/DeepResearchAgent / eval

Method eval

src/benchmark/context.py:490–495  ·  view source on GitHub ↗

Evaluate a benchmark task (delegates to benchmark instance).

(self, name: str, task: Task)

Source from the content-addressed store, hash-verified

488 return await instance.step()
489
490 async def eval(self, name: str, task: Task) -> Optional[Task]:
491 """Evaluate a benchmark task (delegates to benchmark instance)."""
492 instance = await self.get(name)
493 if instance is None:
494 raise ValueError(f"Benchmark '{name}' not found")
495 return await instance.eval(task)
496
497 async def stats(self, name: str) -> Optional[Stats]:
498 """Get benchmark statistics (delegates to benchmark instance)."""

Callers

nothing calls this directly

Calls 1

getMethod · 0.95

Tested by

no test coverage detected