MCPcopy Create free account
hub / github.com/VectifyAI/OpenKB / _build_eval_set

Function _build_eval_set

tests/test_skill_evaluator.py:164–170  ·  view source on GitHub ↗
(n_trig: int = 3, n_no: int = 3)

Source from the content-addressed store, hash-verified

162
163
164def _build_eval_set(n_trig: int = 3, n_no: int = 3) -> list[EvalPrompt]:
165 prompts: list[EvalPrompt] = []
166 for i in range(n_trig):
167 prompts.append(EvalPrompt(question=f"trig {i}", expected="trigger"))
168 for i in range(n_no):
169 prompts.append(EvalPrompt(question=f"no {i}", expected="no-trigger"))
170 return prompts
171
172
173async def _supported_coverage(content, question, *, model):

Calls 1

EvalPromptClass · 0.90

Tested by

no test coverage detected