MCPcopy Create free account
hub / github.com/colbymchenry/codegraph / offload-eval-judge.mjs

File offload-eval-judge.mjs

scripts/agent-eval/offload-eval-judge.mjs:None–None  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

1#!/usr/bin/env node
2// Accuracy judge. For each run in results.jsonl:
3// - end-to-end: agent finalAnswer vs verified ground truth (all arms)
4// - fidelity: offload synthesized answer vs ground truth (offload arm only)

Callers

nothing calls this directly

Calls 12

NumberInterface · 0.85
e2ePromptFunction · 0.85
medOfFunction · 0.85
mapMethod · 0.80
parseMethod · 0.80
pushMethod · 0.80
fromMethod · 0.80
fidPromptFunction · 0.70
workerFunction · 0.70
errorMethod · 0.65
allMethod · 0.65
joinMethod · 0.45

Tested by

no test coverage detected