MCPcopy Create free account
hub / github.com/FlashSampling/FlashSampling / judge_eval.py

File judge_eval.py

benchmarking/vllm/judge_eval.py:None–None  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

1"""LLM-as-a-judge evaluation for GSM8K samples.
2
3lm-eval's regex scoring misses answers in \\boxed{X} format. This script
4re-evaluates the JSONL samples using a judge LLM to get real accuracy.

Callers

nothing calls this directly

Calls 1

mainFunction · 0.70

Tested by

no test coverage detected