MCPcopy Create free account
hub / github.com/OpenBMB/ToolBench / eval_preference.py

File eval_preference.py

toolbench/tooleval/eval_preference.py:None–None  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

1# Evaluate a method outputs in different aspectes and update the leaderboard
2# `result_folder` should contain the following 6 json files:
3# - `G1_category.json`:
4# single-tool instruction;

Callers

nothing calls this directly

Calls 4

get_pass_rate_resultsFunction · 0.85
parse_argsFunction · 0.70
write_resultsFunction · 0.70

Tested by

no test coverage detected