MCPcopy Create free account
hub / github.com/ScaleML/AgentSPEX / parse_answer

Function parse_answer

src/benchmarks/elaipbench/evaluate.py:16–25  ·  view source on GitHub ↗

Extract answer letter(s) from the agent's response. For SA-MCQ: returns a single letter like "B". For MA-MCQ: returns sorted letters like "ABC".

(response: str, question_type: str)

Source from the content-addressed store, hash-verified

14
15
16def parse_answer(response: str, question_type: str) -> Optional[str]:
17 """Extract answer letter(s) from the agent's response.
18
19 For SA-MCQ: returns a single letter like "B".
20 For MA-MCQ: returns sorted letters like "ABC".
21 """
22 if question_type == "SA-MCQ":
23 return _parse_single_answer(response)
24 else:
25 return _parse_multi_answer(response)
26
27
28def _parse_single_answer(response: str) -> Optional[str]:

Callers 1

run_instanceFunction · 0.90

Calls 2

_parse_single_answerFunction · 0.85
_parse_multi_answerFunction · 0.85

Tested by

no test coverage detected