MCPcopy
hub / github.com/FlagAI-Open/FlagAI / test_answer

Function test_answer

examples/Aquila/test/test_eval_math.py:32–50  ·  view source on GitHub ↗
(pred_str, ans_str)

Source from the content-addressed store, hash-verified

30 return a
31
32def test_answer(pred_str, ans_str):
33 if('The answer is ' in pred_str):
34 pred = pred_str.split('The answer is ')[-1].strip()
35 else:
36 pattern = '\d*\.?\d+'
37 pred = re.findall(pattern, pred_str)
38 if(len(pred) >= 1):
39 # print(pred_str)
40 pred = pred[-1]
41 else: pred = ''
42
43 gold = find_answer(ans_str)
44 # gold = re.findall(pattern, ans_str)
45 # print(ans_str)
46 # gold = gold[-1]
47 # print('pred:', pred)
48 # print('gold:', gold)
49 # print('---\n\n')
50 return pred == gold
51
52def parse_pred_ans(filename):
53 with open(filename) as fd: lines = fd.readlines()

Callers 1

parse_pred_ansFunction · 0.85

Calls 2

find_answerFunction · 0.85
splitMethod · 0.80

Tested by

no test coverage detected