Function is_correct

eval_general/eval_gsm8k_tgi.py:149–152 · view source on GitHub ↗

(completion, answer)

Source from the content-addressed store, hash-verified

147
148
149	def is_correct(completion, answer):
150	gold = extract_answer_hf(answer)
151	assert gold != INVALID_ANS, "No ground truth answer found in the document."
152	return extract_answer(completion) == gold
153
154
155	if __name__ == '__main__':

process_docFunction · 0.85

extract_answer_hfFunction · 0.85

extract_answerFunction · 0.85

no test coverage detected