MCPcopy Create free account
hub / github.com/TIGER-AI-Lab/LongRAG / has_correct_answer

Function has_correct_answer

utils/eval_util.py:65–79  ·  view source on GitHub ↗
(retrieve_doc, answers)

Source from the content-addressed store, hash-verified

63
64
65def has_correct_answer(retrieve_doc, answers):
66 tokenizer = SimpleTokenizer()
67 retrieve_doc = _normalize(retrieve_doc)
68 # retrieve_doc = normalize_answer(retrieve_doc)
69 retrieve_doc = tokenizer.tokenize(retrieve_doc, uncased=True)
70
71 for single_answer in answers:
72 single_answer = _normalize(single_answer)
73 # single_answer = normalize_answer(single_answer)
74 single_answer = tokenizer.tokenize(single_answer, uncased=True)
75
76 for i in range(0, len(retrieve_doc) - len(single_answer) + 1):
77 if single_answer == retrieve_doc[i: i + len(single_answer)]:
78 return 1
79 return 0

Callers 1

eval_qa.pyFile · 0.90

Calls 3

tokenizeMethod · 0.95
_normalizeFunction · 0.90
SimpleTokenizerClass · 0.70

Tested by

no test coverage detected