MCPcopy Create free account
hub / github.com/Alibaba-NLP/ViDoRAG / evaluate

Method evaluate

llms/evaluator.py:71–83  ·  view source on GitHub ↗
(self, query, reference_answer, generated_answer)

Source from the content-addressed store, hash-verified

69 return score, passing, judge
70
71 def evaluate(self, query, reference_answer, generated_answer):
72 system_prompt = self.system_template.format(
73 query=query,
74 reference_answer=reference_answer,
75 generated_answer=generated_answer
76 )
77 score, passing, judge = self.llm_eval(query, reference_answer, generated_answer)
78 result = dict(
79 score=score,
80 passing=passing,
81 judge=judge
82 )
83 return result
84
85
86

Callers 1

vidoragMethod · 0.80

Calls 1

llm_evalMethod · 0.95

Tested by

no test coverage detected