MCPcopy Create free account
hub / github.com/IBM/AssetOpsBench / ScorerResult

Class ScorerResult

src/evaluation/models.py:69–81  ·  view source on GitHub ↗

Output of a single :class:`Scorer` invocation. ``scorer`` is the registered name of the scorer that produced this result — distinct from ``Scenario.scoring_method``, which is the *requested* scorer on the input side.

Source from the content-addressed store, hash-verified

67
68
69class ScorerResult(BaseModel):
70 """Output of a single :class:`Scorer` invocation.
71
72 ``scorer`` is the registered name of the scorer that produced this
73 result — distinct from ``Scenario.scoring_method``, which is the
74 *requested* scorer on the input side.
75 """
76
77 scorer: str
78 passed: bool
79 score: float = 0.0
80 rationale: str = ""
81 details: dict[str, Any] = Field(default_factory=dict)
82
83
84class ScenarioResult(BaseModel):

Callers 10

_stub_scorerFunction · 0.90
capture_scorerFunction · 0.90
_fail_scorerFunction · 0.90
_resultFunction · 0.90
_resultFunction · 0.90
_always_pass_scorerFunction · 0.90
_always_fail_scorerFunction · 0.90
__call__Method · 0.85
__call__Method · 0.85

Calls

no outgoing calls

Tested by 8

_stub_scorerFunction · 0.72
capture_scorerFunction · 0.72
_fail_scorerFunction · 0.72
_resultFunction · 0.72
_resultFunction · 0.72
_always_pass_scorerFunction · 0.72
_always_fail_scorerFunction · 0.72