MCPcopy Create free account
hub / github.com/THUDM/AgentTuning / JudgeConfig

Class JudgeConfig

AgentBench.old/src/tasks/os_interaction/task.py:106–122  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

104
105
106class JudgeConfig:
107 image: str = None
108 init_script: List[Tuple[str, str]] = None
109 start: Tuple[str, str] = None
110 description: str
111 check: list = None
112 match: dict = None
113 example_script: str = None
114
115 def get_evaluation_type(self):
116 if self.check:
117 return "check"
118 elif self.match:
119 return "match"
120
121 def get_evaluation_content(self):
122 return self.check or self.match
123
124ONE_SHOT=[
125 {

Callers 1

_load_configsMethod · 0.85

Calls

no outgoing calls

Tested by

no test coverage detected