MCPcopy Create free account
hub / github.com/THUDM/AgentBench / JudgeConfig

Class JudgeConfig

src/server/tasks/os_interaction/task.py:127–143  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

125
126
127class JudgeConfig:
128 image: str = None
129 init_script: List[Tuple[str, str]] = None
130 start: Tuple[str, str] = None
131 description: str
132 check: list = None
133 match: dict = None
134 example_script: str = None
135
136 def get_evaluation_type(self):
137 if self.check:
138 return "check"
139 elif self.match:
140 return "match"
141
142 def get_evaluation_content(self):
143 return self.check or self.match
144
145
146class OSInteraction(Task):

Callers 1

_load_configsMethod · 0.85

Calls

no outgoing calls

Tested by

no test coverage detected