Functions — github.com/THUDM/AgentBench

CodeHub MCPcopy Create free account

hub / github.com/THUDM/AgentBench / functions

Functions312 in github.com/THUDM/AgentBench

⨍ Functions 312◇ Types & classes 81 ↳ Endpoints 1

↓ 1 callersMethodargmax

Argmax by attribute. Returns (new_variable, "Observation: ...").

src/server/tasks/knowledgegraph/api.py:176

↓ 1 callersFunctionbleu_score

(reference, candidate)

src/server/tasks/alfworld/utils.py:8

↓ 1 callersMethodcalculate_overall

(self, results: List[TaskOutput])

src/client/task.py:127

↓ 1 callersMethodcheck

src/utils/rules.py:37

↓ 1 callersFunctioncheck_context_limit

src/client/agents/http_agent.py:138

↓ 1 callersMethodclose_env

src/server/tasks/alfworld/environment.py:29

↓ 1 callersMethodcompare_results

比较答案和标准答案参数: answer - 模型输出的答案 ground_truth - 标准答案 query_type - 查询类型 (SELECT/INSERT/UPDATE/DELETE)

src/server/tasks/dbbench/result_processor.py:10

↓ 1 callersMethodcompute_max_flow

src/utils/max_flow.py:60

↓ 1 callersMethodcount

Count variable cardinality. Returns (new_variable(number), "Observation: ...").

src/server/tasks/knowledgegraph/api.py:140

↓ 1 callersFunctioncount_function

src/server/tasks/knowledgegraph/utils/logic_form_util.py:324

↓ 1 callersFunctioncount_relations_expression

(expression: List)

src/server/tasks/knowledgegraph/utils/logic_form_util.py:939

↓ 1 callersMethodcreate_env

(self, data_item: str)

src/server/tasks/alfworld/environment.py:14

↓ 1 callersMethodexecute

使用单独的Python进程执行SQLite查询

src/server/tasks/dbbench/interaction.py:187

↓ 1 callersMethodfinal_execute

(self, variable: Variable)

src/server/tasks/knowledgegraph/api.py:47

↓ 1 callersMethodfind_augmenting_path

src/utils/max_flow.py:73

↓ 1 callersMethodget_concurrency

src/client/task.py:34

↓ 1 callersMethodget_indices

src/client/task.py:26

↓ 1 callersMethodget_main_metric

(self, overall_result)

src/analysis.py:187

↓ 1 callersFunctionget_nesting_level

src/server/tasks/knowledgegraph/utils/semparse_util.py:39

↓ 1 callersMethodget_order_priority

src/analysis.py:190

↓ 1 callersMethodget_out_relations

(self, entity: str)

src/server/tasks/knowledgegraph/utils/sparql_executer.py:266

↓ 1 callersFunctionget_predefined_structure

src/typings/config.py:22

↓ 1 callersMethodget_prompt

(self, filename: str)

src/server/tasks/alfworld/task.py:116

↓ 1 callersMethodget_prompter

(prompter: Union[str, None, Dict[str, Any]])

src/client/agents/fastchat_client.py:16

↓ 1 callersMethodget_prompter

(prompter: Union[Dict[str, Any], None])

src/client/agents/http_agent.py:48

↓ 1 callersMethodget_relations

Get all relations of a variable (variable = program derivation or entity id). Returns (None, "Observation: [...]").

src/server/tasks/knowledgegraph/api.py:54

↓ 1 callersMethodget_subtypes

src/server/tasks/os_interaction/environment.py:12

↓ 1 callersMethodget_task_instruction

src/server/tasks/alfworld/task.py:110

↓ 1 callersFunctioninteraction

(agent: AgentClient)

src/client/agent_test.py:15

↓ 1 callersFunctionlinearize_lisp_expression_for_bottom_up

(expression: list, sub_formula_id)

src/server/tasks/knowledgegraph/utils/logic_form_util.py:857

↓ 1 callersFunctionload_config

src/server/tasks/alfworld/utils.py:56

↓ 1 callersFunctionload_prompts

src/server/tasks/alfworld/utils.py:50

↓ 1 callersFunctionmain

src/analysis.py:301

↓ 1 callersFunctionmain

scripts/validate_lite_configs.py:38

↓ 1 callersFunctionno_ssl_verification

src/client/agents/http_agent.py:16

↓ 1 callersFunctionparse_args

src/client/agent_test.py:8

↓ 1 callersMethodparse_default_and_overwrite

src/configs.py:88

↓ 1 callersMethodparse_imports

(self, path, raw_config)

src/configs.py:56

↓ 1 callersFunctionparse_timestamp

(time_str: str)

src/analysis.py:266

↓ 1 callersMethodpost_validate

(cls, instance: dict)

src/typings/output.py:28

↓ 1 callersFunctionpreprocess_relation_path_for_superlatives

src/server/tasks/knowledgegraph/utils/logic_form_util.py:843

↓ 1 callersFunctionprocess_action

(action, choices, limit=0.01, to_print=False)

src/server/tasks/alfworld/utils.py:21

↓ 1 callersFunctionprocess_inv_function

(expression: List)

src/server/tasks/knowledgegraph/utils/logic_form_util.py:833

↓ 1 callersFunctionprocess_ob

src/server/tasks/alfworld/utils.py:16

↓ 1 callersMethodprompt_string

( prefix: str = "", suffix: str = "AGENT:", user_format: str = "USER: {content}\n\n",

src/client/agents/http_agent.py:99

↓ 1 callersMethodprompter

(messages: List[Dict[str, str]])

src/client/agents/fastchat_client.py:83

↓ 1 callersMethodprompter

(messages: List[Dict[str, str]])

src/client/agents/http_agent.py:83

↓ 1 callersMethodred

src/utils/others.py:57

↓ 1 callersMethodreset_env

src/server/tasks/alfworld/environment.py:20

↓ 1 callersFunctionretrieve_relations

src/server/tasks/knowledgegraph/utils/logic_form_util.py:489

↓ 1 callersMethodrun_sample

(self, index: SampleIndex, agent: AgentClient)

src/client/task.py:54

↓ 1 callersFunctionset_visited

(G, s, e, relation)

src/server/tasks/knowledgegraph/utils/logic_form_util.py:301

↓ 1 callersMethodstart_worker

( self, agent: str, task: str, index: SampleIndex, finish_callback: Un

src/assigner.py:385

↓ 1 callersFunctionstd_out_err_redirect_tqdm

src/assigner.py:29

↓ 1 callersMethodstep_env

(self, env, action)

src/server/tasks/alfworld/environment.py:25

↓ 1 callersMethodworker_generator

( self, interval=10 )

src/assigner.py:161

Method__aenter__

src/server/tasks/os_interaction/task.py:43

Method__aexit__

(self, exc_type, exc_val, exc_tb)

src/server/tasks/os_interaction/task.py:47

(self, __value: object)

src/server/tasks/knowledgegraph/api.py:31

src/server/tasks/knowledgegraph/api.py:28

src/configs.py:26

Logic: 1. Check if output folder exists (resume or create) 2. Walk through all the folders in output folder, and remo

src/assigner.py:42

( self, name: str, controller_address: str = "http://localhost:5000/api", *_, **__, )

src/client/task.py:19

(self, *args, **kwargs)

src/client/agent.py:5

(self, api_args=None, *args, **config)

src/client/agents/claude_agent.py:10

( self, model_name, controller_address=None, worker_address=None, temp

src/client/agents/fastchat_client.py:100

(self, *args, **kwargs)

src/client/agents/test_agent.py:7

( self, url, proxies=None, body=None, headers=None, return_for

src/client/agents/http_agent.py:165

edges: {(source, target): edge_weight}}

src/utils/max_flow.py:7

(self, graph: Graph, src: int, dst: int)

src/utils/max_flow.py:27

Check if target is in obj. `reverse`: if True, check if obj is in target

src/utils/rules.py:10

(self, rule: RuleBase)

src/utils/rules.py:26

(self, rules: List[RuleBase])

src/utils/rules.py:34

(self, rules: List[RuleBase])

src/utils/rules.py:42

(self, code, o)

src/server/tasks/os_interaction/task.py:60

(self, data_config, docker_config, round_limit=8,

src/server/tasks/os_interaction/task.py:148

(self, image_base: str)

src/server/tasks/os_interaction/environment.py:8

(self, data_file: str, db_file: Optional[str] = None, db_pa

src/server/tasks/dbbench/task.py:39

(self, password: str = 'password')

src/server/tasks/dbbench/environment.py:11

(self, env_controller: EnvironmentController)

src/server/tasks/dbbench/interaction.py:36

(self, sqlite_path: str)

src/server/tasks/dbbench/interaction.py:175

(self, data_path: Optional[str], config_path: Optional[str],

src/server/tasks/alfworld/task.py:23

src/server/tasks/alfworld/environment.py:9

(self, config, game_files, train_eval='eval_out_of_distribution')

src/server/tasks/alfworld/environment.py:40

(self, tools=None, **configs)

src/server/tasks/webshop/task.py:34

(self, data_file: str, max_rounds: int = 15, one_shot: bool

src/server/tasks/knowledgegraph/task.py:28

(self, type, program)

src/server/tasks/knowledgegraph/api.py:24

(self, sparql_executor: SparqlExecuter, task_id: int = 0)

src/server/tasks/knowledgegraph/api.py:43

(self, database_file: Optional[str] = None)

src/server/tasks/knowledgegraph/environment.py:11

(self, url: Union[str, None]=None)

src/server/tasks/knowledgegraph/utils/sparql_executer.py:19

(self, detail: Union[str, None] = None)

src/typings/exception.py:40

(self, detail: Union[str, None] = None)

src/typings/exception.py:45

(self, detail: Union[str, None] = None)

src/typings/exception.py:50

(self, detail: Union[str, None] = None)

src/typings/exception.py:55

(self, detail: Union[str, None] = None)

src/typings/exception.py:60

src/server/tasks/knowledgegraph/api.py:37

src/typings/exception.py:14

Method_ensure_dict

src/typings/general.py:15

Method_extract_action

src/server/tasks/os_interaction/task.py:307

Method_prompter

(messages: List[Dict[str, str]])

src/client/agents/fastchat_client.py:32

← previous next →101–200 of 312, ranked by callers