MCPcopy Create free account

hub / github.com/OpenBMB/AgentCPM-GUI / functions

Functions568 in github.com/OpenBMB/AgentCPM-GUI

Method__len__
(self)
eval/run_eval_agent.py:88
Method__len__
(self)
eval/utils/utils_odyssey/tokenization_qwen.py:200
Method__len__
(self)
eval/grounding_eval/code/Intern2.5-VL/evaluate_grounding_fun2bbox.py:54
Method__len__
(self)
eval/grounding_eval/code/Intern2.5-VL/evaluate_grounding_fun2bbox.py:112
Method__len__
(self)
eval/grounding_eval/code/Intern2.5-VL/evaluate_grounding_bbox2text.py:54
Method__len__
(self)
eval/grounding_eval/code/Intern2.5-VL/evaluate_grounding_bbox2text.py:111
Method__len__
(self)
eval/grounding_eval/code/Intern2.5-VL/evaluate_grounding_text2bbox.py:54
Method__len__
(self)
eval/grounding_eval/code/Intern2.5-VL/evaluate_grounding_text2bbox.py:107
Method__len__
(self)
rft/trainer/arl.py:592
Method__len__
(self)
rft/trainer/utils/dataloader.py:64
Method__len__
(self)
rft/trainer/utils/dataset.py:56
Method__len__
(self)
rft/trainer/utils/dataset.py:149
Method__setstate__
(self, state)
eval/utils/utils_odyssey/tokenization_qwen.py:188
Function_action_args_check
(res:str, solution: dict, reso: tuple, bbox: list[list])
rft/trainer/utils/gui_eval.py:104
Function_action_schema_check
(res:str,solution: dict)
rft/trainer/utils/gui_eval.py:29
Function_action_type_check
(res:str, solution: dict)
rft/trainer/utils/gui_eval.py:53
Method_add_tokens
(self, new_tokens: Union[List[str], List[AddedToken]], special_tokens: bool = False)
eval/utils/utils_odyssey/tokenization_qwen.py:222
Method_convert_id_to_token
Converts an id to a token, special tokens included
eval/utils/utils_odyssey/tokenization_qwen.py:326
Method_convert_token_to_id
Converts a token to an id using the vocab, special tokens included
eval/utils/utils_odyssey/tokenization_qwen.py:332
Method_decode
( self, token_ids: Union[int, List[int]], skip_special_tokens: bool = False,
eval/utils/utils_odyssey/tokenization_qwen.py:349
Method_decode_imgurl
(img_token_ids)
eval/utils/utils_odyssey/tokenization_qwen.py:359
Method_encode_imgurl
(img_tokens)
eval/utils/utils_odyssey/tokenization_qwen.py:288
Method_encode_vl_info
(tokens)
eval/utils/utils_odyssey/tokenization_qwen.py:381
Method_get_eval_sampler
Returns a sampler for evaluation.
rft/trainer/arl.py:864
Function_init_llm
(model_name)
eval/run_predict_os_gensis.py:53
Function_init_llm
(model_name)
eval/run_predict_odyssey.py:56
Function_init_llm
(model_name)
eval/run_predict_os_atlas.py:58
Function_init_llm
load the models and its relative processor, tokenizer. Args: model_name (str): the model name or model path. Returns: N
eval/run_predict_aguvis.py:408
Function_init_llm
(model_name)
eval/run_predict_ui_tars.py:58
Function_init_llm
(model_name)
eval/run_predict_qwen2_5VL.py:67
Function_init_llm
(model_name)
eval/run_predict_minicpm.py:56
Method_init_weights
(self, m)
eval/utils/utils_odyssey/modeling_qwen.py:218
Method_init_weights
Initialize the weights.
eval/utils/utils_odyssey/modeling_qwen.py:554
Method_init_weights
(self, m)
eval/utils/utils_odyssey/visual.py:130
Method_load_data
( dataset: Any, index_queue: multiprocessing.Queue, result_queue: multiprocessing.Queu
rft/trainer/utils/dataloader.py:137
Method_master_loop
Master loop to dispatch tasks to workers
rft/trainer/utils/dataloader.py:68
Method_monitor
监控线程,定期报告状态
rft/trainer/zmq.py:110
Function_react_check
(res:str, solution: dict, reso: tuple, bbox: list[list], step_id)
rft/trainer/utils/gui_eval.py:224
Method_reorder_cache
( past_key_values: Tuple[Tuple[torch.Tensor]], beam_idx: torch.Tensor )
eval/utils/utils_odyssey/modeling_qwen.py:1084
Method_set_gradient_checkpointing
(self, module, value=False)
eval/utils/utils_odyssey/modeling_qwen.py:577
Method_set_signature_columns_if_needed
(self)
rft/trainer/arl.py:375
Method_sync_node_queue
节点队列同步线程
rft/trainer/zmq.py:118
Method_tokenize
Converts a string in a sequence of tokens (string), using the tokenizer. Split in words for word-based vocabulary or sub-words for
eval/utils/utils_odyssey/tokenization_qwen.py:340
Method_upcast_and_reordered_attn
( self, query, key, value, registered_causal_mask, attention_mask=None, head_mask=None )
eval/utils/utils_odyssey/modeling_qwen.py:327
Functionaction_args_check
(completions, solution: list[dict], resolution, bboxs,**kwargs)
rft/trainer/utils/gui_eval.py:210
Functionaction_schema_check
(completions, **kwargs)
rft/trainer/utils/gui_eval.py:40
Functionaction_type_check
(completions, solution: list[dict], **kwargs)
rft/trainer/utils/gui_eval.py:91
Functionaitz_2_qwen2_5
Convert AITZ action to Qwen2.5 action format Args: aitz_action (dict): AITZ format action, contains ACTION and ARGS resi
eval/utils/qwen_mobile_tool.py:92
Functionbox_iou
(boxes1, boxes2)
eval/grounding_eval/code/Intern2.5-VL/evaluate_grounding_bbox2text.py:18
Methodcall
(self, params: Union[str, dict], **kwargs)
eval/utils/utils_qwen/agent_function_call.py:89
Methodcall
(self, params: Union[str, dict], **kwargs)
eval/utils/utils_qwen/agent_function_call.py:227
Methodchat_stream
( self, tokenizer: PreTrainedTokenizer, query: str, histor
eval/utils/utils_odyssey/modeling_qwen.py:1156
Functioncheck_actions_match
Determines if two actions are considered to be the same. Two actions being "the same" is defined here as two actions that would result in a s
eval/utils/action_utils.py:235
Functioncollate_fn
(batches, tokenizer)
eval/grounding_eval/code/Intern2.5-VL/evaluate_grounding_bbox2text.py:34
Functioncollate_fn
(batches, tokenizer)
eval/grounding_eval/code/Intern2.5-VL/evaluate_grounding_text2bbox.py:34
Functioncompact_json_dumps
(obj)
eval/run_predict_os_atlas.py:47
Functioncompact_json_dumps
(obj)
eval/run_predict_ui_tars.py:47
Functioncompact_json_dumps
(obj)
eval/run_predict_qwen2_5VL.py:55
Functioncompact_json_dumps
(obj)
eval/run_predict_minicpm.py:29
Functionconvert2aitz_single_thread
(input_path, output_path)
eval/utils/convert_output.py:127
Methodconvert_tokens_to_string
Converts a sequence of tokens in a single string.
eval/utils/utils_odyssey/tokenization_qwen.py:302
Methodcreate_custom_forward
(module)
eval/utils/utils_odyssey/modeling_qwen.py:871
Methodcustom_forward
(*inputs)
eval/utils/utils_odyssey/modeling_qwen.py:872
Functiondata_collator
(examples, padding_value=0, max_length=2048)
sft/dataset.py:104
Methoddata_collator
(inputs)
rft/trainer/arl.py:168
Methoddescription
(self)
eval/utils/utils_qwen/agent_function_call.py:9
Methoddescription
(self)
eval/utils/utils_qwen/agent_function_call.py:149
Methoddraw_bbox_on_latest_picture
( self, response, history=None, )
eval/utils/utils_odyssey/tokenization_qwen.py:449
Functionextract_gt_action
(example)
eval/utils/action_utils.py:22
Methodforward
(self, x, attn_mask=None)
eval/utils/utils_odyssey/modeling_qwen.py:227
Methodforward
( self, hidden_states: Optional[Tuple[torch.FloatTensor]], rotary_pos_emb: Optional
eval/utils/utils_odyssey/modeling_qwen.py:393
Methodforward
(self, hidden_states)
eval/utils/utils_odyssey/modeling_qwen.py:473
Methodforward
( self, hidden_states: Optional[Tuple[torch.FloatTensor]], rotary_pos_emb: Optional
eval/utils/utils_odyssey/modeling_qwen.py:498
Methodforward
( self, input_ids: Optional[torch.LongTensor] = None, past_key_values: Optional[Tup
eval/utils/utils_odyssey/modeling_qwen.py:677
Methodforward
( self, input_ids: Optional[torch.LongTensor] = None, past_key_values: Optional[Tup
eval/utils/utils_odyssey/modeling_qwen.py:1020
Methodforward
(self, max_seq_len, offset=0, ntk_alpha=1.0)
eval/utils/utils_odyssey/modeling_qwen.py:1302
Methodforward
(self, x)
eval/utils/utils_odyssey/modeling_qwen.py:1343
Methodforward
(self, x, attn_mask=None)
eval/utils/utils_odyssey/visual.py:139
Methodforward
(self, query, key, value, attn_mask = None)
eval/utils/utils_odyssey/visual.py:188
Methodforward
( self, q_x: torch.Tensor, k_x: Optional[torch.Tensor] = None,
eval/utils/utils_odyssey/visual.py:285
Methodforward
(self, x: torch.Tensor, attn_mask: Optional[torch.Tensor] = None)
eval/utils/utils_odyssey/visual.py:326
Methodforward
(self, x: torch.Tensor)
eval/utils/utils_odyssey/visual.py:392
Methodfrom_list_format
(self, list_format: List[Dict])
eval/utils/utils_odyssey/tokenization_qwen.py:407
Functiongenerate_response
Modified from the origin code. Do the inference based on the params. Args: image (Image.Image) instruction (str) pre
eval/run_predict_aguvis.py:507
Functionget_abs_pos
(abs_pos, tgt_size)
eval/utils/utils_odyssey/modeling_qwen.py:113
Functionget_batch
Generate batch from context tokens.
eval/utils/utils_odyssey/qwen_generation_utils.py:94
Methodget_batch_samples
(self, epoch_iterator, num_batches)
rft/trainer/arl.py:580
Functionget_center_distance
(box)
eval/utils/evaluator.py:88
Methodget_image
(self)
eval/utils/utils_odyssey/tokenization_qwen.py:526
Functionget_input_embeddings
(self)
sft/finetune.py:248
Methodget_output
(self)
eval/utils/utils_odyssey/tokenization_qwen.py:604
Methodget_output_embeddings
(self)
eval/utils/utils_odyssey/modeling_qwen.py:978
Functionget_qwen_response_history
Get response from Qwen model Args: user_query: User query text screenshot: Screenshot path history_actions: Hist
eval/utils/qwen_mobile_tool.py:464
Methodget_random_coordinate
()
rft/trainer/utils/dataset.py:97
Methodget_task
()
rft/trainer/utils/dataloader.py:165
Methodget_train_dataloader
Returns the training [`~torch.utils.data.DataLoader`]. Will use no sampler if `train_dataset` does not implement `__len__`, a random
rft/trainer/arl.py:815
Methodget_vocab
(self)
eval/utils/utils_odyssey/tokenization_qwen.py:203
Functionglobal_sync_proc
Manage Global Task Synchronization Signal And Assign Advantages.
rft/trainer/zmq.py:38
Functionis_click
Args: predict_bbox: Tensor of shape [bs, 2], format [x, y] (coordinates of predicted points). target_bbox: Tensor of shape [bs, 4
eval/grounding_eval/code/Intern2.5-VL/evaluate_grounding_fun2bbox.py:115
Functionis_click
Args: predict_bbox: Tensor of shape [bs, 2], format [x, y] (coordinates of predicted points). target_bbox: Tensor of shape [bs, 4
eval/grounding_eval/code/Intern2.5-VL/evaluate_grounding_bbox2text.py:114
← previousnext →401–500 of 568, ranked by callers