MCPcopy Create free account

hub / github.com/OpenBMB/AgentCPM-GUI / functions

Functions568 in github.com/OpenBMB/AgentCPM-GUI

⨍ Functions 568◇ Types & classes 49
↓ 1 callersMethod_open
(self, text: str)
eval/utils/utils_qwen/agent_function_call.py:137
↓ 1 callersMethod_parse_action_
(self, pred, image_width=None, image_height=None)
eval/utils/evaluator.py:196
↓ 1 callersMethod_parse_answer_
(self, gt)
eval/utils/evaluator.py:245
↓ 1 callersMethod_prepare_decoder_attention_mask
(self, attention_mask, input_shape, inputs_embeds, past_key_values_length)
eval/utils/utils_odyssey/modeling_qwen.py:653
↓ 1 callersFunction_process_inputs
( inputs, processing_class, max_prompt_length )
rft/trainer/utils/process.py:77
↓ 1 callersMethod_repeat
(self, query, N: int)
eval/utils/utils_odyssey/modeling_qwen.py:244
↓ 1 callersMethod_repeat
(self, query, N: int)
eval/utils/utils_odyssey/visual.py:155
↓ 1 callersFunction_resize_annotation_bounding_boxes
Uniformly enlarge bbox(es) by the given factors.
eval/utils/evaluator.py:30
↓ 1 callersFunction_resize_annotation_bounding_boxes
Resize the bounding boxes by the given fractions. Args: annotation_positions: Array of shape (N, 4), where each row represents the
eval/utils/action_utils.py:140
↓ 1 callersFunction_rotate_half
(x)
eval/utils/utils_odyssey/modeling_qwen.py:1308
↓ 1 callersMethod_run_main_loop
主事件循环，接收消息并分发给相应的处理函数
rft/trainer/zmq.py:215
↓ 1 callersMethod_scroll
(self, pixels: int)
eval/utils/utils_qwen/agent_function_call.py:264
↓ 1 callersMethod_setup_figure
(self, img)
eval/utils/utils_odyssey/tokenization_qwen.py:502
↓ 1 callersMethod_split_to_steps_
(self, episode_data)
eval/run_eval_agent.py:73
↓ 1 callersMethod_swipe
(self, coordinate: Tuple[int, int], coordinate2: Tuple[int, int])
eval/utils/utils_qwen/agent_function_call.py:128
↓ 1 callersMethod_system_button
(self, button: str)
eval/utils/utils_qwen/agent_function_call.py:134
↓ 1 callersMethod_terminate
(self, status: str)
eval/utils/utils_qwen/agent_function_call.py:143
↓ 1 callersMethod_terminate
(self, status: str)
eval/utils/utils_qwen/agent_function_call.py:270
↓ 1 callersMethod_tokens_match
(self, prev_tokens: torch.LongTensor, tokens: List[int])
eval/utils/utils_odyssey/qwen_generation_utils.py:361
↓ 1 callersMethod_type
(self, text: str)
eval/utils/utils_qwen/agent_function_call.py:131
↓ 1 callersMethod_type
(self, text: str)
eval/utils/utils_qwen/agent_function_call.py:255
↓ 1 callersMethod_wait
(self, time: int)
eval/utils/utils_qwen/agent_function_call.py:140
↓ 1 callersMethod_wait
(self, time: int)
eval/utils/utils_qwen/agent_function_call.py:267
↓ 1 callersMethodaction_map
(self, action_api: dict)
eval/utils/evaluator.py:170
↓ 1 callersFunctionaitw_2_qwen2_5
Convert AITW action to Qwen2.5 prompt
eval/utils/qwen_mobile_tool.py:454
↓ 1 callersFunctionaitw_2_uitars
Convert AITW action to UITARS action format
eval/utils/qwen_mobile_tool.py:29
↓ 1 callersFunctionannotate_and_save_image
Save an annotated image with action details to the specified folder.
eval/utils/utils.py:6
↓ 1 callersMethodattention
( self, q_x: torch.Tensor, k_x: Optional[torch.Tensor] = None,
eval/utils/utils_odyssey/visual.py:272
↓ 1 callersFunctionbox_iou
(boxes1, boxes2)
eval/grounding_eval/code/Intern2.5-VL/evaluate_grounding_fun2bbox.py:18
↓ 1 callersFunctionbox_iou
(boxes1, boxes2)
eval/grounding_eval/code/Intern2.5-VL/evaluate_grounding_text2bbox.py:18
↓ 1 callersFunctionbuild_data_episodes
Transfrom the episode trajectory into Odyssey data. This function work as the data preprocess of the origin repo. Args: episode
eval/run_predict_odyssey.py:330
↓ 1 callersFunctionbuild_history_actions_str
(history_list)
eval/run_predict_os_atlas.py:77
↓ 1 callersFunctioncall_GPT
调用Qwen输出function的描述，输出bbox
eval/grounding_eval/code/GPT-4o/text2bbox_eval_gpt-4o_with_grounding.py:43
↓ 1 callersFunctioncall_GPT
调用Qwen输出function的描述，输出bbox
eval/grounding_eval/code/GPT-4o/fun2bbox_eval_gpt-4o_with_grounding.py:43
↓ 1 callersFunctioncall_Qwenvl
调用Qwen输出function的描述，输出bbox
eval/grounding_eval/code/OS-genesis/bbox2text_eval_osgenesis.py:41
↓ 1 callersFunctioncall_Qwenvl
调用Qwen输出function的描述，输出bbox
eval/grounding_eval/code/OS-genesis/fun2bbox_eval_osgenesis.py:43
↓ 1 callersFunctioncall_Qwenvl
调用Qwen输出function的描述，输出bbox
eval/grounding_eval/code/OS-genesis/text2bbox_eval_osgenesis.py:41
↓ 1 callersFunctioncall_Qwenvl
调用Qwen输出function的描述，输出bbox
eval/grounding_eval/code/minicpm/text2bbox_eval_minicpm.py:63
↓ 1 callersFunctioncall_Qwenvl
调用Qwen输出function的描述，输出bbox
eval/grounding_eval/code/minicpm/bbox2text_eval_minicpm.py:73
↓ 1 callersFunctioncall_Qwenvl
调用Qwen输出function的描述，输出bbox
eval/grounding_eval/code/minicpm/fun2bbox_eval_minicpm.py:65
↓ 1 callersFunctioncall_Qwenvl
调用Qwen输出function的描述，输出bbox
eval/grounding_eval/code/UI-TARS/bbox2text_eval_uitars.py:50
↓ 1 callersFunctioncall_Qwenvl
调用Qwen输出function的描述，输出bbox
eval/grounding_eval/code/UI-TARS/text2bbox_eval_uitars.py:41
↓ 1 callersFunctioncall_Qwenvl
调用Qwen输出function的描述，输出bbox
eval/grounding_eval/code/UI-TARS/fun2bbox_eval_uitars.py:43
↓ 1 callersFunctioncall_Qwenvl
调用Qwen输出function的描述，输出bbox
eval/grounding_eval/code/GPT-4o/text2bbox_eval_click.py:41
↓ 1 callersFunctioncall_Qwenvl
调用Qwen输出function的描述，输出bbox
eval/grounding_eval/code/GPT-4o/bbox2text_eval.py:41
↓ 1 callersFunctioncall_Qwenvl
调用Qwen输出function的描述，输出bbox
eval/grounding_eval/code/GPT-4o/fun2bbox_eval_click.py:43
↓ 1 callersFunctioncall_Qwenvl
调用Qwen输出function的描述，输出bbox
eval/grounding_eval/code/OS-Altas/text2bbox_eval_osatlas.py:41
↓ 1 callersFunctioncall_Qwenvl
调用Qwen输出function的描述，输出bbox
eval/grounding_eval/code/OS-Altas/fun2bbox_eval_osatlas.py:42
↓ 1 callersFunctioncall_Qwenvl
调用Qwen输出function的描述，输出bbox
eval/grounding_eval/code/OS-Altas/bbox2text_eval_osatlas.py:50
↓ 1 callersFunctioncall_Qwenvl
调用Qwen输出function的描述，输出bbox
eval/grounding_eval/code/Aguvis/fun2bbox_eval_aguvis.py:43
↓ 1 callersFunctioncall_Qwenvl
调用Qwen输出function的描述，输出bbox
eval/grounding_eval/code/Aguvis/text2bbox_eval_aguvis.py:41
↓ 1 callersFunctioncall_Qwenvl
调用Qwen输出function的描述，输出bbox
eval/grounding_eval/code/Aguvis/bbox2text_eval_aguvis.py:41
↓ 1 callersFunctioncall_Qwenvl
调用Qwen输出function的描述，输出bbox
eval/grounding_eval/code/Qwen2.5-VL/fun2bbox_eval_qwen.py:43
↓ 1 callersFunctioncall_Qwenvl
调用Qwen输出function的描述，输出bbox
eval/grounding_eval/code/Qwen2.5-VL/bbox2text_eval_qwen.py:41
↓ 1 callersFunctioncall_Qwenvl
调用Qwen输出function的描述，输出bbox
eval/grounding_eval/code/Qwen2.5-VL/text2bbox_eval_qwen.py:41
↓ 1 callersFunctioncheck_inside
(x, y, bbox_list)
eval/utils/evaluator.py:59
↓ 1 callersFunctioncollate_fn
(batches, tokenizer)
eval/grounding_eval/code/Intern2.5-VL/evaluate_grounding_fun2bbox.py:34
↓ 1 callersMethodcompute_atomic_metrics
(step_results)
eval/utils/evaluator.py:453
↓ 1 callersMethodcompute_episode_metrics
(episode_results)
eval/utils/evaluator.py:419
↓ 1 callersMethodcompute_loss
(self, model, inputs, return_outputs=False, num_items_in_batch=None)
rft/trainer/arl.py:722
↓ 1 callersFunctionconversation_to_ids_llama3
(conversation, tokenizer)
sft/dataset.py:243
↓ 1 callersFunctionconversation_to_ids_minicpm
(conversation, tokenizer)
sft/dataset.py:211
↓ 1 callersFunctionconversation_to_ids_qwen2
(conversation, tokenizer)
sft/dataset.py:283
↓ 1 callersFunctionconvert2aitz
(input_path, output_path, max_workers=None)
eval/utils/convert_output.py:98
↓ 1 callersMethoddraw_box
(self, box_coord, alpha=0.5, edge_color="g", line_style="-")
eval/utils/utils_odyssey/tokenization_qwen.py:582
↓ 1 callersMethoddraw_text
( self, text, position, *, font_size=None, color="g",
eval/utils/utils_odyssey/tokenization_qwen.py:549
↓ 1 callersFunctionencode_image
(image_path)
eval/grounding_eval/code/OS-genesis/bbox2text_eval_osgenesis.py:35
↓ 1 callersFunctionencode_image
(image_path)
eval/grounding_eval/code/OS-genesis/fun2bbox_eval_osgenesis.py:37
↓ 1 callersFunctionencode_image
(image_path)
eval/grounding_eval/code/OS-genesis/text2bbox_eval_osgenesis.py:35
↓ 1 callersFunctionencode_image
(image_path)
eval/grounding_eval/code/minicpm/text2bbox_eval_minicpm.py:36
↓ 1 callersFunctionencode_image
(image_path)
eval/grounding_eval/code/minicpm/bbox2text_eval_minicpm.py:36
↓ 1 callersFunctionencode_image
(image_path)
eval/grounding_eval/code/minicpm/fun2bbox_eval_minicpm.py:38
↓ 1 callersFunctionencode_image
(image_path)
eval/grounding_eval/code/UI-TARS/bbox2text_eval_uitars.py:35
↓ 1 callersFunctionencode_image
(image_path)
eval/grounding_eval/code/UI-TARS/text2bbox_eval_uitars.py:35
↓ 1 callersFunctionencode_image
(image_path)
eval/grounding_eval/code/UI-TARS/fun2bbox_eval_uitars.py:37
↓ 1 callersFunctionencode_image
(image_path)
eval/grounding_eval/code/GPT-4o/text2bbox_eval_click.py:35
↓ 1 callersFunctionencode_image
(image_path)
eval/grounding_eval/code/GPT-4o/bbox2text_eval.py:35
↓ 1 callersFunctionencode_image
(image_path)
eval/grounding_eval/code/GPT-4o/fun2bbox_eval_click.py:37
↓ 1 callersFunctionencode_image
(image_path)
eval/grounding_eval/code/GPT-4o/text2bbox_eval_gpt-4o_with_grounding.py:37
↓ 1 callersFunctionencode_image
(image_path)
eval/grounding_eval/code/GPT-4o/fun2bbox_eval_gpt-4o_with_grounding.py:37
↓ 1 callersFunctionencode_image
(image_path)
eval/grounding_eval/code/OS-Altas/text2bbox_eval_osatlas.py:35
↓ 1 callersFunctionencode_image
(image_path)
eval/grounding_eval/code/OS-Altas/fun2bbox_eval_osatlas.py:36
↓ 1 callersFunctionencode_image
(image_path)
eval/grounding_eval/code/OS-Altas/bbox2text_eval_osatlas.py:35
↓ 1 callersFunctionencode_image
(image_path)
eval/grounding_eval/code/Aguvis/fun2bbox_eval_aguvis.py:37
↓ 1 callersFunctionencode_image
(image_path)
eval/grounding_eval/code/Aguvis/text2bbox_eval_aguvis.py:35
↓ 1 callersFunctionencode_image
(image_path)
eval/grounding_eval/code/Aguvis/bbox2text_eval_aguvis.py:35
↓ 1 callersFunctionencode_image
(image_path)
eval/grounding_eval/code/Qwen2.5-VL/fun2bbox_eval_qwen.py:37
↓ 1 callersFunctionencode_image
(image_path)
eval/grounding_eval/code/Qwen2.5-VL/bbox2text_eval_qwen.py:35
↓ 1 callersFunctionencode_image
(image_path)
eval/grounding_eval/code/Qwen2.5-VL/text2bbox_eval_qwen.py:35
↓ 1 callersFunctionevaluate
(args)
eval/run_eval_agent.py:140
↓ 1 callersFunctionevaluate_chat_model
()
eval/grounding_eval/code/Intern2.5-VL/evaluate_grounding_fun2bbox.py:137
↓ 1 callersFunctionevaluate_chat_model
()
eval/grounding_eval/code/Intern2.5-VL/evaluate_grounding_bbox2text.py:136
↓ 1 callersFunctionevaluate_chat_model
()
eval/grounding_eval/code/Intern2.5-VL/evaluate_grounding_text2bbox.py:132
↓ 1 callersFunctionextract_and_validate_json
(input_string)
eval/run_predict_qwen2_5VL.py:379
↓ 1 callersFunctionextract_and_validate_json
(input_string)
eval/run_predict_minicpm.py:80
↓ 1 callersFunctionfsdp2_prepare_model
Prepares the model for FSDP2 in-place. Also returns the model to avoid misuse of the original model. Args: accelerator (`Accelerator`): T
rft/trainer/utils/__init__.py:63
↓ 1 callersFunctionget_2d_sincos_pos_embed
grid_size: int of the grid height and width return: pos_embed: [grid_size*grid_size, embed_dim] or [1+grid_size*grid_size, embed_dim]
eval/utils/utils_odyssey/modeling_qwen.py:132
↓ 1 callersFunctionget_2d_sincos_pos_embed
grid_size: int of the grid height and width return: pos_embed: [grid_size*grid_size, embed_dim] or [1+grid_size*grid_size, embed_dim]
eval/utils/utils_odyssey/visual.py:42
↓ 1 callersFunctionget_2d_sincos_pos_embed_from_grid
(embed_dim, grid)
eval/utils/utils_odyssey/modeling_qwen.py:150
↓ 1 callersFunctionget_2d_sincos_pos_embed_from_grid
(embed_dim, grid)
eval/utils/utils_odyssey/visual.py:60
← previousnext →101–200 of 568, ranked by callers