MCPcopy Create free account

hub / github.com/TencentARC/MindOmni / functions

Functions516 in github.com/TencentARC/MindOmni

↓ 1 callersFunctionlast_boxed_only_string
(string)
rl-postrain/src/open-r1-multimodal/src/open_r1/utils/math.py:38
↓ 1 callersFunctionllm_reward
(content, sol, **kwargs)
rl-postrain/src/open-r1-multimodal/src/open_r1/grpo_jsonl.py:187
↓ 1 callersFunctionllm_reward
(content, sol, **kwargs)
rl-postrain/src/open-r1-multimodal/src/open_r1/grpo_ust.py:199
↓ 1 callersMethodloadCats
Load cats with the specified ids. :param ids (int array) : integer ids specifying cats :return: cats (object array) : l
rl-postrain/src/open-r1-multimodal/src/open_r1/utils/pycocotools/coco.py:168
↓ 1 callersMethodloadImgs
Load anns with the specified ids. :param ids (int array) : integer ids specifying img :return: imgs (object array) : lo
rl-postrain/src/open-r1-multimodal/src/open_r1/utils/pycocotools/coco.py:179
↓ 1 callersMethodloadNumpyAnnotations
Convert result data from a numpy array [Nx7] where each row contains {imageID,x1,y1,w,h,score,class} :param data (numpy.ndarray)
rl-postrain/src/open-r1-multimodal/src/open_r1/utils/pycocotools/coco.py:347
↓ 1 callersFunctionload_image_from_path
(image_path)
rl-postrain/src/open-r1-multimodal/local_scripts/prepare_hf_data.py:58
↓ 1 callersFunctionload_yaml_dataset
(datasets, key_list, debug_json_item_num=None)
pretrain/train_helper/utils.py:7
↓ 1 callersFunctionmain
(args)
train.py:53
↓ 1 callersFunctionmain
()
rl-postrain/src/open-r1-multimodal/local_scripts/create_vision_cot_data.py:136
↓ 1 callersFunctionmain
(script_args, training_args, model_args)
rl-postrain/src/open-r1-multimodal/src/open_r1/grpo_jsonl.py:927
↓ 1 callersFunctionmain
(script_args, training_args, model_args)
rl-postrain/src/open-r1-multimodal/src/open_r1/sft.py:189
↓ 1 callersFunctionmain
(script_args, training_args, model_args)
rl-postrain/src/open-r1-multimodal/src/open_r1/grpo_rec.py:206
↓ 1 callersFunctionmain
(script_args, training_args, model_args)
rl-postrain/src/open-r1-multimodal/src/open_r1/grpo.py:126
↓ 1 callersFunctionmain
(script_args, training_args, model_args)
rl-postrain/src/open-r1-multimodal/src/open_r1/grpo_ust.py:939
↓ 1 callersFunctionmake_conversation
(example)
rl-postrain/src/open-r1-multimodal/src/open_r1/grpo.py:136
↓ 1 callersFunctionmath_reward
(content, sol, **kwargs)
rl-postrain/src/open-r1-multimodal/src/open_r1/grpo_jsonl.py:753
↓ 1 callersFunctionmath_reward
(content, sol, **kwargs)
rl-postrain/src/open-r1-multimodal/src/open_r1/grpo_ust.py:765
↓ 1 callersFunctionmcq_reward
(content, sol, **kwargs)
rl-postrain/src/open-r1-multimodal/src/open_r1/grpo_jsonl.py:197
↓ 1 callersFunctionmcq_reward
(content, sol, **kwargs)
rl-postrain/src/open-r1-multimodal/src/open_r1/grpo_ust.py:209
↓ 1 callersFunctionmodulate
(x, shift, scale)
src/image_decoder/model.py:15
↓ 1 callersFunctionmodulate
(x, shift, scale)
pretrain/model.py:20
↓ 1 callersFunctionnumeric_reward
(content, sol, **kwargs)
rl-postrain/src/open-r1-multimodal/src/open_r1/grpo_jsonl.py:745
↓ 1 callersFunctionnumeric_reward
(content, sol, **kwargs)
rl-postrain/src/open-r1-multimodal/src/open_r1/grpo_ust.py:757
↓ 1 callersFunctionodLength_reward
Calculate reward for object detection task with length penalty. Args: content (str): Model's predicted answer containing boundin
rl-postrain/src/open-r1-multimodal/src/open_r1/grpo_jsonl.py:385
↓ 1 callersFunctionodLength_reward
Calculate reward for object detection task with length penalty. Args: content (str): Model's predicted answer containing boundin
rl-postrain/src/open-r1-multimodal/src/open_r1/grpo_ust.py:397
↓ 1 callersMethodpad_input
(self, context_hidden_state)
src/image_decoder/processor.py:162
↓ 1 callersMethodpatch_multiple_resolutions
(self, latents, padding_latent=None, is_input_images=False)
src/image_decoder/model.py:284
↓ 1 callersMethodprefetch_layer
Starts prefetching the next layer cache
src/image_decoder/scheduler.py:18
↓ 1 callersMethodprefetch_layer
Starts prefetching the next layer cache
src/image_decoder/transformer.py:20
↓ 1 callersMethodprefetch_layer
Starts prefetching the next layer cache
pretrain/scheduler.py:24
↓ 1 callersMethodprefetch_layer
Starts prefetching the next layer cache
pretrain/transformer.py:33
↓ 1 callersMethodprepare_model_inputs
(self, processing_class, prompts_text, images, return_tensors, padding, padding_side, add_special_tokens)
rl-postrain/src/open-r1-multimodal/src/open_r1/vlm_modules/vlm_module.py:49
↓ 1 callersMethodprepare_prompt
(self, processing_class, inputs: dict[str, Union[torch.Tensor, Any]])
rl-postrain/src/open-r1-multimodal/src/open_r1/vlm_modules/vlm_module.py:45
↓ 1 callersFunctionprocess_conversation_list
(conversation_list, system_message=None, image_newline=True)
rl-postrain/src/open-r1-multimodal/src/open_r1/vlm_modules/internvl_module.py:232
↓ 1 callersMethodprocess_image
(self, image)
pretrain/processor.py:54
↓ 1 callersFunctionpush_to_hub_revision
Pushes the model to branch on a Hub repo.
rl-postrain/src/open-r1-multimodal/src/open_r1/utils/hub.py:39
↓ 1 callersFunctionremove_boxed
(s)
rl-postrain/src/open-r1-multimodal/src/open_r1/utils/math.py:25
↓ 1 callersFunctionremove_right_units
(string)
rl-postrain/src/open-r1-multimodal/src/open_r1/utils/math.py:133
↓ 1 callersFunctionrepetition_reward
(content, **kwargs)
rl-postrain/src/open-r1-multimodal/src/open_r1/grpo_jsonl.py:592
↓ 1 callersFunctionrepetition_reward
(content, **kwargs)
rl-postrain/src/open-r1-multimodal/src/open_r1/grpo_ust.py:604
↓ 1 callersFunctionrun_benchmark_jobs
(training_args: Union["SFTConfig", "GRPOConfig"], model_args: "ModelConfig")
rl-postrain/src/open-r1-multimodal/src/open_r1/utils/evaluation.py:93
↓ 1 callersFunctionrun_lighteval_job
( benchmark: str, training_args: Union["SFTConfig", "GRPOConfig"], model_args: "ModelConfig" )
rl-postrain/src/open-r1-multimodal/src/open_r1/utils/evaluation.py:62
↓ 1 callersFunctionsample_timestep
(x1)
pretrain/train_helper/loss.py:30
↓ 1 callersFunctionsample_x0
Sampling x0 & t based on shape of x1 (if needed) Args: x1 - data point; [batch, *dim]
pretrain/train_helper/loss.py:18
↓ 1 callersFunctionsave_single_image
()
pretrain/train_helper/webdataset_laion.py:119
↓ 1 callersFunctionsave_single_image
()
pretrain/train_helper/webdataset_.py:117
↓ 1 callersMethodsetDetParams
(self)
rl-postrain/src/open-r1-multimodal/src/open_r1/utils/pycocotools/cocoeval.py:500
↓ 1 callersMethodsetKpParams
(self)
rl-postrain/src/open-r1-multimodal/src/open_r1/utils/pycocotools/cocoeval.py:511
↓ 1 callersMethodtimestep_embedding
Create sinusoidal timestep embeddings. :param t: a 1-D Tensor of N indices, one per batch element. These ma
src/image_decoder/model.py:33
↓ 1 callersMethodtimestep_embedding
Create sinusoidal timestep embeddings. :param t: a 1-D Tensor of N indices, one per batch element. These ma
pretrain/model.py:38
↓ 1 callersFunctiontraining_losses
Loss for training torche score model Args: - model: backbone model; could be score, noise, or velocity - x1: datapoint - model_kwargs:
pretrain/train_helper/loss.py:52
↓ 1 callersMethodvalid
(self, model, system_content)
rl-postrain/src/open-r1-multimodal/src/open_r1/trainer/grpo_trainer.py:793
↓ 1 callersFunctionvalidate_func
(accelerator, model, vae, processor, model_llm, llm_processor, logger, base_dir, step, device, val_img_size)
pretrain/train_helper/validate.py:229
↓ 1 callersFunctionyes_no_reward
(content, sol, **kwargs)
rl-postrain/src/open-r1-multimodal/src/open_r1/grpo_jsonl.py:216
↓ 1 callersFunctionyes_no_reward
(content, sol, **kwargs)
rl-postrain/src/open-r1-multimodal/src/open_r1/grpo_ust.py:228
Method__call__
(self, z, func, model_kwargs, use_kv_cache: bool = True, offload_kv_cache: bool = True, tqdm_disable: bool = F
src/image_decoder/scheduler.py:148
Method__call__
(self, context_hidden_state: List[torch.tensor], neg_context_hidden_state: L
src/image_decoder/processor.py:69
Method__call__
(self, features)
src/image_decoder/processor.py:192
Method__call__
r""" Function invoked when calling the pipeline for generation. Args: prompt (`str` or `List[str]`): The p
src/image_decoder/image_pipeline.py:83
Method__call__
(self, z, func, model_kwargs, use_kv_cache: bool=True, offload_kv_cache: bool=True, tqdm_disable: bool=False)
pretrain/scheduler.py:169
Method__call__
r""" Function invoked when calling the pipeline for generation. Args: prompt (`str` or `List[str]`): The
pretrain/pipeline.py:150
Method__call__
(self, instructions: List[str], input_images: List[List[str]] = None,
pretrain/processor.py:289
Method__call__
(self, features)
pretrain/processor.py:513
Method__call__
(self, features)
pretrain/processor.py:541
Method__call__
(self, features)
pretrain/train_helper/subdata.py:139
Method__call__
(self, features)
pretrain/train_helper/data.py:199
Method__getitem__
(self, i)
rl-postrain/src/open-r1-multimodal/src/open_r1/sft.py:136
Method__getitem__
(self, i)
rl-postrain/src/open-r1-multimodal/src/open_r1/grpo_rec.py:151
Method__getitem__
Gets the cache for this layer to the device. Prefetches the next and evicts the previous layer.
src/image_decoder/scheduler.py:39
Method__getitem__
Gets the cache for this layer to the device. Prefetches the next and evicts the previous layer.
pretrain/scheduler.py:52
Method__getitem__
(self, index)
pretrain/train_helper/concatedataset.py:83
Method__getitem__
(self, index)
pretrain/train_helper/webdataset_laion.py:85
Method__getitem__
(self, index)
pretrain/train_helper/webdataset_.py:83
Method__getitem__
(self, index)
pretrain/train_helper/data.py:163
Method__init__
(self, data_path: str, script_args: ScriptArguments)
rl-postrain/src/open-r1-multimodal/src/open_r1/sft.py:79
Method__init__
(self, data_path: str, script_args: GRPOScriptArguments, question_template: str)
rl-postrain/src/open-r1-multimodal/src/open_r1/grpo_rec.py:93
Method__init__
(self, **kwargs)
rl-postrain/src/open-r1-multimodal/src/open_r1/utils/callbacks.py:38
Method__init__
(self, model_config)
rl-postrain/src/open-r1-multimodal/src/open_r1/utils/callbacks.py:44
Method__init__
Constructor of Microsoft COCO helper class for reading and visualizing annotations. :param annotation_file (str): location of annotat
rl-postrain/src/open-r1-multimodal/src/open_r1/utils/pycocotools/coco.py:25
Method__init__
Initialize CocoEval using coco APIs for gt and dt :param cocoGt: coco object with ground truth annotations :param cocoDt: coc
rl-postrain/src/open-r1-multimodal/src/open_r1/utils/pycocotools/cocoeval.py:58
Method__init__
(self, iouType='segm')
rl-postrain/src/open-r1-multimodal/src/open_r1/utils/pycocotools/cocoeval.py:523
Method__init__
(self)
rl-postrain/src/open-r1-multimodal/src/open_r1/vlm_modules/internvl_module.py:18
Method__init__
(self)
rl-postrain/src/open-r1-multimodal/src/open_r1/vlm_modules/qwen_module.py:20
Method__init__
(self)
rl-postrain/src/open-r1-multimodal/src/open_r1/vlm_modules/vlm_module.py:7
Method__init__
( self, model: Union[str, PreTrainedModel], reward_funcs: Union[RewardFunc, list[Rewar
rl-postrain/src/open-r1-multimodal/src/open_r1/trainer/vllm_grpo_trainer.py:118
Method__init__
( self, data_source: Sized, mini_repeat_count: int, batch_size: int = 1,
rl-postrain/src/open-r1-multimodal/src/open_r1/trainer/grpo_trainer.py:97
Method__init__
( self, model: Union[str, PreTrainedModel], reward_funcs: Union[RewardFunc, list[Rewar
rl-postrain/src/open-r1-multimodal/src/open_r1/trainer/grpo_trainer.py:214
Method__init__
(self, pre_config, post_config, layer_num: int = 2)
src/mindomni.py:20
Method__init__
(self, config)
src/mllm.py:131
Method__init__
Phi3RMSNorm is equivalent to T5LayerNorm
src/image_decoder/modeling_phi3.py:116
Method__init__
(self, dim, max_position_embeddings=2048, base=10000, device=None)
src/image_decoder/modeling_phi3.py:137
Method__init__
(self, dim, config, device=None)
src/image_decoder/modeling_phi3.py:166
Method__init__
(self, dim, config, device=None)
src/image_decoder/modeling_phi3.py:207
Method__init__
(self, dim, config, device=None)
src/image_decoder/modeling_phi3.py:252
Method__init__
(self, config: Phi3Config, layer_idx: Optional[int] = None)
src/image_decoder/modeling_phi3.py:363
Method__init__
(self, *args, **kwargs)
src/image_decoder/modeling_phi3.py:493
Method__init__
(self, config: Phi3Config, layer_idx: int)
src/image_decoder/modeling_phi3.py:738
Method__init__
(self, config: Phi3Config)
src/image_decoder/modeling_phi3.py:950
Method__init__
(self, config)
src/image_decoder/modeling_phi3.py:1168
← previousnext →201–300 of 516, ranked by callers