MCPcopy Create free account

hub / github.com/alipay/Ant-Multi-Modal-Framework / functions

Functions4,004 in github.com/alipay/Ant-Multi-Modal-Framework

↓ 2 callersFunction_called_with_config
Returns: bool: whether the arguments contain :class:`Configuration` and should be considered forwarded to from_config.
antmmf/common/configurable.py:201
↓ 2 callersMethod_change_in_channels
Adjust model's first convolution layer to in_channels, if in_channels not equals 3. Args: in_channels (int): Input data's channel
antmmf/modules/vision/backbone/efficientnet.py:404
↓ 2 callersMethod_check_annotation_db_present
(self)
antmmf/datasets/database/image_database.py:122
↓ 2 callersMethod_check_model_name_is_valid
Validates model name. Args: model_name (str): Name for efficientnet. Returns: bool: Is a valid name or not.
antmmf/modules/vision/backbone/efficientnet.py:392
↓ 2 callersFunction_compute_recall_from_affine_closeness
assume that the distance between text and video in the same pair is smaller than they each compared with other modality in other pairs
antmmf/modules/metrics/mm_retrieval_recall.py:13
↓ 2 callersMethod_compute_saliency
(self, grad_dict, embeddings_list)
antmmf/modules/interpret/saliency_interpreter.py:73
↓ 2 callersMethod_convert_to_indices
(self, tokens_a, tokens_b=None, probability=0.15)
antmmf/datasets/processors/text_processors.py:839
↓ 2 callersMethod_convert_value_to_str
(self)
antmmf/common/configuration.py:514
↓ 2 callersFunction_decode_value
(value)
antmmf/common/configuration.py:46
↓ 2 callersFunction_download
(url: str, root: str)
antmmf/modules/vision/backbone/clip/model.py:616
↓ 2 callersMethod_expand2square
(self, pil_img)
prj/Pink/pink/datasets/BaseDataset.py:90
↓ 2 callersFunction_extract_normalized_salience_across_time
(attr)
antmmf/modules/interpret/saliency_interpreter.py:211
↓ 2 callersFunction_extract_pred_answer
(attr)
antmmf/modules/interpret/saliency_interpreter.py:219
↓ 2 callersFunction_find_my_group_index
(grouped_ranks)
prj/M2_Encoder/vlmo/torchscale/component/xmoe/moe_layer.py:65
↓ 2 callersMethod_freeze_stages
(self)
antmmf/modules/vision/backbone/cctt.py:946
↓ 2 callersFunction_get_activation_fn
Return an activation function given a string
antmmf/modules/transformers/base.py:508
↓ 2 callersFunction_get_args_from_config
Use `from_config` to obtain explicit arguments. Returns: dict: arguments to be used for :func:`cls.__init__`
antmmf/common/configurable.py:163
↓ 2 callersMethod_get_attrs
Returns possible attribute that can point to image id Args: item (Object): Object from the DB Returns: List[
antmmf/datasets/database/image_database.py:210
↓ 2 callersFunction_get_clones
(module, N)
antmmf/modules/transformers/base.py:504
↓ 2 callersMethod_get_data_item_train
(self, i)
prj/Pink/pink/datasets/BaseDataset.py:189
↓ 2 callersMethod_get_embeddings_attr
(self, attr)
antmmf/models/ant_mmf.py:125
↓ 2 callersFunction_get_input_ids
(text, mask)
antmmf/models/mm_adversarial.py:11
↓ 2 callersMethod_get_one_item
(self, sample_info, video_info)
prj/snps3_vtp/roi_univl/univl/video_text/ret_dataset.py:148
↓ 2 callersMethod_get_one_item
(self, sample_info, video_info)
prj/dmae_vtp/roi_univl/univl/video_text/ret_dataset.py:248
↓ 2 callersMethod_get_one_item
(self, sample_info, video_info)
prj/base_vtp/roi_univl/univl/video_text/ret_dataset.py:148
↓ 2 callersMethod_get_src_permutation_idx
(self, indices)
antmmf/modules/functional/set_criterion.py:127
↓ 2 callersMethod_get_video_start
Args: video_path(str): video path. start(float): start timestamp of video for sampling frames duration(f
antmmf/datasets/processors/video_processors.py:105
↓ 2 callersMethod_get_wti_similarity
(self, text_feat, video_feat, text_mask, video_mask, text_weight=None, video_weigh
prj/dmae_vtp/roi_univl/univl/model/dmae_utils.py:85
↓ 2 callersMethod_ignore_sample
(self, sample_list, model_output, task, ignored_label=-1)
antmmf/modules/metrics/multi_macro_f1.py:33
↓ 2 callersMethod_ignore_sample
(self, sample_list, model_output, task, ignored_label=-1)
antmmf/modules/metrics/multi_accuracy.py:32
↓ 2 callersMethod_inference_run
(self, dataset_type)
antmmf/trainers/base_trainer.py:902
↓ 2 callersMethod_init_extras
(self, config, *args, **kwargs)
antmmf/datasets/processors/image_processors.py:225
↓ 2 callersMethod_init_reader
(self)
antmmf/datasets/features/feature_readers.py:67
↓ 2 callersMethod_load_model
(self, model_key, attributes)
antmmf/trainers/base_trainer.py:248
↓ 2 callersMethod_make_layer
( self, block: Type[Union[BasicBlock, Bottleneck]], planes: int, blocks: int,
antmmf/modules/vision/backbone/cctt.py:898
↓ 2 callersMethod_map_strings_to_indices
(self, tokens)
antmmf/datasets/processors/text_processors.py:241
↓ 2 callersMethod_mask_attentions
(attention, image_locs)
antmmf/modules/attention.py:121
↓ 2 callersMethod_mce_calculate_acc_and_rec
Calculate mce accuracy & recall.
antmmf/modules/metrics/mce_accuracy.py:29
↓ 2 callersFunction_organize_for_two_modalities
(model_output, modalities=List)
antmmf/modules/metrics/mm_retrieval_recall.py:45
↓ 2 callersMethod_predict
(self, sample_list)
antmmf/predictors/base_predictor.py:224
↓ 2 callersMethod_prepare_base_model
(self)
antmmf/datasets/features/vision/video_feature.py:124
↓ 2 callersMethod_preprocess
Preprocess an image or batch of images. Copy of the `preprocess` method from `CLIPImageProcessor`. Args: images (`ImageI
prj/M2_omni/models/image_processing_m2omni.py:192
↓ 2 callersMethod_read_features_and_info
(self, feat_file)
antmmf/datasets/database/features_database.py:92
↓ 2 callersFunction_reset
(item)
antmmf/utils/init.py:52
↓ 2 callersMethod_reshape_tensor
(input_tensor)
antmmf/modules/utils.py:517
↓ 2 callersMethod_save_feature
(self, file_name, feature, info)
antmmf/scripts/features/extract_features_vmb.py:216
↓ 2 callersMethod_set_tensor_field
(self, value)
antmmf/structures/sample.py:257
↓ 2 callersMethod_summarize_overall
Print sample-wise metrics and batch-wise losses/metrics, used in validating a whole val/test set.
antmmf/trainers/base_trainer.py:874
↓ 2 callersMethod_truncate_seq_pair
Truncates a sequence pair in place to the maximum length.
antmmf/datasets/processors/text_processors.py:797
↓ 2 callersMethod_try_full_validation
(self, force=False)
antmmf/trainers/base_trainer.py:768
↓ 2 callersMethod_validate
( self, emissions: torch.Tensor, tags: Optional[torch.LongTensor] = None, mask
antmmf/modules/layers/crf.py:142
↓ 2 callersMethodadd_caption
(self, sample_info, sample)
prj/dmae_vtp/roi_univl/univl/video_text/ret_dataset.py:179
↓ 2 callersMethodadd_caption
(self, sample_info, sample)
prj/cnvid_vtp/roi_univl/roi/dataset.py:252
↓ 2 callersMethodadd_itm_label
( self, sample_info, sample, current_sample_idx, random_ocr=True,
prj/snps3_vtp/roi_univl/roi/dataset.py:225
↓ 2 callersMethodadd_itm_label
( self, sample_info, sample, current_sample_idx, random_ocr=True,
prj/dmae_vtp/roi_univl/roi/dataset.py:225
↓ 2 callersMethodadd_itm_label
( self, sample_info, sample, current_sample_idx, random_ocr=True,
prj/base_vtp/roi_univl/roi/dataset.py:225
↓ 2 callersMethodadd_key_val
(self, k0, v0, num=1)
prj/snps3_vtp/auxiliary_files/generate_ss_word_json/1st_ss_word_mining.py:17
↓ 2 callersMethodadd_label
(self, sample_info, sample)
prj/snps3_vtp/roi_univl/univl/video_text/ret_dataset.py:120
↓ 2 callersMethodadd_label
(self, sample_info, sample)
prj/dmae_vtp/roi_univl/univl/video_text/ret_dataset.py:156
↓ 2 callersMethodadd_label
(self, sample_info, sample)
prj/base_vtp/roi_univl/univl/video_text/ret_dataset.py:120
↓ 2 callersMethodadd_next_word
(self, seqs, prev_word_inds, next_word_inds)
antmmf/utils/text_utils.py:454
↓ 2 callersMethodadd_ocr_details
(self, sample_info, sample)
prj/snps3_vtp/roi_univl/roi/dataset.py:317
↓ 2 callersMethodadd_ocr_details
(self, sample_info, sample)
prj/dmae_vtp/roi_univl/roi/dataset.py:317
↓ 2 callersMethodadd_ocr_details
(self, sample_info, sample)
prj/base_vtp/roi_univl/roi/dataset.py:317
↓ 2 callersMethodadd_video
(self, sample_info, sample, add_default=True)
prj/snps3_vtp/roi_univl/univl/video_text/ret_dataset.py:89
↓ 2 callersMethodadd_video
(self, sample_info, sample, add_default=True)
prj/dmae_vtp/roi_univl/univl/video_text/ret_dataset.py:125
↓ 2 callersMethodadd_video
(self, sample_info, sample, add_default=True)
prj/base_vtp/roi_univl/univl/video_text/ret_dataset.py:89
↓ 2 callersMethodall_to_all_wrapper
(self, input: Tensor)
prj/M2_Encoder/vlmo/torchscale/component/xmoe/moe_layer.py:295
↓ 2 callersMethodasy_loss
(self, x, y)
antmmf/modules/losses/asymmetric_loss_optimized.py:47
↓ 2 callersMethodattack
(self, external_optimizer=None, sample_list=None)
antmmf/models/nlp_adversarial.py:37
↓ 2 callersFunctionbroadcast
(src: torch.Tensor, other: torch.Tensor, dim: int)
antmmf/utils/scatter.py:5
↓ 2 callersFunctionbuild_collate_fn
(_dataset)
antmmf/common/task_loader.py:18
↓ 2 callersFunctionbuild_config
Build configuration from command line.
antmmf/common/build.py:8
↓ 2 callersMethodbuild_hier_group
(self)
antmmf/modules/utils.py:284
↓ 2 callersFunctionbuild_model
(config: dict, state_dict: dict = None)
antmmf/modules/vision/backbone/clip/cn_model.py:308
↓ 2 callersFunctionbuild_model
(config, for_test=False)
antmmf/models/build.py:9
↓ 2 callersFunctionbuild_optimizer
(model, config, overwrite_optimizer_attributes=None)
antmmf/optimizer/build.py:10
↓ 2 callersFunctionbuild_pretrained_model
(config)
antmmf/models/build.py:28
↓ 2 callersFunctionbuild_tokenizer
AutoTokenizer needs transformer config to decide which tokenizer instance to initialize: * If we have downloaded the pretrained model, `token
antmmf/datasets/build.py:64
↓ 2 callersFunctionbytes_to_unicode
Returns list of utf-8 byte and a corresponding list of unicode strings. The reversible bpe codes work on unicode strings. This means you
antmmf/modules/vision/backbone/clip/simple_tokenizer.py:36
↓ 2 callersMethodcalculate
Abstract method to be implemented by the child class. Takes in a ``SampleList`` and a dict returned by model as output and returns bac
antmmf/modules/metrics/base_metric.py:18
↓ 2 callersMethodcalculate_logits
(self, joint_embedding, **kwargs)
antmmf/models/ant_mmf.py:284
↓ 2 callersFunctioncheck_header
Performs a HEAD request to check if the URL / Google Drive ID is live.
antmmf/utils/download.py:309
↓ 2 callersMethodchecksum
Checksum on a given file. Args: download_path (string): path to the downloaded file.
antmmf/utils/download.py:100
↓ 2 callersMethodclean_config
Override this in case you want to clean the config you updated earlier in update_registry_for_model
antmmf/tasks/base_task.py:219
↓ 2 callersFunctioncom_mult
(a, b)
antmmf/modules/utils.py:57
↓ 2 callersFunctioncomputeIoU
(box1, box2)
prj/Pink/pink/eval/object365_filter.py:9
↓ 2 callersFunctioncomputeIoU
(box1, box2)
prj/Pink/pink/eval/eval_vg.py:15
↓ 2 callersMethodcompute_norm
(self, edge_index, num_nodes)
antmmf/modules/graph.py:390
↓ 2 callersMethodcompute_norm
(self, edge_index, num_nodes)
antmmf/modules/graph.py:544
↓ 2 callersFunctionconj
(a)
antmmf/modules/utils.py:63
↓ 2 callersMethodconstruct_reader
(self)
antmmf/datasets/utils.py:176
↓ 2 callersMethodconvert_id2text
(self, tokenizer, generation_ids)
antmmf/modules/transformers/heads/mlm.py:58
↓ 2 callersFunctionconvert_pl_ckpt
(state_dict, num_visual_token=197)
prj/M2_Encoder/vlmo/modules/vlmo_module.py:22
↓ 2 callersFunctionconvert_to_one_hot
(expected, output)
antmmf/modules/metrics/utils.py:7
↓ 2 callersFunctionconvert_to_xywh
(boxes)
antmmf/modules/metrics/evaluators/coco_eval.py:174
↓ 2 callersMethodcreateIndex
(self)
prj/Pink/pink/eval/vqa_tools/vqa_result.py:366
↓ 2 callersMethodcreateIndex
(self)
prj/Pink/pink/eval/vqa_tools/vqa.py:53
↓ 2 callersFunctioncreate_image_tensor_from_images
Args: images: a tuple or list of `torch.Tensor`, each of shape (Hi, Wi) or (C_1, ..., C_K, Hi, Wi) where K >= 1. The Tensors
antmmf/structures/utils.py:40
↓ 2 callersMethoddecode
Find the most likely tag sequence using Viterbi algorithm. Args: emissions (`~torch.Tensor`): Emission score tensor of size
antmmf/modules/layers/crf.py:117
← previousnext →401–500 of 4,004, ranked by callers