Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/alipay/Ant-Multi-Modal-Framework
/ functions
Functions
4,004 in github.com/alipay/Ant-Multi-Modal-Framework
⨍
Functions
4,004
◇
Types & classes
941
↳
Endpoints
1
↓ 1 callers
Method
init_weights
(self)
antmmf/models/visual_bert.py:319
↓ 1 callers
Method
init_weights
(self)
antmmf/models/bert.py:284
↓ 1 callers
Method
init_weights
(self)
antmmf/models/vilbert.py:1140
↓ 1 callers
Method
initialize_num_words
(self)
antmmf/modules/approx_compute.py:131
↓ 1 callers
Method
initialize_vision_tokenizer
(self, tokenizer)
prj/Pink/pink/model/pink.py:368
↓ 1 callers
Method
initialize_visual_from_pretrained
(self)
antmmf/modules/embeddings/bert_vision_linguistic_embeddings.py:23
↓ 1 callers
Function
interpolate_pos_embed
(model, checkpoint_model)
prj/Pink/pink/model/eva_vit.py:382
↓ 1 callers
Method
interpret
(self, dataset_type, use_tqdm=True)
antmmf/trainers/base_trainer.py:834
↓ 1 callers
Method
is_batch_sampler
(self)
antmmf/datasets/samplers.py:44
↓ 1 callers
Function
is_chinese
(word: str)
antmmf/utils/text_utils.py:238
↓ 1 callers
Function
is_decord_available
()
prj/M2_omni/models/m2omni_utils.py:42
↓ 1 callers
Function
iter_random_indices
Get an infinite iterator that randomly samples the index of the source to pick examples from.
prj/Pink/pink/datasets/ProbMergeDataset.py:99
↓ 1 callers
Method
json_dump
(self, filepath)
antmmf/common/test_reporter.py:98
↓ 1 callers
Function
keys_to_transforms
(keys: list, size=224)
prj/M2_Encoder/vlmo/transforms/__init__.py:18
↓ 1 callers
Method
label_smooth_cross_entropy
(self, input, target)
antmmf/modules/losses/label_smoothing_cross_entropy.py:27
↓ 1 callers
Function
linear_gelu_forward
(input_, weight1, bias1, weight2, bias2)
antmmf/utils/optim_utils.py:55
↓ 1 callers
Method
loadRes
Load result file and return a result object. :param resFile (str) : file name of result file :return: res (obj)
prj/Pink/pink/eval/vqa_tools/vqa_result.py:486
↓ 1 callers
Method
loadRes
Load result file and return a result object. :param resFile (str) : file name of result file :return: res (obj)
prj/Pink/pink/eval/vqa_tools/vqa.py:173
↓ 1 callers
Method
load_checkpoint
(self)
antmmf/predictors/base_predictor.py:155
↓ 1 callers
Method
load_extras
(self, has_check_point=True)
antmmf/trainers/base_trainer.py:376
↓ 1 callers
Method
load_extras
load any inference related model or resources
antmmf/predictors/base_predictor.py:196
↓ 1 callers
Function
load_from_file
(file_path: str)
antmmf/common/configuration.py:106
↓ 1 callers
Method
load_image
(self, directory, idx, **kwargs)
antmmf/utils/image_ops.py:512
↓ 1 callers
Method
load_model
(self)
antmmf/trainers/distill_trainer.py:58
↓ 1 callers
Method
load_model
(self)
antmmf/predictors/base_predictor.py:114
↓ 1 callers
Method
load_ocr_info
(self, annotation_item)
prj/snps3_vtp/roi_univl/roi/dataset.py:172
↓ 1 callers
Method
load_ocr_info
(self, annotation_item)
prj/dmae_vtp/roi_univl/roi/dataset.py:172
↓ 1 callers
Method
load_ocr_info
(self, annotation_item)
prj/base_vtp/roi_univl/roi/dataset.py:172
↓ 1 callers
Method
load_ocr_info
(self, annotation_item)
prj/cnvid_vtp/roi_univl/roi/dataset.py:172
↓ 1 callers
Function
load_pretrained_model
(model_name, *args, **kwargs)
antmmf/common/checkpoint.py:50
↓ 1 callers
Method
load_pretrained_weight
(self)
prj/M2_Encoder/vlmo/modules/vlmo_module.py:292
↓ 1 callers
Function
load_pretrained_weights
Loads pretrained weights from weights path or download using url. Args: model (Module): The whole model of efficientnet. model_na
antmmf/modules/vision/backbone/efficientnet.py:722
↓ 1 callers
Method
load_processors
(self)
antmmf/predictors/base_predictor.py:105
↓ 1 callers
Method
load_state_dict
(self, name, download_root=None)
prj/snps3_vtp/roi_univl/univl/model/clip_text_encoder.py:194
↓ 1 callers
Method
load_state_dict
(self, name, download_root=None)
prj/snps3_vtp/roi_univl/univl/model/clip_visual_encoder.py:46
↓ 1 callers
Method
load_state_dict
(self, name, download_root=None)
prj/dmae_vtp/roi_univl/univl/model/clip_visual_encoder.py:46
↓ 1 callers
Method
load_state_dict
(self, name, download_root=None)
prj/base_vtp/roi_univl/univl/model/clip_text_encoder.py:194
↓ 1 callers
Method
load_state_dict
(self, name, download_root=None)
prj/base_vtp/roi_univl/univl/model/clip_visual_encoder.py:46
↓ 1 callers
Method
load_state_dict
(self)
antmmf/common/checkpoint.py:141
↓ 1 callers
Function
load_state_dict_mapping
load checkpoint and then map the key of the loaded checkpoint to a key in a target model Example of attr_mapping: attr_mapping =
antmmf/common/checkpoint.py:17
↓ 1 callers
Function
load_str_list
(fname)
antmmf/utils/text_utils.py:308
↓ 1 callers
Function
load_vocab
Loads a vocabulary file into a dictionary.
antmmf/modules/vision/backbone/clip/cn_tokenizer.py:141
↓ 1 callers
Function
load_yaml
(yaml_file)
antmmf/utils/file_io.py:114
↓ 1 callers
Function
local_merge
(all_img_ids, all_eval_imgs)
antmmf/modules/metrics/evaluators/coco_eval.py:189
↓ 1 callers
Method
log_uniform_candidate_sampler
(self, targets, choice_func=_choice)
antmmf/modules/approx_compute.py:253
↓ 1 callers
Function
lr_lambda_update
(i_iter, trainer)
antmmf/utils/general.py:27
↓ 1 callers
Function
main
()
prj/Pink/demo.py:338
↓ 1 callers
Function
main
()
antmmf/utils/launch.py:220
↓ 1 callers
Function
main
()
antmmf/scripts/hm_convert.py:156
↓ 1 callers
Function
main
(args)
antmmf/scripts/features/extract_features.py:236
↓ 1 callers
Function
make_batched_audios
Accepts audios in list or nested list format, and makes a list of images for preprocessing. Args: audios (`torch.Tensor`, `List[
prj/M2_omni/models/feature_extraction_sanm.py:271
↓ 1 callers
Function
make_batched_images
Accepts images in list or nested list format, and makes a list of images for preprocessing. Args: images (`Union[List[List[ImageInpu
prj/M2_omni/models/image_processing_m2omni.py:56
↓ 1 callers
Function
make_batched_videos
(videos)
prj/M2_omni/models/image_processing_m2omni.py:79
↓ 1 callers
Method
make_dataloaders
(self)
antmmf/common/task_loader.py:104
↓ 1 callers
Function
make_supervised_data_module
Make dataset and collator for supervised fine-tuning.
prj/Pink/pink/train/train.py:168
↓ 1 callers
Function
mark_done
Mark this path as prebuilt. Marks the path as done by adding a '.built' file with the current timestamp plus a version description strin
antmmf/utils/download.py:189
↓ 1 callers
Method
matched_pairwise_iou
Compute pairwise intersection over union (IOU) of two sets of matched boxes that have the same number of boxes. Similar to :f
antmmf/structures/boxes.py:376
↓ 1 callers
Function
median_blur
Median Blurring, which takes the median of all the pixels under the kernel area and the central element is replaced with this media
antmmf/utils/dataset_utils.py:376
↓ 1 callers
Function
merge
(img_ids, eval_imgs, distributed=True)
antmmf/modules/metrics/evaluators/coco_eval.py:179
↓ 1 callers
Method
merge_with
Make it compatible to the old Configuration, and its function is same as update. Returns: Configuration: the configurati
antmmf/common/configuration.py:392
↓ 1 callers
Method
message
r"""Constructs messages from node :math:`j` to node :math:`i` in analogy to :math:`\phi_{\mathbf{\Theta}}` for each edge in :obj:`edge
antmmf/modules/message_passing/message_passing.py:208
↓ 1 callers
Method
mkdir_if_not_exists
(path: str)
antmmf/utils/file_io.py:74
↓ 1 callers
Method
model_clip_order
(self, clip_feat)
prj/snps3_vtp/roi_univl/univl/model/univl_video_pretrain.py:358
↓ 1 callers
Method
model_clip_order
(self, clip_feat)
prj/dmae_vtp/roi_univl/univl/model/univl_video_pretrain.py:335
↓ 1 callers
Method
model_clip_order
(self, clip_feat)
prj/base_vtp/roi_univl/univl/model/univl_video_pretrain.py:335
↓ 1 callers
Method
model_clip_order
(self, clip_feat)
prj/cnvid_vtp/roi_univl/univl/model/univl_video_pretrain.py:341
↓ 1 callers
Method
model_similarity
(self, cap_input, vis_input, caption_input=None, sample_list=None)
prj/snps3_vtp/roi_univl/univl/model/univl_video_pretrain.py:291
↓ 1 callers
Method
model_similarity
(self, cap_input, vis_input)
prj/dmae_vtp/roi_univl/univl/model/univl_video_pretrain.py:291
↓ 1 callers
Method
model_similarity
(self, cap_input, vis_input)
prj/base_vtp/roi_univl/univl/model/univl_video_pretrain.py:291
↓ 1 callers
Method
mold_vertext_on_image
:param image_np: :param coords: batchx #vertext x 2 :param content: :return:
antmmf/utils/visual_utils/visualization_utils.py:111
↓ 1 callers
Method
momentum_update_key_encoder
Momentum update of the key encoder
prj/snps3_vtp/roi_univl/univl/model/moco_utils.py:56
↓ 1 callers
Method
momentum_update_key_encoder
Momentum update of the key encoder
prj/dmae_vtp/roi_univl/univl/model/moco_utils.py:56
↓ 1 callers
Method
momentum_update_key_encoder
Momentum update of the key encoder
prj/base_vtp/roi_univl/univl/model/moco_utils.py:56
↓ 1 callers
Method
momentum_update_key_encoder
Momentum update of the key encoder
prj/cnvid_vtp/roi_univl/univl/model/moco_utils.py:56
↓ 1 callers
Function
move_device_like
Tracing friendly way to cast tensor to another tensor's device. Device will be treated as constant during tracing, scripting the casting proc
antmmf/structures/utils.py:9
↓ 1 callers
Function
multi_gray
Get output gray_value from multiple-channels. @param img:ndarray,Input image data on range[0,255]. @param gray_type: string, ['average','
antmmf/utils/dataset_utils.py:460
↓ 1 callers
Function
nested_cpu
(model_output)
antmmf/trainers/retrieval_trainer.py:37
↓ 1 callers
Function
normalize
(x, axis=-1)
antmmf/modules/losses/eet_loss.py:9
↓ 1 callers
Function
normalize_word
(token)
prj/Pink/pink/eval/model_vqav2.py:189
↓ 1 callers
Method
not_report
(self)
antmmf/common/metrics_reporter.py:130
↓ 1 callers
Method
open_image
(self, path)
antmmf/datasets/database/image_database.py:207
↓ 1 callers
Function
order_points
(pts)
antmmf/utils/visual_utils/visualization_utils.py:20
↓ 1 callers
Function
organize_dict
(vocab_data, dict_dir, json_save_dir, csv_save_dir, abandon_list=None)
prj/snps3_vtp/auxiliary_files/generate_ss_word_json/2nd_get_what_word_is_important.py:18
↓ 1 callers
Method
output_layer
(self, features)
prj/M2_Encoder/vlmo/torchscale/architecture/decoder.py:427
↓ 1 callers
Method
override_with_cmd_config
Override the configurations, it is usually used in command line. Example: .. code-block:: python # Usage 1: ov
antmmf/common/configuration.py:314
↓ 1 callers
Method
override_with_cmd_opts
Merge options to configurations. Example: .. code-block:: python config = Configuration({"a": 1, "b": {"c": 2,
antmmf/common/configuration.py:345
↓ 1 callers
Function
pad
(image, target, padding)
antmmf/datasets/processors/transforms/detection.py:160
↓ 1 callers
Function
param_type_repr
(param)
antmmf/utils/inspector.py:56
↓ 1 callers
Function
parse_args
Helper function parsing the command line options @retval ArgumentParser
antmmf/utils/launch.py:108
↓ 1 callers
Function
parse_args
()
antmmf/scripts/features/extract_features.py:90
↓ 1 callers
Function
parse_field
Usage: transform the given string fields to List[field], for example: 1. given: "metrics.[0].type" return: ["metrics", "[0
antmmf/common/configuration.py:152
↓ 1 callers
Method
parse_item
(self, i)
prj/Pink/pink/eval/model_object365.py:89
↓ 1 callers
Function
parse_types
(func: Callable)
antmmf/utils/inspector.py:74
↓ 1 callers
Function
patch_config
(config)
prj/Pink/pink/eval/model_vsr.py:64
↓ 1 callers
Function
patch_config
(config)
prj/Pink/pink/eval/model_seed.py:101
↓ 1 callers
Function
patch_config
(config)
prj/Pink/pink/eval/model_pointingvqa_looktwice.py:74
↓ 1 callers
Function
patch_config
(config)
prj/Pink/pink/eval/model_object365.py:126
↓ 1 callers
Function
patch_config
(config)
prj/Pink/pink/eval/model_pointingvqa_local.py:74
↓ 1 callers
Function
patch_config
(config)
prj/Pink/pink/eval/model_vg_base_batch.py:112
↓ 1 callers
Function
patch_config
(config)
prj/Pink/pink/eval/model_vqav2.py:258
← previous
next →
1,401–1,500 of 4,004, ranked by callers