MCPcopy Create free account

hub / github.com/OpenGVLab/unmasked_teacher / functions

Functions1,198 in github.com/OpenGVLab/unmasked_teacher

↓ 4 callersFunctionsetup_model
( config, model_cls, has_decoder=False, pretrain=False, find_unused_parameters=False )
multi_modality/tasks/shared_utils.py:40
↓ 4 callersFunctionsetup_wandb
(config)
multi_modality/utils/logger.py:26
↓ 4 callersFunctionsynchronize
Helper function to synchronize (barrier) among all processes when using distributed training
single_modality/action_detection/alphaction/utils/comm.py:31
↓ 4 callersMethodsynchronize_between_processes
(self)
multi_modality/utils/basic_utils.py:135
↓ 4 callersMethodupdate
(self, value, n=1)
single_modality/utils.py:34
↓ 3 callersMethod__init__
(self, cfg, dim_in, dim_out, kernels, stride, padding, dilation=1, init_weight=None)
single_modality/action_detection/alphaction/modeling/common_blocks.py:7
↓ 3 callersMethod__init__
(self, cfg)
single_modality/action_detection/alphaction/modeling/backbone/slowfast.py:106
↓ 3 callersMethod__len__
(self)
single_modality/datasets/kinetics.py:306
↓ 3 callersMethod__len__
(self)
single_modality/datasets/ssv2.py:315
↓ 3 callersMethod__len__
(self)
single_modality/datasets/ssv2.py:591
↓ 3 callersMethod__len__
(self)
single_modality/datasets/kinetics_sparse.py:294
↓ 3 callersFunction_block_set
(ia_blocks)
single_modality/action_detection/alphaction/utils/IA_helper.py:3
↓ 3 callersFunction_cfg
(url='', **kwargs)
single_modality/action_detection/modeling_finetune.py:14
↓ 3 callersFunction_get_global_gloo_group
Return a process group based on gloo backend, containing all the ranks The result is cached.
single_modality/action_detection/alphaction/utils/comm.py:49
↓ 3 callersFunction_pil_interp
(method)
single_modality/datasets/video_transforms.py:32
↓ 3 callersMethod_should_log_tensorboard
(self)
multi_modality/utils/logger.py:238
↓ 3 callersMethodadd_single_detected_image_info
Adds detections for a single image to be used for evaluation. Args: image_id: A unique string/integer identifier for the image. detec
single_modality/action_detection/alphaction/dataset/datasets/evaluation/ava/pascal_evaluation/object_detection_evaluation.py:81
↓ 3 callersFunctionarea
Computes area of boxes. Args: boxes: Numpy array with shape [N, 4] holding N boxes Returns: a numpy array with shape [N*1] representing
single_modality/action_detection/alphaction/dataset/datasets/evaluation/ava/pascal_evaluation/np_box_ops.py:25
↓ 3 callersFunctionarea
Computes area of masks. Args: masks: Numpy array with shape [N, height, width] holding N masks. Masks values are of type np.uint8 and val
single_modality/action_detection/alphaction/dataset/datasets/evaluation/ava/pascal_evaluation/np_mask_ops.py:27
↓ 3 callersMethodattention
(self, x, return_attn=False)
multi_modality/models/backbones/vit/clip.py:48
↓ 3 callersFunctionbatch_different_videos
:param videos: a list of video tensors :param size_divisible: output_size(width and height) should be divisble by this param :return: bat
single_modality/action_detection/alphaction/dataset/collate_batch.py:4
↓ 3 callersFunctionblend
Blend two images with a given weight alpha. Args: images1 (tensor): the first images to be blended, the dimension is `num
single_modality/datasets/video_transforms.py:275
↓ 3 callersFunctionbuild_dataset
(is_train, test_mode, args)
single_modality/datasets/build.py:83
↓ 3 callersFunctionbuild_vit
(config, add_pool_norm=True)
multi_modality/models/backbones/vit/vit.py:420
↓ 3 callersMethodc2_weight_mapping
(self)
single_modality/action_detection/alphaction/modeling/common_blocks.py:26
↓ 3 callersFunctioncreate_optimizer
( args, model, get_num_layer=None, get_layer_scale=None, filter_bias_and_bn=True, skip_list=N
single_modality/optim_factory.py:101
↓ 3 callersMethodencode_text
encode text. Args: text (dict): The output of huggingface's `PreTrainedTokenizer`. contains keys: - input_ids (tor
multi_modality/models/umt.py:204
↓ 3 callersMethodevaluate
Evaluates detections and returns a dictionary of metrics.
single_modality/action_detection/alphaction/dataset/datasets/evaluation/ava/pascal_evaluation/object_detection_evaluation.py:92
↓ 3 callersFunctionfuse_batch_num
(things)
single_modality/action_detection/alphaction/modeling/roi_heads/action_head/IA_structure.py:385
↓ 3 callersFunctionget_frame_indices
(num_frames, vlen, sample='rand', fix_start=None, input_fps=1, max_num_frames=-1)
multi_modality/dataset/video_utils.py:48
↓ 3 callersFunctionget_rank
()
single_modality/action_detection/alphaction/utils/comm.py:20
↓ 3 callersFunctionget_sim
calculate pair-wise video-text similarity. Args: vision_proj (torch.Tensor): The vision representation. Shape: [B,T,C]. text_proj
multi_modality/models/criterions.py:15
↓ 3 callersFunctionget_sinusoid_encoding_table
Sinusoid position encoding table
single_modality/models/modeling_finetune.py:158
↓ 3 callersFunctionhorizontal_flip
Perform horizontal flip on the given images and corresponding boxes. Args: prob (float): probility to flip the images. images
single_modality/datasets/video_transforms.py:155
↓ 3 callersFunctionis_dist_avail_and_initialized
()
single_modality/utils.py:282
↓ 3 callersFunctionis_dist_avail_and_initialized
()
single_modality/action_detection/utils.py:220
↓ 3 callersFunctionload_state_dict
(model, state_dict, input_resolution=224, patch_size=16, center=True)
multi_modality/models/backbones/vit/clip.py:172
↓ 3 callersFunctionload_state_dict
(model, state_dict, input_resolution=224, patch_size=16, center=True)
single_modality/models/clip.py:188
↓ 3 callersFunctionmake_image_key
Returns a unique identifier for a video id & timestamp.
single_modality/action_detection/data/ava_eval.py:36
↓ 3 callersFunctionmake_image_key
Returns a unique identifier for a video id & timestamp.
single_modality/action_detection/alphaction/dataset/datasets/evaluation/ava/ava_eval.py:33
↓ 3 callersFunctionrandom_crop
Perform random spatial crop on the given images and corresponding boxes. Args: images (tensor): images to perform random crop. The di
single_modality/datasets/video_transforms.py:119
↓ 3 callersMethodset_step
(self, step=None)
single_modality/utils.py:232
↓ 3 callersFunctionsetup_dataloaders
(config, mode="pt")
multi_modality/tasks/pretrain.py:117
↓ 3 callersFunctiontile
(x, dim, n_tile)
multi_modality/models/utils.py:192
↓ 3 callersMethodtokenize
Basic Tokenization of a piece of text. Split on "white spaces" only, for sub-word tokenization, see WordPieceTokenizer. Args:
multi_modality/models/backbones/bert/tokenization_bert.py:374
↓ 3 callersFunctiontrain_class_batch
(model, samples, boxes)
single_modality/action_detection/engine_for_finetuning.py:22
↓ 3 callersFunctionuniform_crop
Perform uniform spatial sampling on the images and corresponding boxes. Args: images (tensor): images to perform uniform crop. The di
single_modality/datasets/video_transforms.py:190
↓ 3 callersMethodupdate
(self, head='scalar', step=None, **kwargs)
single_modality/utils.py:238
↓ 3 callersMethodvalue
(self)
multi_modality/utils/basic_utils.py:72
↓ 3 callersFunctionwhitespace_tokenize
Runs basic whitespace cleaning and splitting on a piece of text.
multi_modality/models/backbones/bert/tokenization_bert.py:108
↓ 2 callersMethod__init__
(self, masking_prob, tokenizer)
multi_modality/models/criterions.py:208
↓ 2 callersMethod__init__
( self, width, layers, heads, clip_return_layer=1, clip_return_interval=1 )
multi_modality/models/backbones/vit/clip.py:68
↓ 2 callersMethod__init__
( self, width, layers, heads, return_attn=False, clip_return_layer=1, clip_return_int
single_modality/models/clip.py:66
↓ 2 callersMethod__init__
(self, img_size=224, patch_size=16, encoder_in_chans=3,
single_modality/models/modeling_pretrain.py:173
↓ 2 callersMethod__init__
(self, num_classes=768, embed_dim=768, norm_layer=nn.LayerNorm, clip_norm_type='l2')
single_modality/models/modeling_pretrain_umt.py:136
↓ 2 callersMethod_aug_frame
( self, buffer, args, )
single_modality/datasets/kinetics.py:177
↓ 2 callersMethod_aug_frame
( self, buffer, args, )
single_modality/datasets/ssv2.py:195
↓ 2 callersMethod_aug_frame
( self, buffer, args, )
single_modality/datasets/ssv2.py:470
↓ 2 callersMethod_aug_frame
( self, buffer, args, )
single_modality/datasets/kinetics_sparse.py:176
↓ 2 callersFunction_cached_log_stream
(filename)
multi_modality/utils/logger.py:195
↓ 2 callersFunction_copy_extra_fields
Copies the extra fields of boxlist_to_copy_from to boxlist_to_copy_to. Args: boxlist_to_copy_to: BoxList to which extra fields are copied.
single_modality/action_detection/alphaction/dataset/datasets/evaluation/ava/pascal_evaluation/np_box_list_ops.py:535
↓ 2 callersMethod_erase
(self, img, chan, img_h, img_w, dtype)
single_modality/datasets/random_erasing.py:80
↓ 2 callersMethod_get_ith_class_arrays
Returns numpy arrays belonging to class with index `class_index`. Args: detected_boxes: A numpy array containing detected boxes. dete
single_modality/action_detection/alphaction/dataset/datasets/evaluation/ava/pascal_evaluation/per_image_evaluation.py:486
↓ 2 callersFunction_get_pixels
( per_pixel, rand_color, patch_size, dtype=torch.float32, device="cuda" )
single_modality/datasets/random_erasing.py:11
↓ 2 callersMethod_initialize_detections
(self)
single_modality/action_detection/alphaction/dataset/datasets/evaluation/ava/pascal_evaluation/object_detection_evaluation.py:489
↓ 2 callersFunction_load_checkpoint_for_ema
Workaround for ModelEma._load_checkpoint to accept an already-loaded object
single_modality/utils.py:257
↓ 2 callersFunction_load_checkpoint_for_ema
Workaround for ModelEma._load_checkpoint to accept an already-loaded object
single_modality/action_detection/utils.py:195
↓ 2 callersMethod_load_file
(self, f)
single_modality/action_detection/alphaction/utils/checkpoint.py:106
↓ 2 callersMethod_load_from_state_dict
(self, state_dict, prefix, metadata, strict, missing_keys, unexpected_keys, erro
single_modality/action_detection/alphaction/layers/batch_norm.py:57
↓ 2 callersMethod_make_interaction_block
(self, block_type, block_name, dim_person, dim_other, dim_out, dim_inner, structure_cfg)
single_modality/action_detection/alphaction/modeling/roi_heads/action_head/IA_structure.py:208
↓ 2 callersFunction_pad_to_largest_tensor
Returns: list[int]: size of the tensor, on each rank Tensor: padded tensor that has the max size
single_modality/action_detection/alphaction/utils/comm.py:71
↓ 2 callersMethod_params_per_batch
(self)
single_modality/datasets/mixup.py:141
↓ 2 callersMethod_prepare_batches
(self)
single_modality/action_detection/alphaction/dataset/samplers/grouped_batch_sampler.py:38
↓ 2 callersFunction_register_generic
(module_dict, module_name, module)
single_modality/action_detection/alphaction/utils/registry.py:3
↓ 2 callersMethod_run_strip_accents
Strips accents from a piece of text.
multi_modality/models/backbones/bert/tokenization_bert.py:411
↓ 2 callersMethod_sample_train_indices
(self, num_frames)
single_modality/datasets/mae.py:226
↓ 2 callersFunction_serialize_to_tensor
(data, group)
single_modality/action_detection/alphaction/utils/comm.py:60
↓ 2 callersFunctionall_gather
Run all_gather on arbitrary picklable data (not necessarily tensors). Args: data: any picklable object group: a torch process
single_modality/action_detection/alphaction/utils/comm.py:98
↓ 2 callersMethodattention
(self, x, return_attn=False)
single_modality/models/clip.py:46
↓ 2 callersFunctionbuild_ava_dataset
(is_train, transforms, frame_span=64)
single_modality/action_detection/datasets.py:26
↓ 2 callersFunctionbuild_clip
(config)
multi_modality/models/backbones/vit/clip.py:256
↓ 2 callersMethodbuild_data
(self)
multi_modality/dataset/caption_dataset.py:97
↓ 2 callersFunctionbuild_pretraining_dataset
(args)
single_modality/datasets/build.py:60
↓ 2 callersFunctionbuild_transforms
(cfg=TransformsCfg(), is_train=True, sparse=False)
single_modality/action_detection/data/transforms.py:29
↓ 2 callersMethodc2_weight_mapping
(self)
single_modality/action_detection/alphaction/modeling/backbone/i3d.py:134
↓ 2 callersMethodcheck_fetch_mem_feature
(self, movie_cache, mem_ind, max_num, cur_loss, use_penalty)
single_modality/action_detection/alphaction/modeling/roi_heads/action_head/roi_action_feature_extractor.py:157
↓ 2 callersFunctionconvert_img
Converts (H, W, C) numpy.ndarray to (C, W, H) format
single_modality/datasets/volume_transforms.py:6
↓ 2 callersMethodconvert_key
(self, org_key)
single_modality/action_detection/alphaction/dataset/datasets/ava.py:24
↓ 2 callersFunctioncreate_sampler
(datasets, shuffles, num_tasks, global_rank)
multi_modality/dataset/__init__.py:228
↓ 2 callersFunctioncrop_boxes
Peform crop on the bounding boxes given the offsets. Args: boxes (ndarray or None): bounding boxes to peform crop. The dimension
single_modality/datasets/video_transforms.py:100
↓ 2 callersFunctionevaluation_wrapper
(model, data_loader, tokenizer, device, config, prefix="")
multi_modality/tasks/retrieval_utils.py:73
↓ 2 callersFunctionfilter_scores_greater_than
Filter to keep only boxes and masks with score exceeding a given threshold. This op keeps the collection of boxes and masks whose corresponding sco
single_modality/action_detection/alphaction/dataset/datasets/evaluation/ava/pascal_evaluation/np_box_mask_list_ops.py:367
↓ 2 callersFunctionfilter_scores_greater_than
Filter to keep only boxes with score exceeding a given threshold. This op keeps the collection of boxes whose corresponding scores are greater th
single_modality/action_detection/alphaction/dataset/datasets/evaluation/ava/pascal_evaluation/np_box_list_ops.py:472
↓ 2 callersFunctionfinal_test
(data_loader, model, device, file)
single_modality/engines/engine_for_finetuning.py:180
↓ 2 callersFunctionflat_list_of_lists
flatten a list of lists [[1,2], [3,4]] to [1,2,3,4]
multi_modality/utils/basic_utils.py:246
↓ 2 callersMethodget_mask
Args: sim (torch.Tensor): The similarity between videos and texts. shape: (B, B). idx (torch.Tensor): The index for e
multi_modality/models/criterions.py:179
↓ 2 callersFunctionget_media_types
get the media types for for all the dataloaders. Args: datasources (List): List of dataloaders or datasets. Returns: List. The media
multi_modality/tasks/shared_utils.py:17
↓ 2 callersFunctionget_parameter_groups
( model, weight_decay=1e-5, skip_list=(), get_num_layer=None, get_layer_scale=None, )
single_modality/optim_factory.py:56
↓ 2 callersFunctionget_parameter_groups
(model, weight_decay=1e-5, skip_list=(), get_num_layer=None, get_layer_scale=None, lr
single_modality/action_detection/optim_factory.py:51
↓ 2 callersFunctionget_position_angle_vec
(position)
multi_modality/models/backbones/vit/vit.py:166
← previousnext →101–200 of 1,198, ranked by callers