MCPcopy Create free account

hub / github.com/WarmCongee/SDUMC / functions

Functions495 in github.com/WarmCongee/SDUMC

↓ 18 callersFunctionfunc_read_multiprocess
(feature_root, names, processor=None, read_type='feat', model_name=None)
toolkit/utils/read_data.py:70
↓ 15 callersMethodMLP
(self, input_dim, layers, dropout)
toolkit/models/wengnet_mosei_mult_views_text_missing.py:264
↓ 15 callersMethodMLP
(self, input_dim, layers, dropout)
toolkit/models/wengnet_mosei_mult_views_text_missing.py:438
↓ 14 callersFunctionfunc_read_key_from_csv
(csv_path, key)
toolkit/utils/read_files.py:148
↓ 13 callersFunctionconv3x3
3x3 convolution with padding
feature_extraction/visual/manet/model/manet.py:4
↓ 12 callersMethodMLP
(self, input_dim, layers, dropout)
toolkit/models/wengnet_mosei_mult_views_text_missing.py:595
↓ 12 callersMethod_make_layer
(self, block, inplanes, planes, blocks, stride=1)
feature_extraction/visual/manet/model/manet.py:208
↓ 11 callersMethod__init__
(self)
toolkit/utils/loss.py:8
↓ 11 callersMethod__init__
(self)
toolkit/models/wengnet_mosei_mult_views_text_missing.py:11
↓ 10 callersFunctionfunc_mapping_feature_tensor
(feature, dst_len, pad_place='right')
toolkit/utils/read_data.py:139
↓ 9 callersFunctionfunc_mapping_feature
(feature, dst_len)
toolkit/utils/read_data.py:120
↓ 9 callersMethodget_network
(self, self_type='l', layers=-1)
toolkit/models/mult_mosei.py:518
↓ 9 callersMethodget_network
(self, self_type='l', layers=-1)
toolkit/models/mult.py:65
↓ 6 callersFunctioneval_mosei_metric
(results, truths, ids_list, exclude_zero=False)
metric.py:103
↓ 6 callersMethodget_network
(self, self_type='l', layers=-1)
toolkit/models/mult_mosei.py:94
↓ 6 callersMethodget_network
(self, self_type='l', layers=-1)
toolkit/models/mult_mosei.py:230
↓ 6 callersMethodget_network
(self, self_type='l', layers=-1)
toolkit/models/mult_mosei.py:375
↓ 6 callersMethodmaybe_layer_norm
(self, i, x, before=False, after=False)
toolkit/models/modules/transformers_encoder/transformer.py:171
↓ 5 callersMethod_in_proj
(self, input, start=0, end=None, **kwargs)
toolkit/models/modules/transformers_encoder/multihead_attention.py:148
↓ 5 callersFunctionfunc_write_key_to_csv
(csv_path, names, name2key, keynames)
toolkit/utils/read_files.py:162
↓ 5 callersFunctionget_translate_eng2chi
(text, model='gpt-3.5-turbo-16k-0613')
toolkit/utils/chatgpt.py:89
↓ 5 callersFunctionmanet
(**kwargs)
feature_extraction/visual/manet/model/manet.py:272
↓ 5 callersMethodread_names_labels
(self, dataset, data_type, debug=False)
toolkit/dataloader/crossdis.py:136
↓ 4 callersMethodMLP
(self, input_dim, layers, dropout)
toolkit/models/wengnet_mosei_mult_views_text_missing.py:706
↓ 4 callersMethodMLP
(self, input_dim, layers, dropout)
toolkit/models/wengnet_mosei_mult_views_text_missing.py:777
↓ 4 callersMethod__init__
(self, args)
toolkit/models/mult_mosei.py:38
↓ 4 callersMethod__init__
(self, args)
toolkit/models/mctn.py:130
↓ 4 callersFunctionarbitrary_point_mask
Args: index: (b t), index of the masked point len_out: length of mask reverse: reverse the output mask (Default: False)
toolkit/models/dst_att.py:81
↓ 4 callersMethodget_resnet_layer
(self, block=BasicBlock, n_blocks=[2,2,2,2], channels=[64, 128, 256, 512], stride = 1)
feature_extraction/visual/extract_imagenet_embedding.py:88
↓ 4 callersMethodloss
(self, p, q, pad_mask=None)
toolkit/utils/loss.py:78
↓ 4 callersFunctionloss_MMD
(zy)
toolkit/models/mfm.py:22
↓ 4 callersFunctionmulticlass_acc
Compute the multiclass accuracy w.r.t. groundtruth :param preds: Float array representing the predictions, dimension (N,) :param truths:
metric.py:17
↓ 4 callersFunctionpad_to_maxlen_pre_modality_tensor
(audios, texts, videos)
toolkit/utils/read_data.py:213
↓ 4 callersMethodupdate
(self, val, n=1)
feature_extraction/visual/manet/main.py:245
↓ 3 callersMethod__init__
(self, embed_dim, ffn_embed_dim, dropout=0., activation='relu')
toolkit/models/dst_att.py:110
↓ 3 callersMethod__init__
(self, x_size, y_size, n_layers=1, activation='Tanh')
toolkit/models/mmim.py:93
↓ 3 callersMethod__init__
(self)
toolkit/models/misa.py:26
↓ 3 callersMethod__init__
(self, block_b, block_m, block_a, layers, num_classes=12666)
feature_extraction/visual/manet/model/manet.py:167
↓ 3 callersMethod__init__
(self, gate_channels, reduction_ratio=16, pool_types=['avg', 'max'])
feature_extraction/visual/manet/model/attention.py:76
↓ 3 callersFunction_get_activation_fn
Returns the activation function corresponding to `activation`
toolkit/models/dst_att.py:25
↓ 3 callersMethodbackward
(ctx, grad_output)
toolkit/models/misa.py:20
↓ 3 callersFunctioncompute_kernel
(x, y)
toolkit/models/mfm.py:11
↓ 3 callersFunctionread_train_val_test
(label_path, data_type)
toolkit/preprocess/cmumosi.py:32
↓ 3 callersFunctionread_train_val_test
(label_path, data_type)
toolkit/preprocess/cmumosei.py:87
↓ 3 callersFunctiontrain_or_eval_model
(args, model, cl_proj, losses, dataloader, optimizer=None, train=False, task='all')
main_frame_val_text_missing.py:84
↓ 2 callersFunctionCosineSimilarityLoss
(u, v, reduction='mean')
toolkit/utils/loss.py:100
↓ 2 callersFunctionLayerNorm
(embedding_dim)
toolkit/models/modules/transformers_encoder/transformer.py:201
↓ 2 callersFunctionLinear
(in_features, out_features, bias=True)
toolkit/models/modules/transformers_encoder/transformer.py:193
↓ 2 callersMethod__init__
(self, args)
toolkit/models/mfm.py:88
↓ 2 callersMethod__init__
(self, vid, face_dir, transform=None)
feature_extraction/visual/dataset.py:10
↓ 2 callersFunctionaccuracy
Computes the accuracy over the k top predictions for the specified values of k
feature_extraction/visual/manet/main.py:277
↓ 2 callersFunctioncal_amp
(wf)
toolkit/utils/functions.py:349
↓ 2 callersFunctioncal_rms
(amp)
toolkit/utils/functions.py:354
↓ 2 callersFunctionconvert_time
(t)
toolkit/preprocess/cmumosei.py:11
↓ 2 callersMethoddisplay
(self, batch)
feature_extraction/visual/manet/main.py:262
↓ 2 callersFunctionfeature_scale_compress
(audios, texts, videos, scale_factor=1)
toolkit/utils/read_data.py:186
↓ 2 callersFunctionfunc_postprocess_chatgpt
(response)
toolkit/utils/chatgpt.py:47
↓ 2 callersFunctionfunc_shuffle_list_data
(whole_json)
toolkit/utils/read_files.py:137
↓ 2 callersMethodfusion
(self, in_modalities)
toolkit/models/graph_mfn.py:73
↓ 2 callersFunctiongenerate_csv
(input_root, save_root, startIdx)
feature_extraction/visual/extract_openface.py:41
↓ 2 callersFunctiongenerate_hog
(input_root, save_root)
feature_extraction/visual/extract_openface.py:32
↓ 2 callersFunctionget_completion
(prompt, model, maxtry=5)
toolkit/utils/chatgpt.py:35
↓ 2 callersMethodget_featdim
(self)
toolkit/data/feat_data.py:83
↓ 2 callersMethodget_loaders
(self)
toolkit/dataloader/sims.py:25
↓ 2 callersMethodin_proj_q
(self, query, **kwargs)
toolkit/models/modules/transformers_encoder/multihead_attention.py:139
↓ 2 callersFunctionindex_wav
(wav_dir)
feature_extraction/wav_fusion.py:14
↓ 2 callersFunctionis_number
(s)
metric.py:28
↓ 2 callersMethodmatchnorm
(self, x1, x2)
toolkit/models/misa.py:83
↓ 2 callersMethodread_names_labels
(self, label_path, data_type, debug=False)
toolkit/dataloader/mer2023.py:100
↓ 2 callersMethodread_names_labels
(self, dataset, data_type, debug=False)
toolkit/dataloader/crossdim.py:58
↓ 2 callersFunctionvalidate
(val_loader, model, criterion, args)
feature_extraction/visual/manet/main.py:192
↓ 1 callersMethod__init__
(self, args)
toolkit/models/graph_mfn.py:100
↓ 1 callersMethod__init__
(self, args)
toolkit/models/tfn.py:13
↓ 1 callersMethod__init__
Args: in_size: input dimension hidden_size: hidden layer dimension dropout: dropout probability O
toolkit/models/modules/encoder.py:14
↓ 1 callersMethod__init__
(self, embed_dim, num_heads, layers, attn_dropout=0.0, relu_dropout=0.0, res_dropout=0.0, emb
toolkit/models/modules/transformers_encoder/transformer.py:24
↓ 1 callersMethod__init__
(self, block, n_blocks, channels, output_dim)
feature_extraction/visual/extract_imagenet_embedding.py:67
↓ 1 callersMethod__init__
(self, output_dim1=1, output_dim2=1, layers='256,128', dropout=0.3)
feature_extraction/llm4wav/extract_wavlm_vicuna.py:188
↓ 1 callersMethod__init__
(self, output_dim1=1, output_dim2=1, layers='256,128', dropout=0.3)
feature_extraction/llm4wav/extract_wavlm_vicuna_hd.py:188
↓ 1 callersMethod_forward_impl
(self, x, return_embedding=False)
feature_extraction/visual/manet/model/manet.py:220
↓ 1 callersMethod_get_batch_fmtstr
(self, num_batches)
feature_extraction/visual/manet/main.py:271
↓ 1 callersMethod_reset_specially
(self)
toolkit/models/dst_att.py:146
↓ 1 callersFunctionadd_position
add position information to the input x x: B, T, C position: T, C mask: B, T
toolkit/models/dst_att.py:38
↓ 1 callersFunctionarbitrary_segment_mask
Args: start_index: (b t), the first true value end_index: (b t), the last true value len_out: length of mask rev
toolkit/models/dst_att.py:54
↓ 1 callersFunctionaverage_fusion_wav
(fused_wav, base_wav, fusing_wavs)
feature_extraction/wav_fusion.py:22
↓ 1 callersFunctionbuffered_future_mask
(tensor, tensor2=None)
toolkit/models/modules/transformers_encoder/transformer.py:183
↓ 1 callersFunctioncal_adjusted_rms
(clean_rms, snr)
toolkit/utils/functions.py:357
↓ 1 callersFunctionconv1x1
1x1 convolution
feature_extraction/visual/manet/model/manet.py:10
↓ 1 callersFunctioncreate_PositionalEncoding
(input_dim, max_seq_len=2000)
toolkit/models/dst_att.py:12
↓ 1 callersFunctioncrop_one_sample
(pic_dir, store_name, store_dir)
feature_extraction/crop_lip.py:9
↓ 1 callersFunctionextract
(model_name, audio_files, save_dir, feature_level, layer_ids=None, gpu=None)
feature_extraction/audio/extract_transformers_embedding.py:29
↓ 1 callersFunctionextract
(data_loader, model)
feature_extraction/visual/extract_manet_embedding.py:82
↓ 1 callersFunctionextract
(data_loader, model)
feature_extraction/visual/extract_manet_embedding_mixup.py:82
↓ 1 callersFunctionextract
(data_loader, model)
feature_extraction/visual/extract_imagenet_embedding.py:125
↓ 1 callersFunctionextract
(data_loader, model)
feature_extraction/visual/extract_manet_embedding_yajiang.py:82
↓ 1 callersFunctionextract
(input_dir, process_type, save_dir, face_dir, hog_dir, pose_dir)
feature_extraction/visual/extract_openface.py:48
↓ 1 callersFunctionextract_embedding
(model_name, trans_dir, save_dir, feature_level, gpu=-1, punc_case=None, language='chinese', model_dir=None)
feature_extraction/llm4wav/extract_wavlm_vicuna.py:272
↓ 1 callersFunctionextract_embedding
(model_name, trans_dir, save_dir, feature_level, gpu=-1, punc_case=None, language='chinese', model_dir=None)
feature_extraction/llm4wav/extract_wavlm_vicuna_hd.py:284
↓ 1 callersFunctionextract_embedding
(model_name, trans_dir, save_dir, feature_level, gpu=-1, punc_case=None, language='chinese', model_dir=None)
feature_extraction/text/extract_text_embedding_huggingface.py:139
↓ 1 callersFunctionfill_with_neg_inf
FP16-compatible function that fills a tensor with -inf.
toolkit/models/modules/transformers_encoder/transformer.py:178
↓ 1 callersFunctionfind_batchpos_embdim
(tokenizer, model, gpu)
feature_extraction/text/extract_text_embedding_huggingface.py:118
next →1–100 of 495, ranked by callers