MCPcopy Create free account

hub / github.com/TaoRuijie/TalkNet-ASD / functions

Functions104 in github.com/TaoRuijie/TalkNet-ASD

↓ 6 callersMethod__init__
(self)
model/visualEncoder.py:63
↓ 5 callersMethodforward
(self, x, labels)
loss.py:32
↓ 4 callersMethod_make_layer
(self, block, planes, blocks, stride=1)
model/audioEncoder.py:78
↓ 4 callersFunctioneq
Returns true if values are approximately equal.
utils/get_ava_active_speaker_performance.py:89
↓ 4 callersFunctionget_length
(input_video)
TalkSet/generate_TalkSet.py:8
↓ 4 callersFunctionread_Vox_lines
(file)
TalkSet/generate_TalkSet.py:12
↓ 3 callersMethodforward_audio_frontend
(self, x)
model/talkNetModel.py:41
↓ 3 callersMethodforward_audio_visual_backend
(self, x1, x2)
model/talkNetModel.py:51
↓ 3 callersMethodforward_cross_attention
(self, x1, x2)
model/talkNetModel.py:46
↓ 3 callersMethodforward_visual_frontend
(self, x)
model/talkNetModel.py:29
↓ 3 callersMethodloadParameters
(self, path)
talkNet.py:81
↓ 2 callersMethod__init__
(self)
loss.py:27
↓ 2 callersMethod__init__
(self, channel, reduction=8)
model/audioEncoder.py:38
↓ 2 callersFunctionbb_intersection_over_union
(boxA, boxB, evalCol = False)
demoTalkNet.py:114
↓ 2 callersMethodevaluate_network
(self, loader, evalCsvSave, evalOrig, **kwargs)
talkNet.py:51
↓ 2 callersMethodforward
(self, x)
model/faceDetector/s3fd/nets.py:21
↓ 2 callersFunctiongenerate_audio_set
(dataPath, batchList)
dataLoader.py:5
↓ 2 callersFunctionload_audio
(data, dataPath, numFrames, audioAug, audioSet = None)
dataLoader.py:30
↓ 2 callersFunctionload_csv
Loads CSV from the filename using given column names. Adds uid column. Args: filename: Path to the CSV file to load. column_names: A l
utils/get_ava_active_speaker_performance.py:70
↓ 2 callersFunctionload_label
(data, numFrames)
dataLoader.py:80
↓ 2 callersFunctionload_visual
(data, dataPath, numFrames, visualAug)
dataLoader.py:49
↓ 1 callersMethod__init__
(self, num_classes=2, top_k=750, nms_thresh=0.3, conf_thresh=0.05, var
model/faceDetector/s3fd/box_utils.py:131
↓ 1 callersMethod__init__
(self, n_channels, scale)
model/faceDetector/s3fd/nets.py:10
↓ 1 callersMethod__len__
(self)
dataLoader.py:142
↓ 1 callersFunctioncalculate_precision_recall
Calculates precision and recall arrays going through df_merged row-wise.
utils/get_ava_active_speaker_performance.py:151
↓ 1 callersFunctioncompute_average_precision
Compute Average Precision according to the definition in VOCdevkit. Precision is modified to ensure that it does not decrease as recall decrease
utils/get_ava_active_speaker_performance.py:23
↓ 1 callersFunctioncrop_video
(args, track, cropFile)
demoTalkNet.py:163
↓ 1 callersFunctiondecode
Decode locations from predictions using priors to undo the encoding we did for offset regression at train time. Args: loc (tensor): lo
model/faceDetector/s3fd/box_utils.py:41
↓ 1 callersMethoddetect_faces
(self, image, conf_th=0.8, scales=[1])
model/faceDetector/s3fd/__init__.py:32
↓ 1 callersFunctiondownload_csv
(args)
utils/tools.py:74
↓ 1 callersFunctiondownload_pretrain_model_AVA
()
utils/tools.py:29
↓ 1 callersFunctiondownload_videos
(args)
utils/tools.py:83
↓ 1 callersFunctionevaluate_col_ASD
(tracks, scores, args)
demoTalkNet.py:285
↓ 1 callersFunctionevaluate_network
(files, args)
demoTalkNet.py:207
↓ 1 callersFunctionextract_audio
(args)
utils/tools.py:92
↓ 1 callersFunctionextract_audio_clips
(args)
utils/tools.py:105
↓ 1 callersFunctionextract_video_clips
(args)
utils/tools.py:141
↓ 1 callersMethodforward_audio_backend
(self,x)
model/talkNetModel.py:57
↓ 1 callersMethodforward_visual_backend
(self,x)
model/talkNetModel.py:61
↓ 1 callersFunctionget_all_positives
Counts all positive examples in the groundtruth dataset.
utils/get_ava_active_speaker_performance.py:145
↓ 1 callersFunctioninference_video
(args)
demoTalkNet.py:95
↓ 1 callersFunctioninit_args
(args)
utils/tools.py:4
↓ 1 callersFunctionmain
()
demoTalkNet.py:353
↓ 1 callersFunctionmain
()
trainTalkNet.py:7
↓ 1 callersFunctionmain
()
utils/get_ava_active_speaker_performance.py:225
↓ 1 callersFunctionmerge_groundtruth_and_predictions
Merges groundtruth and prediction DataFrames. The returned DataFrame is merged on uid field and sorted in descending order by score field. Bound
utils/get_ava_active_speaker_performance.py:94
↓ 1 callersFunctionnms
Apply non-maximum suppression at test time to avoid detecting too many overlapping bounding boxes for a given object. Args: boxes: (te
model/faceDetector/s3fd/box_utils.py:62
↓ 1 callersFunctionnms_
Courtesy of Ross Girshick [https://github.com/rbgirshick/py-faster-rcnn/blob/master/lib/nms/py_cpu_nms.py]
model/faceDetector/s3fd/box_utils.py:7
↓ 1 callersFunctionoverlap
(dataName, audio, audioSet)
dataLoader.py:15
↓ 1 callersFunctionparse_arguments
Parses command-line flags. Returns: args: a named tuple containing three file objects args.labelmap, args.groundtruth, and args.detection
utils/get_ava_active_speaker_performance.py:201
↓ 1 callersFunctionpreprocess_AVA
(args)
utils/tools.py:35
↓ 1 callersFunctionread_LRS3_S
(file)
TalkSet/generate_TalkSet.py:35
↓ 1 callersFunctionread_LRS3_ST
(file)
TalkSet/generate_TalkSet.py:25
↓ 1 callersMethodreset_parameters
(self)
model/visualEncoder.py:90
↓ 1 callersMethodreset_parameters
(self)
model/faceDetector/s3fd/nets.py:18
↓ 1 callersFunctionrun_evaluation
Runs AVA Active Speaker evaluation, printing average precision result.
utils/get_ava_active_speaker_performance.py:180
↓ 1 callersMethodsaveParameters
(self, path)
talkNet.py:78
↓ 1 callersFunctionscene_detect
(args)
demoTalkNet.py:76
↓ 1 callersFunctiontrack_shot
(args, sceneFaces)
demoTalkNet.py:129
↓ 1 callersMethodtrain_network
(self, loader, epoch, **kwargs)
talkNet.py:21
↓ 1 callersFunctionvisualization
(tracks, scores, args)
demoTalkNet.py:255
Method__getitem__
(self, index)
dataLoader.py:106
Method__getitem__
(self, index)
dataLoader.py:130
Method__init__
(self)
loss.py:6
Method__init__
(self)
loss.py:39
Method__init__
(self, trialFileName, audioPath, visualPath, batchSize, **kwargs)
dataLoader.py:90
Method__init__
(self, trialFileName, audioPath, visualPath, **kwargs)
dataLoader.py:125
Method__init__
(self, lr = 0.0001, lrDecay = 0.95, **kwargs)
talkNet.py:11
Method__init__
(self)
model/talkNetModel.py:9
Method__init__
(self, d_model, nhead, dropout=0.1)
model/attentionLayer.py:8
Method__init__
(self, inplanes, outplanes, stride)
model/visualEncoder.py:21
Method__init__
(self, channel_size)
model/visualEncoder.py:84
Method__init__
(self)
model/visualEncoder.py:107
Method__init__
(self)
model/visualEncoder.py:133
Method__init__
(self)
model/visualEncoder.py:149
Method__init__
(self)
model/visualEncoder.py:161
Method__init__
(self, inplanes, planes, stride=1, downsample=None, reduction=8)
model/audioEncoder.py:8
Method__init__
(self, layers, num_filters, **kwargs)
model/audioEncoder.py:55
Method__init__
(self, device='cuda')
model/faceDetector/s3fd/__init__.py:19
Method__init__
(self, input_size, feature_maps, variance=[0.1, 0.2], min_sizes=[16, 3
model/faceDetector/s3fd/box_utils.py:178
Method__init__
(self, device='cuda')
model/faceDetector/s3fd/nets.py:30
Method__len__
(self)
dataLoader.py:120
Functionextract_MFCC
(file, outPath)
demoTalkNet.py:200
Methodforward
(self, x, labels=None)
loss.py:11
Methodforward
(self, x, labels)
loss.py:45
Methodforward
(self, src, tar)
model/attentionLayer.py:23
Methodforward
(self, inputBatch)
model/visualEncoder.py:37
Methodforward
(self, inputBatch)
model/visualEncoder.py:74
Methodforward
(self, y)
model/visualEncoder.py:94
Methodforward
(self, inputBatch)
model/visualEncoder.py:119
Methodforward
(self, x)
model/visualEncoder.py:144
Methodforward
(self, x)
model/visualEncoder.py:156
Methodforward
(self, x)
model/visualEncoder.py:170
Methodforward
(self, x)
model/audioEncoder.py:19
Methodforward
(self, x)
model/audioEncoder.py:48
Methodforward
(self, x)
model/audioEncoder.py:95
Methodforward
(self, loc_data, conf_data, prior_data)
model/faceDetector/s3fd/box_utils.py:142
Methodforward
(self)
model/faceDetector/s3fd/box_utils.py:195
Methodforward
(self, x)
model/faceDetector/s3fd/nets.py:109
Functiongenerate_FAudio
(line, args)
TalkSet/generate_TalkSet.py:83
next →1–100 of 104, ranked by callers