Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/HumanMLLM/ViSpeak
/ functions
Functions
1,447 in github.com/HumanMLLM/ViSpeak
⨍
Functions
1,447
◇
Types & classes
292
↓ 1 callers
Function
remove_space
(text)
audio_eval/cn_tn.py:1055
↓ 1 callers
Function
remove_symbols_and_diacritics
Replace any other markers, symbols, and punctuations with a space, and drop any diacritics (category 'Mn' and some manual mappings)
audio_eval/whisper_normalizer/basic.py:27
↓ 1 callers
Function
repeat
Repeat module N times. :param int N: repeat time :param function fn: function to generate module :return: repeated modules :rtype: Mu
vispeak/model/vita_tts/encoder/transformer.py:17
↓ 1 callers
Method
report_acc_by_groups
(self, df, group_column)
VLMEvalKit/vlmeval/dataset/image_mcq.py:390
↓ 1 callers
Function
rescale_img
(img, tgt=None)
VLMEvalKit/vlmeval/smp/vlm.py:15
↓ 1 callers
Method
robust_json_load
(s)
VLMEvalKit/vlmeval/dataset/mmbench_video.py:150
↓ 1 callers
Function
rough_filter
(answer_text)
VLMEvalKit/vlmeval/dataset/vcr.py:40
↓ 1 callers
Function
safe_save_model_for_hf_trainer
Collects the state dict and dump to disk.
vispeak/train/train.py:175
↓ 1 callers
Function
save_error_files
(error_files, output_file_path)
data_tools/mmco_collect.py:16
↓ 1 callers
Method
save_video_frames
(self, video, num_frames=8)
VLMEvalKit/vlmeval/dataset/videomme.py:180
↓ 1 callers
Method
save_video_frames
(self, imgs, video_name, frames)
VLMEvalKit/vlmeval/dataset/mvbench.py:532
↓ 1 callers
Method
score
(self)
OVO-Bench/utils/OVOBenchScore.py:71
↓ 1 callers
Method
set_max_num
(self, dataset)
VLMEvalKit/vlmeval/vlm/mmalaya.py:325
↓ 1 callers
Method
set_max_num
(self, dataset)
VLMEvalKit/vlmeval/vlm/vispeak/vispeak_qwen2.py:179
↓ 1 callers
Function
set_random_seed
(seed)
data_tools/check_video_lost_fast.py:18
↓ 1 callers
Function
set_random_seed
(seed)
vispeak/train/train.py:20
↓ 1 callers
Method
set_system_role
( self, extra_inputs: Optional[dict] = None, )
vispeak/model/vita_tts/audioLLM.py:212
↓ 1 callers
Function
setup
(app)
VLMEvalKit/docs/zh-CN/conf.py:241
↓ 1 callers
Function
sigmoid_focal_loss
Loss used in RetinaNet for dense detection: https://arxiv.org/abs/1708.02002. Args: inputs: A float tensor of arbitrary shape.
vispeak/model/language_model/vispeak_qwen2.py:23
↓ 1 callers
Method
slow_fast
(self, image_features, sf_masks)
vispeak/model/vispeak_arch.py:336
↓ 1 callers
Method
split_MUIR
(msgs)
VLMEvalKit/vlmeval/dataset/image_mcq.py:313
↓ 1 callers
Function
split_chessboard
x: b * c * h * w Deividing x into num_split**2 sub-squares, and concatenate all the sub-squares on the batch dimension
vispeak/util/s2wrapper/utils.py:11
↓ 1 callers
Function
split_file_into_four
(input_file)
data_tools/cut_txt.py:1
↓ 1 callers
Function
split_model
(model_name)
VLMEvalKit/vlmeval/vlm/mmalaya.py:161
↓ 1 callers
Function
split_model
(model_name)
VLMEvalKit/vlmeval/vlm/internvl_chat.py:100
↓ 1 callers
Method
split_subtitle
(self, data)
VLMEvalKit/vlmeval/vlm/video_llm/videochat2.py:364
↓ 1 callers
Function
split_to_even_chunks
Split a list of indices into `chunks` chunks of roughly equal lengths.
vispeak/train/vispeak_trainer.py:40
↓ 1 callers
Function
string2symbols
(chinese_string, system)
audio_eval/cn_tn.py:581
↓ 1 callers
Function
timestr
(second=True, minute=False)
VLMEvalKit/vlmeval/smp/misc.py:129
↓ 1 callers
Function
train
()
vispeak/train/train.py:214
↓ 1 callers
Function
tsv_unescape
Unescape strings in the TSV file. Escaped characters include: newline (0x10) -> backslash + n vertical bar (0x7C) -> backslash + p
VLMEvalKit/vlmeval/dataset/utils/tablevqabench.py:476
↓ 1 callers
Function
unwrap_hf_pkl
(pth, suffix='.mp4')
VLMEvalKit/vlmeval/dataset/mmbench_video.py:11
↓ 1 callers
Function
update_video_path_to_absolute
(json_file)
StreamingBench/src/data/modify_video_path.py:5
↓ 1 callers
Method
use_cot
(self, dataset=None)
VLMEvalKit/vlmeval/vlm/minicpm_v.py:298
↓ 1 callers
Method
use_custom_prompt
(self, dataset)
VLMEvalKit/vlmeval/vlm/mmalaya.py:254
↓ 1 callers
Method
use_custom_prompt
(self, dataset)
VLMEvalKit/vlmeval/vlm/transcore_m.py:83
↓ 1 callers
Method
use_custom_prompt
(self, dataset)
VLMEvalKit/vlmeval/vlm/internvl_chat.py:179
↓ 1 callers
Method
use_custom_prompt
(self, dataset)
VLMEvalKit/vlmeval/vlm/omnilmm.py:146
↓ 1 callers
Method
use_custom_prompt
(self, dataset)
VLMEvalKit/vlmeval/vlm/parrot.py:61
↓ 1 callers
Method
use_custom_prompt
(self, dataset)
VLMEvalKit/vlmeval/vlm/minicpm_v.py:30
↓ 1 callers
Method
use_custom_prompt
(self, dataset)
VLMEvalKit/vlmeval/vlm/omchat.py:44
↓ 1 callers
Method
use_custom_prompt
(self, dataset)
VLMEvalKit/vlmeval/vlm/rbdash.py:194
↓ 1 callers
Method
use_custom_prompt
(self, dataset)
VLMEvalKit/vlmeval/vlm/mplug_owl3.py:37
↓ 1 callers
Method
use_custom_prompt
(self, dataset)
VLMEvalKit/vlmeval/vlm/wemm.py:17
↓ 1 callers
Method
use_custom_prompt
(self, dataset)
VLMEvalKit/vlmeval/vlm/mantis.py:92
↓ 1 callers
Method
use_custom_prompt
(self, dataset)
VLMEvalKit/vlmeval/vlm/cogvlm.py:73
↓ 1 callers
Method
use_custom_prompt
(self, dataset)
VLMEvalKit/vlmeval/vlm/mplug_owl2.py:41
↓ 1 callers
Method
use_custom_prompt
(self, dataset)
VLMEvalKit/vlmeval/vlm/xcomposer/xcomposer.py:115
↓ 1 callers
Method
use_custom_prompt
(self, dataset)
VLMEvalKit/vlmeval/vlm/xcomposer/xcomposer2_4KHD.py:183
↓ 1 callers
Method
use_custom_prompt
(self, dataset)
VLMEvalKit/vlmeval/vlm/xcomposer/sharecaptioner.py:22
↓ 1 callers
Method
use_custom_prompt
(self, dataset)
VLMEvalKit/vlmeval/vlm/xcomposer/xcomposer2.py:162
↓ 1 callers
Method
use_custom_prompt
(self, dataset)
VLMEvalKit/vlmeval/vlm/xcomposer/xcomposer2d5.py:225
↓ 1 callers
Method
use_custom_prompt
(self, dataset)
VLMEvalKit/vlmeval/vlm/vispeak/vispeak_qwen2.py:91
↓ 1 callers
Method
use_custom_prompt
(self, dataset)
VLMEvalKit/vlmeval/vlm/llava/llava.py:69
↓ 1 callers
Method
use_custom_prompt
(self, dataset)
VLMEvalKit/vlmeval/vlm/llava/llava.py:261
↓ 1 callers
Method
use_custom_prompt
(self, dataset)
VLMEvalKit/vlmeval/vlm/llava/llava_xtuner.py:156
↓ 1 callers
Method
use_custom_prompt
(self, dataset)
VLMEvalKit/vlmeval/api/sensechat_vision.py:83
↓ 1 callers
Method
use_upsize
(self, dataset=None)
VLMEvalKit/vlmeval/vlm/minicpm_v.py:309
↓ 1 callers
Function
wrap_question_for_omni_lmm
(question, image_token_len, tokenizer)
VLMEvalKit/vlmeval/vlm/omnilmm.py:73
Function
LLaVABench_atomeval
(model, prompt)
VLMEvalKit/vlmeval/dataset/utils/llavabench.py:49
Function
MATH_V_auxeval
(model, line)
VLMEvalKit/vlmeval/dataset/utils/mathv.py:123
Function
MMVet_auxeval
(model, line)
VLMEvalKit/vlmeval/dataset/utils/mmvet.py:45
Function
MathVista_auxeval
(model, line)
VLMEvalKit/vlmeval/dataset/utils/mathvista.py:104
Function
OCRBench_eval
(eval_file)
VLMEvalKit/vlmeval/dataset/utils/ocrbench.py:4
Method
Run
Given the file and input prompt, run the model and return the response file: Video file path inp: Input prompt
StreamingBench/src/model/modelclass.py:8
Function
YOrN_auxeval
(model, line)
VLMEvalKit/vlmeval/dataset/utils/yorn.py:195
Method
__call__
(self, item)
vispeak/model/multimodal_encoder/eva_clip/eva_clip_processors.py:18
Method
__call__
(self, item)
vispeak/model/multimodal_encoder/eva_clip/eva_clip_processors.py:64
Method
__call__
(self, instances: Sequence[Dict])
vispeak/util/data_utils.py:1005
Method
__call__
(self, output_ids: torch.LongTensor, scores: torch.FloatTensor, **kwargs)
vispeak/util/mm_utils.py:158
Method
__call__
(self, text)
audio_eval/cn_tn.py:1090
Method
__call__
(self, s: str)
audio_eval/whisper_normalizer/english.py:442
Method
__call__
(self, s: str)
audio_eval/whisper_normalizer/english.py:461
Method
__call__
(self, s: str)
audio_eval/whisper_normalizer/english.py:526
Method
__call__
(self, s: str)
audio_eval/whisper_normalizer/basic.py:63
Method
__call__
(self, inputs)
VLMEvalKit/vlmeval/utils/mp_util.py:19
Method
__call__
(self, img_group)
VLMEvalKit/vlmeval/dataset/utils/mvbench.py:57
Method
__call__
(self, img_group)
VLMEvalKit/vlmeval/dataset/utils/mvbench.py:85
Method
__call__
(self, img_group)
VLMEvalKit/vlmeval/dataset/utils/mvbench.py:110
Method
__call__
(self, img_group, is_flow=False)
VLMEvalKit/vlmeval/dataset/utils/mvbench.py:121
Method
__call__
(self, tensor)
VLMEvalKit/vlmeval/dataset/utils/mvbench.py:139
Method
__call__
(self, img_group)
VLMEvalKit/vlmeval/dataset/utils/mvbench.py:162
Method
__call__
(self, img_group)
VLMEvalKit/vlmeval/dataset/utils/mvbench.py:177
Method
__call__
(self, img_group)
VLMEvalKit/vlmeval/dataset/utils/mvbench.py:218
Method
__call__
(self, img_group)
VLMEvalKit/vlmeval/dataset/utils/mvbench.py:266
Method
__call__
(self, img_group)
VLMEvalKit/vlmeval/dataset/utils/mvbench.py:353
Method
__call__
(self, images)
VLMEvalKit/vlmeval/dataset/utils/mvbench.py:395
Method
__call__
(self, img_group)
VLMEvalKit/vlmeval/dataset/utils/mvbench.py:410
Method
__call__
(self, pic)
VLMEvalKit/vlmeval/dataset/utils/mvbench.py:431
Method
__call__
(self, data)
VLMEvalKit/vlmeval/dataset/utils/mvbench.py:449
Method
__call__
(self, input_ids: torch.LongTensor, scores: torch.FloatTensor)
VLMEvalKit/vlmeval/vlm/xcomposer/xcomposer.py:15
Method
__call__
(self, input_ids: torch.LongTensor, scores: torch.FloatTensor)
VLMEvalKit/vlmeval/vlm/video_llm/videochat2.py:52
Method
__eq__
(self, other)
VLMEvalKit/vlmeval/dataset/utils/tablevqabench.py:267
Method
__eq__
(self, other)
VLMEvalKit/vlmeval/dataset/utils/tablevqabench.py:301
Method
__eq__
(self, other)
VLMEvalKit/vlmeval/dataset/utils/tablevqabench.py:363
Method
__getattr__
(self, attr)
vispeak/util/utils.py:79
Method
__getitem__
(self, i)
vispeak/util/data_utils.py:757
Method
__getitem__
(self, idx)
audio_eval/eval_asr.py:86
Method
__getitem__
(self, idx)
VLMEvalKit/vlmeval/dataset/video_base.py:38
Method
__getitem__
(self, idx)
VLMEvalKit/vlmeval/dataset/image_base.py:74
← previous
next →
601–700 of 1,447, ranked by callers