MCPcopy Create free account

hub / github.com/FunAudioLLM/Fun-Audio-Chat / functions

Functions257 in github.com/FunAudioLLM/Fun-Audio-Chat

↓ 127 callersFunctionlog
(level, message)
web_demo/server/server.py:53
↓ 21 callersMethodput
Receiving generated tokens
web_demo/server/funaudiochat_infer.py:47
↓ 20 callersMethoddecode
This method forwards all its arguments to FunAudioChatTokenizerFast's [`~PreTrainedTokenizer.decode`]. Please refer to the docstring
funaudiochat/processing_funaudiochat.py:303
↓ 6 callersMethod__init__
(self, config: FunAudioChatAudioEncoderConfig)
funaudiochat/modeling_funaudiochat.py:576
↓ 6 callersFunctionabort
(what)
web_demo/client/public/assets/decoderWorker.min.js:594
↓ 6 callersFunctiongetMimeType
(type: "audio" | "video")
web_demo/client/src/pages/Conversation/getMimeType.ts:55
↓ 6 callersFunctionstandardize_string
This function standardizes the string by removing all the spaces, ",./-_*^" punctuation, and converting it to lowercase It will also convert
evaluate/SpeechFCEval/utils/compute_metrics_bfcl.py:189
↓ 6 callersFunctionstandardize_string
(input_string: str)
evaluate/SpeechFCEval/utils/compute_metrics_acebench.py:74
↓ 6 callersFunctionuseSocketContext
()
web_demo/client/src/pages/Conversation/SocketContext.ts:16
↓ 5 callersFunctionasMs
* 音频队列播放器 - 优化网络抖动处理 * * 设计思路: * 1. 所有收到的音频帧按顺序入队 * 2. 使用较大的初始缓冲区减少网络抖动影响 * 3. 不丢弃任何音频帧,确保完整播放 * 4. Buffer underrun 时快速恢复
web_demo/client/src/audio-processor.ts:12
↓ 5 callersMethodget_input_embeddings
(self)
funaudiochat/modeling_funaudiochat.py:808
↓ 5 callersMethodtimestamp
()
web_demo/client/src/audio-processor.ts:110
↓ 4 callersFunctioncompute_metrics_bfcl_v1
(model_name, dataset_name, test_category, base_folder)
evaluate/SpeechFCEval/utils/compute_metrics_bfcl.py:908
↓ 4 callersFunctiondecodeMessage
(data: Uint8Array)
web_demo/client/src/protocol/encoder.ts:37
↓ 4 callersFunctiongetFloatFromStorage
(val: string | null)
web_demo/client/src/pages/Queue/Queue.tsx:11
↓ 4 callersFunctiongetIntFromStorage
(val: string | null)
web_demo/client/src/pages/Queue/Queue.tsx:15
↓ 4 callersFunctionregister_funaudiochat
Register FunAudioChat classes with AutoConfig and AutoModel.
funaudiochat/register.py:15
↓ 4 callersFunctionsimple_function_checker
( func_description: dict, model_output: dict, possible_answer: dict, language: str, model_
evaluate/SpeechFCEval/utils/compute_metrics_bfcl.py:350
↓ 3 callersFunctionasSamples
(mili)
web_demo/client/src/audio-processor.ts:16
↓ 3 callersFunctioncallRuntimeCallbacks
(callbacks)
web_demo/client/public/assets/decoderWorker.min.js:727
↓ 3 callersFunctiondict_checker
(param: str, model_output: dict, possible_answers: list, func_name)
evaluate/SpeechFCEval/utils/compute_metrics_acebench.py:244
↓ 3 callersFunctionfind_description
(func_descriptions, name)
evaluate/SpeechFCEval/utils/compute_metrics_bfcl.py:72
↓ 3 callersFunctiongetExtension
(type: "audio" | "video")
web_demo/client/src/pages/Conversation/getMimeType.ts:62
↓ 3 callersFunctionget_audio_detokenizer
(token_hop_len=25 * 30)
utils/cosyvoice_detokenizer.py:86
↓ 3 callersMethodget_step_results
(self)
web_demo/server/funaudiochat_infer.py:134
↓ 3 callersFunctionr
(s)
web_demo/client/public/assets/decoderWorker.min.js:13
↓ 3 callersFunctionresolve_ast_call
(elem)
evaluate/SpeechFCEval/utils/compute_metrics_bfcl.py:715
↓ 2 callersFunctionUTF8ArrayToString
(heap, idx, maxBytesToRead)
web_demo/client/public/assets/decoderWorker.min.js:473
↓ 2 callersMethod_get_feat_extract_output_lengths
Computes the output length of the convolutional layers and the output length of the audio encoder
funaudiochat/modeling_funaudiochat.py:493
↓ 2 callersMethod_regularize_audios
r"""Regularizes audios to avoid error. Including reading and resampling.
funaudiochat/processing_funaudiochat.py:111
↓ 2 callersFunctionclamp
(value: number, min: number, max: number)
web_demo/client/src/pages/Conversation/hooks/audioUtils.ts:1
↓ 2 callersFunctioncompute_metrics_acebench_v1
(model_name, dataset_name, test_category, base_folder)
evaluate/SpeechFCEval/utils/compute_metrics_acebench.py:701
↓ 2 callersFunctionconvertMinSecs
(total_secs: number)
web_demo/client/src/pages/Conversation/components/ServerAudio/ServerAudioStats.tsx:23
↓ 2 callersFunctiondict_checker
(param: str, model_output: dict, possible_answers: list)
evaluate/SpeechFCEval/utils/compute_metrics_bfcl.py:253
↓ 2 callersFunctiondoRun
()
web_demo/client/public/assets/decoderWorker.min.js:873
↓ 2 callersFunctiongetBinary
(file)
web_demo/client/public/assets/decoderWorker.min.js:620
↓ 2 callersMethodget_accumulated_results
(self)
web_demo/server/funaudiochat_infer.py:142
↓ 2 callersMethodget_embeddings
(self, audio_tokens)
funaudiochat/modeling_funaudiochat.py:594
↓ 2 callersFunctionget_possible_answer_type
(possible_answer: list)
evaluate/SpeechFCEval/utils/compute_metrics_bfcl.py:83
↓ 2 callersFunctionget_possible_answer_type
(possible_answer)
evaluate/SpeechFCEval/utils/compute_metrics_acebench.py:68
↓ 2 callersMethodinitState
()
web_demo/client/src/audio-processor.ts:81
↓ 2 callersFunctioninstantiateArrayBuffer
(receiver)
web_demo/client/public/assets/decoderWorker.min.js:680
↓ 2 callersFunctionisDataURI
(filename)
web_demo/client/public/assets/decoderWorker.min.js:609
↓ 2 callersFunctionisFileURI
(filename)
web_demo/client/public/assets/decoderWorker.min.js:612
↓ 2 callersFunctionregister_all
Register all FunAudioChat plugins with LLaMA-Factory. This is the main entry point for registration.
training/plugin/registration.py:144
↓ 2 callersFunctionrun
(args)
web_demo/client/public/assets/decoderWorker.min.js:864
↓ 2 callersFunctionsum_key_list
(data)
evaluate/SpeechFCEval/utils/compute_metrics_acebench.py:50
↓ 2 callersFunctiontoken2wav
(cosyvoice3_model, tokens, embedding=None, token_hop_len=25 * 30, pre_lookahead_len=3)
utils/cosyvoice_detokenizer.py:34
↓ 2 callersFunctionuseMediaContext
()
web_demo/client/src/pages/Conversation/MediaContext.ts:14
↓ 2 callersFunctionuseModelParams
(params?: useModelParamsArgs)
web_demo/client/src/pages/Conversation/hooks/useModelParams.ts:30
↓ 1 callersFunctionUTF8ToString
(ptr, maxBytesToRead)
web_demo/client/public/assets/decoderWorker.min.js:508
↓ 1 callersMethod__init__
( self, audio_config=None, text_config=None, audio_token_index=151646,
funaudiochat/configuration_funaudiochat.py:207
↓ 1 callersMethod_get_mm_inputs
Process multimodal inputs including audio.
training/plugin/mm_plugins.py:101
↓ 1 callersMethod_prepare_attention_mask
(self, inputs_tensor: torch.Tensor, cu_seqlens: torch.Tensor)
funaudiochat/modeling_funaudiochat.py:290
↓ 1 callersFunctionabortOnCannotGrowMemory
(requestedSize)
web_demo/client/public/assets/decoderWorker.min.js:752
↓ 1 callersFunctionaddOnInit
(cb)
web_demo/client/public/assets/decoderWorker.min.js:560
↓ 1 callersFunctionaddOnPostRun
(cb)
web_demo/client/public/assets/decoderWorker.min.js:563
↓ 1 callersFunctionaddOnPreRun
(cb)
web_demo/client/public/assets/decoderWorker.min.js:557
↓ 1 callersFunctionaddRunDependency
(id)
web_demo/client/public/assets/decoderWorker.min.js:569
↓ 1 callersFunctionadd_filter_to_llamafactory
Add filter to llamafactory loggers after they are created.
training/plugin/sitecustomize.py:40
↓ 1 callersFunctionassert
(condition, text)
web_demo/client/public/assets/decoderWorker.min.js:466
↓ 1 callersFunctionast_checker
( func_description, model_output, possible_answer, language, test_category: str, model
evaluate/SpeechFCEval/utils/compute_metrics_bfcl.py:638
↓ 1 callersFunctionbuildURL
({ workerAddr, params, workerAuthId, email, textSeed, audioSeed, }: { workerAddr: string; para
web_demo/client/src/pages/Conversation/Conversation.tsx:36
↓ 1 callersFunctionclamp_color
(v: number)
web_demo/client/src/pages/Conversation/components/TextDisplay/TextDisplay.tsx:16
↓ 1 callersFunctioncompute_metrics_acebench_example
()
evaluate/SpeechFCEval/utils/compute_metrics_acebench.py:828
↓ 1 callersFunctioncompute_metrics_example
()
evaluate/SpeechFCEval/compute_metrics_speech_fc.py:18
↓ 1 callersFunctioncompute_metrics_example
()
evaluate/SpeechFCEval/utils/compute_metrics_bfcl.py:1014
↓ 1 callersFunctionconvert_func_name
(function_name)
evaluate/SpeechFCEval/utils/compute_metrics_bfcl.py:100
↓ 1 callersFunctioncreateWasm
()
web_demo/client/public/assets/decoderWorker.min.js:665
↓ 1 callersFunctiondecode_message
(data: bytes)
web_demo/server/protocal.py:40
↓ 1 callersFunctionencodeMessage
(message: WSMessage)
web_demo/client/src/protocol/encoder.ts:9
↓ 1 callersFunctionencode_handshake
(version: int = 0, model: int = 0)
web_demo/server/protocal.py:36
↓ 1 callersMethodend
(self)
web_demo/server/funaudiochat_infer.py:119
↓ 1 callersFunctionextract_speech_token
(ort_session, wav_path, pool_executor=None)
utils/cosyvoice_tokenizer.py:21
↓ 1 callersFunctionfind_description
(func_descriptions, name)
evaluate/SpeechFCEval/utils/compute_metrics_acebench.py:58
↓ 1 callersFunctionflatten_dates
(d)
evaluate/SpeechFCEval/utils/compute_metrics_acebench.py:80
↓ 1 callersMethodgetAudioFromQueue
(requestedSamples)
web_demo/client/src/audio-processor.ts:125
↓ 1 callersFunctiongetAudioMimeType
()
web_demo/client/src/pages/Conversation/getMimeType.ts:38
↓ 1 callersFunctiongetBinaryPromise
()
web_demo/client/public/assets/decoderWorker.min.js:634
↓ 1 callersFunctiongetVideoMimeType
()
web_demo/client/src/pages/Conversation/getMimeType.ts:24
↓ 1 callersMethodget_audio_features
Encodes audios into continuous embeddings that can be forwarded to the language model. Args: input_features (`torch.Floa
funaudiochat/modeling_funaudiochat.py:839
↓ 1 callersFunctionget_audio_tokenizer
(onnx_path = "pretrained_models/Fun-CosyVoice3-0.5B-2512/speech_tokenizer_v3.onnx", device_id=0)
utils/cosyvoice_tokenizer.py:89
↓ 1 callersMethodget_input_embeddings
(self)
funaudiochat/modeling_funaudiochat.py:284
↓ 1 callersFunctioninfer_example
推理示例函数 Args: model_path: 模型路径 audio_path: 输入音频路径
examples/infer_s2s.py:37
↓ 1 callersFunctioninfer_example
推理示例函数(仅生成文本,不生成语音) Args: model_path: 模型路径 audio_path: 输入音频路径 instruction: 输入音频指令,可选
examples/infer_s2t.py:32
↓ 1 callersFunctioninitRuntime
()
web_demo/client/public/assets/decoderWorker.min.js:543
↓ 1 callersMethodinitialize
(self, model_path: str, target_sample_rate: int = 16000)
web_demo/server/server.py:162
↓ 1 callersFunctioninstantiateAsync
()
web_demo/client/public/assets/decoderWorker.min.js:693
↓ 1 callersFunctionis_function_call_format_valid
(decoded_output)
evaluate/SpeechFCEval/utils/compute_metrics_bfcl.py:803
↓ 1 callersFunctionis_function_call_format_valid
(decoded_output)
evaluate/SpeechFCEval/utils/compute_metrics_acebench.py:596
↓ 1 callersFunctionkeepRuntimeAlive
()
web_demo/client/public/assets/decoderWorker.min.js:530
↓ 1 callersFunctionlist_checker
(param: str, model_output: list, possible_answer: list)
evaluate/SpeechFCEval/utils/compute_metrics_bfcl.py:219
↓ 1 callersFunctionlist_checker
(param: str, model_output: list, possible_answer: list, func_name)
evaluate/SpeechFCEval/utils/compute_metrics_acebench.py:212
↓ 1 callersFunctionlist_dict_checker
(param: str, model_output: list, possible_answers: list)
evaluate/SpeechFCEval/utils/compute_metrics_bfcl.py:316
↓ 1 callersFunctionlist_dict_checker
(param: str, model_output: list, possible_answers: list, func_name)
evaluate/SpeechFCEval/utils/compute_metrics_acebench.py:312
↓ 1 callersMethodload_audio_batch
Loads a batch of audio files. Args: paths: List of audio file paths sampling_rate: Target sampling r
training/plugin/mm_plugins.py:84
↓ 1 callersFunctionload_audio_batch_default
Default audio loader using librosa. Args: paths: List of audio file paths sampling_rate: Target sampling rate
training/plugin/mm_plugins.py:45
↓ 1 callersFunctionlocateFile
(path)
web_demo/client/public/assets/decoderWorker.min.js:327
↓ 1 callersFunctionlogExceptionOnExit
(e)
web_demo/client/public/assets/decoderWorker.min.js:334
↓ 1 callersFunctionmain
()
training/process/data_process.py:81
next →1–100 of 257, ranked by callers