MCPcopy Create free account

hub / github.com/anliyuan/Ultralight-Digital-Human / functions

Functions297 in github.com/anliyuan/Ultralight-Digital-Human

Method__init__
(self, d_model: int, dropout_rate: float)
data_utils/wenet/transformer/embedding.py:119
Method__init__
Construct an EncoderLayer object.
data_utils/wenet/transformer/encoder_layer.py:34
Method__len__
(self)
datasetsss.py:50
Method__repr__
(self)
data_utils/wenet/utils/scheduler.py:39
Function_key
(name: str)
data_utils/process.py:79
Methodadvance_decoding
(self)
data_utils/wenet_infer.py:205
Methodattention_decoding
(self, audio)
data_utils/wenet_infer.py:399
Methodattention_rescoring
Apply attention rescoring decoding, CTC prefix beam search is applied first to get nbest, then we resoring the nbest on atten
data_utils/wenet/transformer/asr_model_streaming.py:470
Functioncheck_onnx
(torch_out, torch_in)
data_utils/pfld_mobileone.py:306
Methodctc_activation
Export interface for c++ call, apply linear transform and log softmax before ctc Args: xs (torch.Tensor): encoder out
data_utils/wenet/transformer/asr_model.py:605
Methodctc_activation
Export interface for c++ call, apply linear transform and log softmax before ctc Args: xs (torch.Tensor): encoder out
data_utils/wenet/transformer/asr_model_streaming.py:628
Methodctc_greedy_search
(self, audio)
data_utils/wenet_infer.py:427
Methodctc_greedy_search
Apply CTC greedy search Args: speech (torch.Tensor): (batch, max_len, feat_dim) speech_length (torch.Tensor): (batch
data_utils/wenet/transformer/asr_model_streaming.py:308
Methodctc_prefix_beam_search
Apply CTC prefix beam search Args: speech (torch.Tensor): (batch, max_len, feat_dim) speech_length (torch.Tensor): (
data_utils/wenet/transformer/asr_model_streaming.py:438
Methodctc_rescoring_decoding
(self, audio)
data_utils/wenet_infer.py:375
Functiondecode_chunk
(model, encoder_out, encoder_mask, beam_size, cache, device, hyps, scores, end_flag)
data_utils/wenet/bin/recognize_wav_streaming.py:149
Methoddetect
(self, srcimg)
data_utils/detect_face.py:57
Methodeos_symbol
Export interface for c++ call, return eos symbol id of the model
data_utils/wenet/transformer/asr_model.py:565
Methodeos_symbol
Export interface for c++ call, return eos symbol id of the model
data_utils/wenet/transformer/asr_model_streaming.py:588
Methodfinalize_rescoring
(self)
data_utils/wenet_infer.py:291
Methodforward
(self, x)
unet.py:46
Methodforward
(self, x)
unet.py:61
Methodforward
(self, x)
unet.py:71
Methodforward
(self, x)
unet.py:80
Methodforward
(self, x1: torch.Tensor, x2: torch.Tensor)
unet.py:90
Methodforward
(self, x)
unet.py:108
Methodforward
(self, x)
unet.py:132
Methodforward
(self, x)
unet.py:163
Methodforward
(self, x: torch.Tensor, audio_feat: torch.Tensor)
unet.py:217
Methodforward
(self, x)
data_utils/base_module.py:36
Methodforward
(self, x)
data_utils/base_module.py:53
Methodforward
(self, x)
data_utils/base_module.py:83
Methodforward
(self, x)
data_utils/base_module.py:117
Methodforward
(self, x)
data_utils/base_module.py:150
Methodforward
Apply forward pass.
data_utils/base_module.py:275
Methodforward
(self, x)
data_utils/pfld_mobileone.py:99
Methodforward
(self, x)
data_utils/pfld_mobileone.py:216
Methodforward
(self, out1, out2, out3, out4)
data_utils/pfld_mobileone.py:266
Methodforward
Forward function. Args: xs: input tensor (B, L, D) Returns: output tensor, (B, L, D)
data_utils/wenet/transformer/positionwise_feed_forward.py:35
Methodforward
Forward decoder. Args: memory: encoded memory, float32 (batch, maxlen_in, feat) memory_mask: encoder memory mask, (ba
data_utils/wenet/transformer/decoder.py:85
Methodforward
Forward decoder. Args: memory: encoded memory, float32 (batch, maxlen_in, feat) memory_mask: encoder memory mask, (ba
data_utils/wenet/transformer/decoder.py:228
Methodforward
Compute decoded features. Args: tgt (torch.Tensor): Input tensor (#batch, maxlen_out, size). tgt_mask (torch.Tensor):
data_utils/wenet/transformer/decoder_layer.py:58
Methodforward
Frontend + Encoder + Decoder + Calc loss Args: speech: (Batch, Length, ...) speech_lengths: (Batch, ) tex
data_utils/wenet/transformer/asr_model.py:72
Methodforward
Forward decoder. Args: memory: encoded memory, float32 (batch, maxlen_in, feat) memory_mask: encoder memory mask, (ba
data_utils/wenet/transformer/decoder_streaming.py:85
Methodforward
Forward decoder. Args: memory: encoded memory, float32 (batch, maxlen_in, feat) memory_mask: encoder memory mask, (ba
data_utils/wenet/transformer/decoder_streaming.py:244
Methodforward
Input x. Args: x (torch.Tensor): Input tensor (#batch, time, idim). x_mask (torch.Tensor): Input mask (#batch, 1, tim
data_utils/wenet/transformer/subsampling.py:45
Methodforward
Subsample x. Args: x (torch.Tensor): Input tensor (#batch, time, idim). x_mask (torch.Tensor): Input mask (#batch, 1,
data_utils/wenet/transformer/subsampling.py:97
Methodforward
Subsample x. Args: x (torch.Tensor): Input tensor (#batch, time, idim). x_mask (torch.Tensor): Input mask (#batch, 1,
data_utils/wenet/transformer/subsampling.py:150
Methodforward
Subsample x. Args: x (torch.Tensor): Input tensor (#batch, time, idim). x_mask (torch.Tensor): Input mask (#batch, 1,
data_utils/wenet/transformer/subsampling.py:204
Methodforward
Frontend + Encoder + Decoder + Calc loss Args: speech: (Batch, Length, ...) speech_lengths: (Batch, ) tex
data_utils/wenet/transformer/asr_model_streaming.py:72
Methodforward
Compute loss between x and target. The model outputs and data labels tensors are flatten to (batch*seqlen, class) shape and a mask is
data_utils/wenet/transformer/label_smoothing_loss.py:58
Methodforward
Return Swish activation function.
data_utils/wenet/transformer/swish.py:14
Methodforward
Calculate CTC loss. Args: hs_pad: batch of padded hidden state sequences (B, Tmax, D) hlens: batch of lengths of hidd
data_utils/wenet/transformer/ctc.py:31
Methodforward
Args: x (torch.Tensor): (batch, max_len, feat_dim) Returns: (torch.Tensor): normalized feature
data_utils/wenet/transformer/cmvn.py:36
Methodforward
Compute scaled dot product attention. Args: query (torch.Tensor): Query tensor (#batch, time1, size). key (torch.Tens
data_utils/wenet/transformer/attention.py:101
Methodforward
Compute 'Scaled Dot Product Attention' with rel. positional encoding. Args: query (torch.Tensor): Query tensor (#batch, time1, siz
data_utils/wenet/transformer/attention.py:182
Methodforward
Compute convolution module. Args: x (torch.Tensor): Input tensor (#batch, time, channels). mask_pad (torch.Tensor): us
data_utils/wenet/transformer/convolution.py:81
Methodforward
Embed positions in tensor. Args: xs: padded input tensor (B, T, D) xs_lens: input length (B) decoding_chu
data_utils/wenet/transformer/encoder_streaming.py:123
Methodforward
Embed positions in tensor. Args: xs: padded input tensor (B, T, D) xs_lens: input length (B) decoding_chu
data_utils/wenet/transformer/encoder.py:123
Methodforward
Add positional encoding. Args: x (torch.Tensor): Input. Its shape is (batch, time, ...) offset (int): position offset
data_utils/wenet/transformer/embedding.py:46
Methodforward
Compute positional encoding. Args: x (torch.Tensor): Input tensor (batch, time, `*`). Returns: torch.Tensor: E
data_utils/wenet/transformer/embedding.py:97
Methodforward
Just return zero vector for interface compatibility
data_utils/wenet/transformer/embedding.py:124
Methodforward
Compute encoded features. Args: x (torch.Tensor): Input tensor (#batch, time, size). mask (torch.Tensor): Mask tensor
data_utils/wenet/transformer/encoder_layer.py:57
Methodforward
Compute encoded features. Args: x (torch.Tensor): (#batch, time, size) mask (torch.Tensor): Mask tensor for the input
data_utils/wenet/transformer/encoder_layer.py:179
Methodforward_attention_decoder
Export interface for c++ call, forward decoder with multiple hypothesis from ctc prefix beam search and one encoder output Args:
data_utils/wenet/transformer/asr_model.py:629
Methodforward_attention_decoder
Export interface for c++ call, forward decoder with multiple hypothesis from ctc prefix beam search and one encoder output Args:
data_utils/wenet/transformer/asr_model_streaming.py:652
Methodforward_chunk_by_chunk
Forward input chunk by chunk with chunk_size like a streaming fashion Here we should pay special attention to computation cache
data_utils/wenet/transformer/encoder_streaming.py:252
Methodforward_encoder_chunk
Export interface for c++ call, give input chunk xs, and return output from time 0 to current chunk. Args: xs (torch.
data_utils/wenet/transformer/asr_model.py:571
Methodforward_encoder_chunk
Export interface for c++ call, give input chunk xs, and return output from time 0 to current chunk. Args: xs (torch.
data_utils/wenet/transformer/asr_model_streaming.py:594
Methodforward_one_step
Forward one step. This is only used for decoding. Args: memory: encoded memory, float32 (batch, maxlen_in, feat)
data_utils/wenet/transformer/decoder.py:263
Methodforward_one_step
Forward one step. This is only used for decoding. Args: memory: encoded memory, float32 (batch, maxlen_in, feat)
data_utils/wenet/transformer/decoder_streaming.py:279
Functionget_hubert_from_16k_wav
(wav_16k_name, device=DEFAULT_DEVICE)
data_utils/hubert.py:18
Methodget_lr
(self)
data_utils/wenet/utils/scheduler.py:42
Methodget_output
(self)
data_utils/wenet_infer.py:450
Methodget_wav_before_endpoint
(self)
data_utils/wenet_infer.py:68
Methodget_wave_len_in_feat_pipeline
(self)
data_utils/wenet_infer.py:65
Functiongreed_search_decode
(model, encoder_out, encoder_mask)
data_utils/wenet/bin/recognize_wav_streaming.py:372
Methodinit_decoding
(self)
data_utils/wenet_infer.py:72
Methodis_bidirectional_decoder
Returns: torch.Tensor: decoder output
data_utils/wenet/transformer/asr_model.py:618
Methodis_bidirectional_decoder
Returns: torch.Tensor: decoder output
data_utils/wenet/transformer/asr_model_streaming.py:641
Functionmake_non_pad_mask
Make mask tensor containing indices of non-padded part. The sequences in a batch may have different lengths. To enable batch computing, paddi
data_utils/wenet/utils/mask.py:177
Methodoutput_size
(self)
data_utils/wenet/transformer/encoder_streaming.py:120
Methodposition_encoding
For getting encoding in a streaming fashion Attention!!!!! we apply dropout only once at the whole utterance level in a none
data_utils/wenet/transformer/embedding.py:65
Methodposition_encoding
(self, offset: int, size: int)
data_utils/wenet/transformer/embedding.py:132
Methodpr
(self, text)
data_utils/wenet_infer.py:369
Functionread_lists
(list_file)
data_utils/wenet/utils/file_utils.py:16
Methodrecognize
Apply beam search on attention decoder Args: speech (torch.Tensor): (batch, max_len, feat_dim) speech_length (torch.
data_utils/wenet/transformer/asr_model_streaming.py:180
Methodrel_shift
Compute relative positinal encoding. Args: x (torch.Tensor): Input tensor (batch, time, size). zero_triu (bool): If tr
data_utils/wenet/transformer/attention.py:156
Methodreparameterize
Following works like `RepVGG: Making VGG-style ConvNets Great Again` - https://arxiv.org/pdf/2101.03697.pdf. We re-parameterize multi-branche
data_utils/base_module.py:299
Methodright_context
Export interface for c++ call, return right_context of the model
data_utils/wenet/transformer/asr_model.py:553
Methodright_context
Export interface for c++ call, return right_context of the model
data_utils/wenet/transformer/asr_model_streaming.py:576
Methodset_input_pipeline
(self, waveform_byte)
data_utils/wenet_infer.py:62
Methodsos_symbol
Export interface for c++ call, return sos symbol id of the model
data_utils/wenet/transformer/asr_model.py:559
Methodsos_symbol
Export interface for c++ call, return sos symbol id of the model
data_utils/wenet/transformer/asr_model_streaming.py:582
Methodsubsampling_rate
Export interface for c++ call, return subsampling_rate of the model
data_utils/wenet/transformer/asr_model.py:546
Methodsubsampling_rate
Export interface for c++ call, return subsampling_rate of the model
data_utils/wenet/transformer/asr_model_streaming.py:569
Functionto_numpy
(tensor)
data_utils/wenet_infer.py:464
← previous201–297 of 297, ranked by callers