MCPcopy Create free account

hub / github.com/LAION-AI/natural_voice_assistant / functions

Functions135 in github.com/LAION-AI/natural_voice_assistant

Method__init__
( self, prednet: Dict[str, Any], vocab_size: int, normalization_mode: Optional
models_voice_assistant/STT/rnnt_decoder.py:116
Method__init__
(self)
models_voice_assistant/TTS/whisper_speech_model.py:5
Method__init__
Initialize StyleTTS2 model for text sythesizing. StyleTTS2 repository have to be cloned locally and a valid path to the repo have to be pas
models_voice_assistant/TTS/style_tts2_model.py:25
Method__iter__
(self)
utils_voice_assistant/streaming_buffer.py:37
Method__len__
(self)
utils_voice_assistant/streaming_buffer.py:79
Methodcfg
(self)
models_voice_assistant/STT/enc_dec_rnnt_model.py:66
Methodchange_subsampling_conv_chunking_factor
(self, subsampling_conv_chunking_factor: int)
models_voice_assistant/STT/conformer_encoder.py:1737
Methodextend_pe
Reset and extend the positional encodings if needed.
models_voice_assistant/STT/conformer_encoder.py:866
Methodforward
(self, x, seq_len)
utils_voice_assistant/preprocessor.py:90
Methodforward
Perform an encoding, decoding and joint step on the given audio signal. Args: processed_signal: preprocessed audio chunk
models_voice_assistant/stt_llm_tts_model.py:52
Methodforward
Perform a single LLM inference step Args: input_token: either input token from user or previous generated token from LLM
models_voice_assistant/stt_llm_tts_model.py:298
Methodforward
Perform a single voice assistant forward path 1) If a processed signal is passed and speech is detected, the audio chunk is transcribed
models_voice_assistant/stt_llm_tts_model.py:609
Methodforward
Compute 'Scaled Dot Product Attention'. Args: query (torch.Tensor): (batch, time1, size) key (torch.Tensor): (batch, t
models_voice_assistant/STT/conformer_encoder.py:103
Methodforward
(self, query, key, value, mask, pos_emb, cache=None)
models_voice_assistant/STT/conformer_encoder.py:166
Methodforward
Compute Scaled Dot Product Local Attention with rel. positional encoding. using overlapping chunks Args: query (torch.Tensor): (ba
models_voice_assistant/STT/conformer_encoder.py:259
Methodforward
Adds positional encoding. Args: x (torch.Tensor): Input. Its shape is (batch, time, feature_size) cache_len (int): the
models_voice_assistant/STT/conformer_encoder.py:847
Methodforward
Compute positional encoding. Args: x (torch.Tensor): Input. Its shape is (batch, time, feature_size) cache_len (int):
models_voice_assistant/STT/conformer_encoder.py:876
Methodforward
(self, x, cache=None)
models_voice_assistant/STT/conformer_encoder.py:1020
Methodforward
(self, x, pad_mask=None, cache=None)
models_voice_assistant/STT/conformer_encoder.py:1077
Methodforward
(self, x)
models_voice_assistant/STT/conformer_encoder.py:1131
Methodforward
(self, x, att_mask=None, pos_emb=None, pad_mask=None, cache_last_channel=None, cache_last_time=None)
models_voice_assistant/STT/conformer_encoder.py:1229
Methodforward
(self, x, lengths)
models_voice_assistant/STT/conformer_encoder.py:1576
Methodforward
( self, audio_signal, length, cache_last_channel=None, cache_last_time=None, cache_last_channel_len=No
models_voice_assistant/STT/conformer_encoder.py:1918
Methodforward
( self, encoder_outputs: torch.Tensor, decoder_outputs: Optional[torch.Tensor],
models_voice_assistant/STT/rnnt_joint.py:87
Methodforward
( self, x: torch.Tensor, h: Optional[Tuple[torch.Tensor, torch.Tensor]] = None )
models_voice_assistant/STT/rnnt_decoder.py:104
Methodforward
(self, targets, target_length, states=None)
models_voice_assistant/STT/rnnt_decoder.py:156
Methodforward
(self, text)
models_voice_assistant/TTS/whisper_speech_model.py:9
Methodforward
Synthesize the entire given text. For good quality a whole sentence should be passed Args: text: String of text that should be sy
models_voice_assistant/TTS/style_tts2_model.py:106
Methodis_buffer_empty
(self)
utils_voice_assistant/streaming_buffer.py:82
Functionmain_loop
Wait for audio input, call voice assistant model and play synthesized speech Args: streaming_buffer: streaming buffer instance t
main.py:162
Functionplay_audio
Play synthesized audio data in a separate process Args: audio_output_buffer: multiprocessing-queue to receive audio data
main.py:142
Methodreset_parameters
(self)
models_voice_assistant/STT/conformer_encoder.py:1630
Methodreset_parameters_conv
(self)
models_voice_assistant/STT/conformer_encoder.py:1109
Methodreset_parameters_ff
(self)
models_voice_assistant/STT/conformer_encoder.py:1138
Functionterminate
Signal handler for keyboard interrupt to terminate all subprocesses
main.py:17
← previous101–135 of 135, ranked by callers