Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/Mu-Y/mpl-mdd
/ functions
Functions
77 in github.com/Mu-Y/mpl-mdd
⨍
Functions
77
◇
Types & classes
5
↳
Endpoints
5
↓ 25 callers
Method
append
( self, ids, predict, canonical, perceived, predict_len=None,
mpd_eval_v3.py:29
↓ 10 callers
Method
summarize
Summarize the error_rate and return relevant statistics. * See MetricStats.summarize()
mpd_eval_v3.py:87
↓ 10 callers
Method
write_stats
Write all relevant info (e.g., error rate alignments) to file. * See MetricStats.write_stats()
mpd_eval_v3.py:102
↓ 4 callers
Method
compute_forward
Given an input batch it computes the phoneme probabilities.
train_mpl.py:36
↓ 3 callers
Method
compute_forward
Given an input batch it computes the phoneme probabilities.
train.py:27
↓ 3 callers
Method
compute_objectives
Given the network predictions and targets computed the NLL loss.
train.py:51
↓ 3 callers
Method
compute_objectives
Given the network predictions and targets computed the NLL loss.
train_mpl.py:60
↓ 3 callers
Function
normalize_phone
Normalize phoneme labels to lower case, stress-free form. This will also deal with L2-ARCTIC annotations. Args: s: A phoneme annotatio
l2arctic_prepare.py:217
↓ 2 callers
Function
extract_alignment
a, b are two aligned lists (i.e. same length) gap_token is the artificial token placeholder used in L2Arctic annotation. In this case is a `s
mpd_eval_v3.py:304
↓ 2 callers
Method
fit
Iterate epochs and datasets to improve objective. Relies on the existence of multiple functions that can (or should) be overridden. Th
train_mpl.py:362
↓ 2 callers
Function
get_phonemes
(tg, keep_artificial_sil=False, rm_repetitive_sil=True)
l2arctic_prepare.py:110
↓ 2 callers
Function
make_attn_mask
wav_lens: relative lengths(i.e. 0-1) of a batch. shape: (bs, ) return a tensor of shape (bs, seq_len), representing mask on allowed positions
train_mpl.py:22
↓ 2 callers
Function
mpd_summary
(total_wer_details)
mpd_eval_v3.py:155
↓ 2 callers
Function
normalize_tier_mark
Normalize the marks of an IntervalTier. Refer to the code for supported modes. Args: tier: An IntervalTier object. mode: The f
l2arctic_prepare.py:178
↓ 2 callers
Method
on_stage_start
Gets called when a stage (either training, validation, test) starts.
train_mpl.py:112
↓ 2 callers
Function
print_mpd_details
(wer_details, mpd_stats, mpd_file)
mpd_eval_v3.py:208
↓ 2 callers
Function
remove_repetitive_sil
(phone_list)
l2arctic_prepare.py:152
↓ 2 callers
Function
rm_parallel_sil
(canos, percs)
mpd_eval_v3.py:337
↓ 2 callers
Function
tier_to_list
(tier)
l2arctic_prepare.py:125
↓ 1 callers
Method
compute_forward
Given an input batch it computes the phoneme probabilities.
transcribe.py:27
↓ 1 callers
Method
compute_forward
Given an input batch it computes the phoneme probabilities.
evaluate.py:27
↓ 1 callers
Method
compute_objectives
Given the network predictions and targets computed the NLL loss.
evaluate.py:51
↓ 1 callers
Method
compute_objectives_unlabeled
Simply compute the CTC loss
train_mpl.py:282
↓ 1 callers
Function
dataio_prep
This function prepares the datasets to be used in the brain class. It also defines the data processing pipeline through user-defined functions.
train.py:263
↓ 1 callers
Function
dataio_prep
This function prepares the datasets to be used in the brain class. It also defines the data processing pipeline through user-defined functions.
transcribe.py:92
↓ 1 callers
Function
dataio_prep
This function prepares the datasets to be used in the brain class. It also defines the data processing pipeline through user-defined functions.
train_mpl.py:510
↓ 1 callers
Function
dataio_prep
This function prepares the datasets to be used in the brain class. It also defines the data processing pipeline through user-defined functions.
evaluate.py:164
↓ 1 callers
Method
evaluate_batch
Computations needed for validation/test batches
train_mpl.py:106
↓ 1 callers
Method
fit_batch
Fit one batch, override to do multiple updates. The default implementation depends on a few methods being defined with a particular b
train_mpl.py:175
↓ 1 callers
Function
get_data_from_spk
(data_folder, spk)
l2arctic_prepare.py:65
↓ 1 callers
Function
get_data_from_spk
(data_folder, spk, labeled_data)
l2arctic_unlabeled_prepare.py:68
↓ 1 callers
Function
get_data_from_utt
(tg, wav_file, text_file, spk)
l2arctic_prepare.py:86
↓ 1 callers
Function
get_data_from_utt
( wav_file, text_file, spk)
l2arctic_unlabeled_prepare.py:83
↓ 1 callers
Method
infer_batch
(self, batch)
train_mpl.py:252
↓ 1 callers
Method
init_optimizers
Initializes the wav2vec2 optimizer and model optimizer
train.py:221
↓ 1 callers
Method
init_optimizers
Initializes the wav2vec2 optimizer and model optimizer
train_mpl.py:296
↓ 1 callers
Function
is_sil
Test if the input string represents silence. Args: s: A phoneme label. Returns: True if is silence, otherwise False.
l2arctic_prepare.py:268
↓ 1 callers
Function
main
(args)
split_train_dev.py:23
↓ 1 callers
Function
main
(args)
mpd_eval_v3.py:348
↓ 1 callers
Function
make_attn_mask
wav_lens: relative lengths(i.e. 0-1) of a batch. shape: (bs, ) return a tensor of shape (bs, seq_len), representing mask on allowed positions
train.py:13
↓ 1 callers
Function
make_attn_mask
wav_lens: relative lengths(i.e. 0-1) of a batch. shape: (bs, ) return a tensor of shape (bs, seq_len), representing mask on allowed positions
transcribe.py:13
↓ 1 callers
Function
make_attn_mask
wav_lens: relative lengths(i.e. 0-1) of a batch. shape: (bs, ) return a tensor of shape (bs, seq_len), representing mask on allowed positions
evaluate.py:13
↓ 1 callers
Function
make_json
(data_folder, split, spks)
l2arctic_prepare.py:53
↓ 1 callers
Function
make_json
check whether the wav is presented in labled_data we only keep those wav that were not labled.
l2arctic_unlabeled_prepare.py:52
↓ 1 callers
Function
mpd_eval_on_dataset
(in_json, mpd_file=sys.stdout, per_file=None)
mpd_eval_v3.py:112
↓ 1 callers
Function
mpd_stats
schema: [(operator, idx_i(None), idx_j(None))] c: canonical p: perceived h: hypothesis
mpd_eval_v3.py:236
↓ 1 callers
Method
on_fit_start
Gets called at the beginning of ``fit()``, on multiple processes if ``distributed_count > 0`` and backend is ddp. Default implementat
train_mpl.py:310
↓ 1 callers
Method
on_stage_end
Gets called at the end of a epoch.
train_mpl.py:124
↓ 1 callers
Function
prepare_l2arctic
( data_folder, save_json_train="train_l2arctic.json", save_json_test="test_l2arctic.json", met
l2arctic_prepare.py:25
↓ 1 callers
Function
prepare_l2arctic_unlabeled
( data_folder, save_json_train="train_l2arctic_unlabeled.json", labeled_json="train_l2arctic.json"
l2arctic_unlabeled_prepare.py:24
↓ 1 callers
Function
process_arpa_phoneme
(path)
l2arctic_prepare.py:14
↓ 1 callers
Function
process_arpa_phoneme
(path)
l2arctic_unlabeled_prepare.py:13
↓ 1 callers
Function
rm_parallel_sil_batch
(canos, percs)
mpd_eval_v3.py:328
↓ 1 callers
Method
set_momentum_factor
(self, n_train_batch, n_epochs)
train_mpl.py:357
↓ 1 callers
Function
split_by_speaker
(in_json, ratio=0.1)
split_train_dev.py:10
↓ 1 callers
Function
split_list
(in_list, ratio=0.1)
split_train_dev.py:5
↓ 1 callers
Method
teacher_momentum_update
(self)
train_mpl.py:290
↓ 1 callers
Method
transcribe_dataset
( self, dataset, # Must be obtained from the dataio_function min_key, # We
transcribe.py:58
Method
__init__
(self, merge_tokens=False, split_tokens=False, space_token="_")
mpd_eval_v3.py:23
Function
audio_pipeline
(wav)
train.py:311
Function
audio_pipeline
(wav)
transcribe.py:110
Function
audio_pipeline
(wav)
train_mpl.py:564
Function
audio_pipeline
(wav)
evaluate.py:181
Method
evaluate_batch
Computations needed for validation/test batches
train.py:95
Method
evaluate_batch
Computations needed for validation/test batches
evaluate.py:96
Method
fit_batch
Fit one batch, override to do multiple updates. The default implementation depends on a few methods being defined with a particular b
train.py:163
Function
get_word_bounds
word_tier: [(minTime, maxTime, word1), (minTime, maxTime, word2), ...] phone_tier: [(minTime, maxTime, phn1), (minTime, maxTime, phn2), ...]
l2arctic_prepare.py:128
Method
on_fit_start
Gets called at the beginning of ``fit()``, on multiple processes if ``distributed_count > 0`` and backend is ddp. Default implementat
train.py:235
Method
on_stage_end
Gets called at the end of a epoch.
train.py:112
Method
on_stage_end
Gets called at the end of a epoch.
evaluate.py:113
Method
on_stage_start
Gets called when a stage (either training, validation, test) starts.
train.py:101
Method
on_stage_start
Gets called when a stage (either training, validation, test) starts.
evaluate.py:102
Function
text_pipeline_test
(target, canonical, perceived)
train.py:352
Function
text_pipeline_test
(target, canonical, perceived)
train_mpl.py:605
Function
text_pipeline_test
(target, canonical, perceived)
evaluate.py:208
Function
text_pipeline_train
(phn)
train.py:332
Function
text_pipeline_train
(phn)
train_mpl.py:585