MCPcopy Create free account

hub / github.com/Sally-SH/VSP-LLM / functions

Functions6,051 in github.com/Sally-SH/VSP-LLM

⨍ Functions 6,051◇ Types & classes 878↳ Endpoints 3
↓ 3 callersFunction_create_dummy_alignment_data
(filename_src, filename_tgt, filename)
fairseq/tests/utils.py:174
↓ 3 callersFunction_create_dummy_data
(filename)
fairseq/tests/test_binaries.py:1746
↓ 3 callersMethod_generate
( self, sample: Dict[str, Dict[str, Tensor]], prefix_tokens: Optional[Tensor] = None,
src/sequence_generator.py:190
↓ 3 callersMethod_generate
( self, sample: Dict[str, Dict[str, Tensor]], prefix_tokens: Optional[Tensor] = None,
fairseq/fairseq/sequence_generator.py:189
↓ 3 callersMethod_get_relative_position
( self, input: Tensor, max_relative_position: int, left_context_length: int,
fairseq/fairseq/models/speech_to_text/modules/emformer.py:1049
↓ 3 callersFunction_lang_token
(lang: str)
fairseq/fairseq/tasks/online_backtranslation.py:658
↓ 3 callersMethod_log_oom
(self, exc)
fairseq/fairseq/trainer.py:1209
↓ 3 callersFunction_override_attr
( sub_node: str, data_class: Type[FairseqDataclass], args: Namespace )
fairseq/fairseq/dataclass/utils.py:198
↓ 3 callersMethod_prepare_sample
(self, sample, is_dummy=False)
fairseq/fairseq/trainer.py:1149
↓ 3 callersMethod_prepend_lang_bos_to_target
( self, dataset: LanguagePairDataset, lang: str )
fairseq/fairseq/tasks/online_backtranslation.py:254
↓ 3 callersMethod_reduce_and_log_stats
(self, logging_outputs, sample_size, grad_norm=None)
fairseq/fairseq/trainer.py:1338
↓ 3 callersMethod_sync_fp16_grads_to_fp32
(self)
fairseq/fairseq/optim/fp16_optimizer.py:106
↓ 3 callersMethod_test_pretrained_masked_lm_for_translation
(self, learned_pos_emb, encoder_only)
fairseq/tests/test_binaries.py:1468
↓ 3 callersMethod_test_resume_training
(self, extra_clargs, arch="fconv_iwslt_de_en")
fairseq/tests/gpu/test_binaries_gpu.py:68
↓ 3 callersFunction_torch_persistent_save
(obj, f)
fairseq/fairseq/checkpoint_utils.py:500
↓ 3 callersMethod_train_transformer
(self, seed, extra_args=None)
fairseq/tests/test_checkpoint_utils.py:32
↓ 3 callersMethodadd_file_to_dictionary
(filename, dict, tokenize, num_workers)
fairseq/fairseq/data/dictionary.py:351
↓ 3 callersMethodadd_insertion_noise
(self, tokens, p)
fairseq/fairseq/data/denoising_dataset.py:372
↓ 3 callersMethodadvance
Reads in a token and advances the state. Here's how it works. We can advance to the next state if: - there is a matching child
fairseq/fairseq/token_generation_constraints.py:463
↓ 3 callersFunctionall_reduce
(tensor, group, op="sum")
fairseq/fairseq/distributed/utils.py:491
↓ 3 callersMethodapply_mask
(self, x, padding_mask, target_list)
fairseq/fairseq/models/hubert/hubert.py:323
↓ 3 callersMethodassertAlmostEqual
(self, t1, t2)
fairseq/tests/test_label_smoothing.py:117
↓ 3 callersMethodassertAlmostEqual
(self, t1, t2)
fairseq/tests/distributed/test_bmuf.py:201
↓ 3 callersMethodassert_eos_at_end
Asserts last token of every sentence in x is EOS
fairseq/tests/test_noising.py:140
↓ 3 callersFunctionaverage_checkpoints
Loads checkpoints from inputs and returns a model with averaged weights. Args: inputs: An iterable of string paths of checkpoints to load f
fairseq/scripts/average_checkpoints.py:16
↓ 3 callersFunctionbase_architecture
(args)
fairseq/fairseq/models/masked_lm.py:314
↓ 3 callersFunctionbase_architecture
(args)
fairseq/fairseq/models/lstm.py:699
↓ 3 callersFunctionbase_architecture
(args)
fairseq/examples/linformer/linformer_src/models/linformer_roberta.py:103
↓ 3 callersFunctionbase_lm_architecture
(args)
fairseq/fairseq/model_parallel/models/transformer_lm.py:91
↓ 3 callersFunctionbase_lm_architecture
(args)
fairseq/fairseq/models/fconv_lm.py:95
↓ 3 callersMethodbatch_by_size
Given an ordered set of indices, return batches according to *max_tokens*, *max_sentences* and *required_batch_size_multiple*.
fairseq/fairseq/data/fairseq_dataset.py:104
↓ 3 callersFunctionberard
The original version: "End-to-End Automatic Speech Translation of Audiobooks" (https://arxiv.org/abs/1802.04200)
fairseq/fairseq/models/speech_to_text/berard.py:547
↓ 3 callersFunctionbinarize
( databin_dir, direction, spm_vocab=SPM_VOCAB, prefix='', splits=['train', 'test', 'valid'], p
fairseq/examples/multilingual/data_scripts/binarize.py:117
↓ 3 callersMethodbinarize
(self, s: str, append_eos: bool = False)
fairseq/examples/roberta/wsc/wsc_task.py:85
↓ 3 callersFunctionbinarize_
( bpe_dir, databin_dir, direction, spm_vocab=SPM_VOCAB, splits=['train', 'test', 'valid'], )
fairseq/examples/multilingual/data_scripts/binarize.py:68
↓ 3 callersMethodbuffered_future_mask
(self, tensor)
fairseq/examples/speech_recognition/models/vggtransformer.py:699
↓ 3 callersMethodbuffered_sparse_mask
(self, tensor, tgt_len, src_len)
fairseq/fairseq/modules/sparse_multihead_attention.py:119
↓ 3 callersMethodbuild_dataset_for_inference
(self, src_tokens, src_lengths, sort=True)
fairseq/fairseq/tasks/masked_lm.py:225
↓ 3 callersFunctionbuild_dictionary
(filenames, src=False, tgt=False)
fairseq/fairseq_cli/preprocess.py:61
↓ 3 callersMethodbuild_embedding
(cls, args, dictionary, embed_dim, path=None)
fairseq/fairseq/models/transformer.py:272
↓ 3 callersMethodbuild_shared_embeddings
Helper function to build shared embeddings for a set of languages after checking that all dicts corresponding to those languages are
fairseq/fairseq/models/fairseq_model.py:385
↓ 3 callersFunctionbyte_decode
(x: str)
fairseq/fairseq/data/encoders/byte_utils.py:27
↓ 3 callersFunctionbyte_encode
(x: str)
fairseq/fairseq/data/encoders/byte_utils.py:22
↓ 3 callersMethodclip_grad_norm
(self, clip_norm)
fairseq/fairseq/trainer.py:1100
↓ 3 callersMethodcompute_distances
For every centroid m, computes ||M - m[None, :]||_2 Remarks: - We rely on PyTorch's broadcast
fairseq/fairseq/modules/quantization/pq/em.py:133
↓ 3 callersFunctioncompute_mask_indices
Computes random mask spans for a given shape Args: shape: the the shape for which to compute masks. should be of size 2 w
src/utils_vsp_llm.py:142
↓ 3 callersMethodcompute_score_full
(self, L, tau)
fairseq/fairseq/models/nat/insertion_transformer.py:45
↓ 3 callersFunctionconcat_files
(split, src, tgt, extracted_folders, split_urls, path_patterns, to_folder, debug=False)
fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py:327
↓ 3 callersFunctionconsumer
(tensor)
fairseq/fairseq_cli/preprocess.py:346
↓ 3 callersFunctionconvtransformer_espnet
(args)
fairseq/fairseq/models/speech_to_text/convtransformer.py:444
↓ 3 callersFunctioncorpus_bleu
(sys_stream, ref_streams)
fairseq/examples/translation_moe/score.py:112
↓ 3 callersFunctiondataset_dest_prefix
(args, output_prefix, lang)
fairseq/fairseq_cli/preprocess.py:373
↓ 3 callersMethoddecode
(self, tok, symbols_ignore=None)
src/hubert_pretraining.py:56
↓ 3 callersMethoddecode
(x: str)
fairseq/fairseq/data/encoders/bytes.py:32
↓ 3 callersFunctiondecode_fn
(x)
fairseq/fairseq_cli/generate.py:175
↓ 3 callersMethoddisconnect
(self)
fairseq/fairseq/data/plasma_utils.py:167
↓ 3 callersFunctiondownload_files
(dl_folder, urls, completed_urls={})
fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py:93
↓ 3 callersFunctionedit_distance2_with_dp
fairseq/fairseq/clib/libnat/edit_dist.cpp:23
↓ 3 callersMethodend_of_epoch
Returns whether the most recent epoch iterator has been exhausted
fairseq/fairseq/data/iterators.py:378
↓ 3 callersFunctioneval_str_list
(x, x_type=float)
fairseq/fairseq/dataclass/utils.py:25
↓ 3 callersMethodexpert_index
(self, i)
fairseq/examples/translation_moe/translation_moe_src/translation_moe.py:139
↓ 3 callersFunctionextend_embedding
( emb: nn.Module, new_vocab_size: int, copy_from_token_id: int )
fairseq/fairseq/tasks/online_backtranslation.py:590
↓ 3 callersMethodextract_features
Similar to *forward* but only return features. Inputs: prev_output_tokens: Tensor(B, T) encoder_out: a dictio
fairseq/fairseq/models/nat/levenshtein_transformer.py:312
↓ 3 callersMethodextract_features
Similar to *forward* but only return features. Includes several features from "Jointly Learning to Align and Translate with
fairseq/examples/laser/laser_src/laser_transformer.py:179
↓ 3 callersMethodextract_features_scriptable
Similar to *forward* but only return features. Includes several features from "Jointly Learning to Align and Translate with
fairseq/fairseq/models/transformer.py:859
↓ 3 callersFunctionextract_file
(downloaded_file, extract_folder, get_extract_name=get_extract_name, debug=False)
fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py:131
↓ 3 callersFunctionfasta_file_path
(prefix_path)
fairseq/fairseq/data/fasta_dataset.py:15
↓ 3 callersMethodfilter_indices_by_size
Filter examples that are too large Args: indices (np.array): original array of sample indices dataset (~fair
fairseq/fairseq/tasks/fairseq_task.py:172
↓ 3 callersFunctionfilter_manifest_df
( df, is_train_split=False, extra_filters=None, min_n_frames=5, max_n_frames=3000 )
fairseq/examples/speech_to_text/data_utils.py:204
↓ 3 callersMethodfind_offsets
(filename, num_chunks)
fairseq/fairseq/binarizer.py:105
↓ 3 callersMethodforward
(self)
src/sequence_generator.py:756
↓ 3 callersMethodforward
(self)
fairseq/fairseq/sequence_generator.py:751
↓ 3 callersMethodforward_idx
(self, x)
fairseq/fairseq/modules/gumbel_vector_quantizer.py:137
↓ 3 callersMethodgenerate
Generate a batch of inferences.
fairseq/examples/speech_recognition/w2l_decoder.py:69
↓ 3 callersFunctionget_available_dataset_impl
()
fairseq/fairseq/data/indexed_dataset.py:37
↓ 3 callersMethodget_cache_size
(self)
fairseq/examples/adaptive_span/adaptive_span_model.py:90
↓ 3 callersMethodget_decoder_langtok
(self, tgt_lang, spec=None)
fairseq/fairseq/data/multilingual/multilingual_data_manager.py:478
↓ 3 callersFunctionget_dummy_task_and_parser
to build a fariseq model, we need some dummy parse and task. This function is used to create dummy task and parser to faciliate model/criteri
fairseq/tests/test_sequence_generator.py:52
↓ 3 callersMethodget_encoder_langtok
(self, src_lang, tgt_lang, spec=None)
fairseq/fairseq/data/multilingual/multilingual_data_manager.py:459
↓ 3 callersFunctionget_extract_name
(file_path)
fairseq/examples/multilingual/data_scripts/download_wmt19_and_before.py:127
↓ 3 callersFunctionget_global_group
()
fairseq/fairseq/distributed/utils.py:419
↓ 3 callersMethodget_input_path
(self, fname=None)
fairseq/examples/wav2vec/wav2vec_featurize.py:168
↓ 3 callersMethodget_normalized_probs
(self, net_output, log_probs, sample=None)
fairseq/fairseq/criterions/composite_loss.py:51
↓ 3 callersMethodget_normalized_probs
( self, net_output: Tuple[ torch.Tensor, Optional[Dict[str, List[Optional[torch.Te
fairseq/examples/wav2vec/unsupervised/models/wav2vec_u.py:478
↓ 3 callersMethodget_original_text
(self, i)
fairseq/fairseq/data/indexed_dataset.py:291
↓ 3 callersFunctionget_prefix_no_bpe
(sentence, bpe_symbol, prefix_len)
fairseq/examples/noisychannel/rerank_utils.py:216
↓ 3 callersMethodget_smoothed_value
Get a single smoothed value.
fairseq/fairseq/logging/meters.py:291
↓ 3 callersFunctionget_symbols_to_strip_from_output
(generator)
fairseq/fairseq_cli/generate.py:52
↓ 3 callersMethodget_target
(self, item)
fairseq/examples/wav2vec/unsupervised/data/random_input_dataset.py:30
↓ 3 callersMethodget_targets
(self, net_output, is_masked=True)
fairseq/fairseq/models/hubert/hubert.py:544
↓ 3 callersMethodget_tokens
Normalize tokens by handling CTC blank, ASG replabels, etc.
fairseq/examples/speech_recognition/w2l_decoder.py:89
↓ 3 callersMethodget_train_iterator
Return an EpochBatchIterator over the training set for a given epoch.
fairseq/fairseq/trainer.py:577
↓ 3 callersFunctionget_whole_word_mask
(args, dictionary)
fairseq/fairseq/data/encoders/utils.py:10
↓ 3 callersMethodhas_encoder
(self)
src/sequence_generator.py:759
↓ 3 callersMethodhas_encoder
(self)
fairseq/fairseq/sequence_generator.py:754
↓ 3 callersMethodhas_sharded_data
(self, split)
fairseq/fairseq/tasks/fairseq_task.py:134
↓ 3 callersMethodhead_reshape
(self, x)
fairseq/examples/adaptive_span/adaptive_span_model.py:110
↓ 3 callersFunctionimport_pipe
()
fairseq/fairseq/model_parallel/models/pipeline_parallel_transformer/model.py:45
↓ 3 callersMethodinference_step
( self, generator, models, sample, prefix_tokens=None, constraints=None )
fairseq/examples/adaptive_span/truncated_bptt_lm_task.py:172
↓ 3 callersMethodload_dataset
Load a given dataset split. Args: split (str): name of the split (e.g., train, valid, test)
fairseq/examples/speech_recognition/tasks/speech_recognition.py:117
← previousnext →501–600 of 6,051, ranked by callers