Return a loaded dataset split. Args: split (str): name of the split (e.g., train, valid, test) Returns:

Sort symbols by frequency in descending order, ignoring special ones. Args: - threshold defines the minimum word count

Build a dictionary of var/value from :param: args. Parameters can be either named or unnamed. In the latter case, their name is taken fro

Stores dictionary into a text file

Linear layer (input: N x T x C)

CIntFromPy */

UnicodeEquals */

Score a batch of translations.

Get an iterator that yields batches of data from the given dataset. Args: dataset (~fairseq.data.FairseqDataset): datase

Returns the index of the specified symbol

Load the dictionary from the filename Args: filename (str): the filename

Return a new iterator over the dataset. Args: shuffle (bool, optional): shuffle batches before returning the iter

Transforms wiki markup. @see https://www.mediawiki.org/wiki/Help:Formatting

ParseKeywords */

CIntFromPy */

BufferGetAndValidate */

Add optimizer-specific arguments to the parser.

Args: args (argparse.Namespace): fairseq args params (iterable): iterable of parameters to optimize

Create a domain instance that is aligned with the origin. The actual domain might be slightly larger than [t_min, t_max] but

Load a given dataset split. Args: split (str): name of the split (e.g., train, valid, test)

Shift the domain right by `dt`

Import */

BufferFallbackError */

SetVTable */

decode_c_string */

decode_c_string */

outputs: batch x len x d_model targets: batch x len masks: batch x len policy_logprob: if there is