Adjust the learning rate at the end of the epoch.

Update the learning rate after each update.

Helper to get index of mask symbol

Ordered indices for batching.

Parse the configuration of lambda coefficient (for scheduling). x = "3" # lambda will be a constant equal to x x = "0:1,

Do we require PathManager to access given path?

Raises if there are paths matching 'valid*[0-9].*' which are not combined or ignored.

tsv is needed to retrieve the uids for the labels

Replabel symbols used in flashlight, currently just "1", "2", ... This prevents training with numeral tokens, so this might change in the fut

Evaluate language model based on the current lm state and new word Parameters: ----------- state: current lm state

Set the number of parameters updates.

Shuffle dataset samples before batching

Usage:: x = torch.Tensor([1]) y = torch.Tensor([2]) tensors, packed_non_tensors = split_non_tensors((x, y, None, 3))

Called at the end of each step.

unfold T x B x C to T x B x C x K

Transforms *one row* of a packed constraint tensor (e.g., for one sentence in the batch) into a list of constraint tensors.

Updates the running statistics when quantizing a new layer.

Upgrade old state dicts to work with newer code.

Weight-normalized Conv1d layer optimized for decoding

BufferFormatCheck */

BufferFormatCheck */

FetchSharedCythonModule */

FetchSharedCythonModule */

GetAttr */

GetAttr */

GetVTable */

GetVTable */

IsLittleEndian */

IsLittleEndian */

CIntFromPy */

CIntToPy */