preprocess data by removing extra space and normalize data.

Returns text encoded in a way suitable for print or `tf.logging`.

Reshapes a rank 2 tensor back to its original rank >= 2 tensor.

Reshapes a rank 2 tensor back to its original rank >= 2 tensor.

Reshapes a rank 2 tensor back to its original rank >= 2 tensor.

Reshapes a >= rank 2 tensor to a rank 2 tensor (i.e., a matrix).

Reshapes a >= rank 2 tensor to a rank 2 tensor (i.e., a matrix).

Reshapes a >= rank 2 tensor to a rank 2 tensor (i.e., a matrix).

test of Factorized embedding parameterization :return:

test of share parameters across all layers: how many parameter after share parameter across layers of transformer. :return:

Serializes this instance to a JSON string.

Serializes this instance to a JSON string.

Serializes this instance to a JSON string.

Tokenizes a piece of text.

Tokenizes a piece of text into its word pieces. This uses a greedy longest-match-first algorithm to perform tokenization using the given voca

Tokenizes a piece of text.

Tokenizes a piece of text into its word pieces. This uses a greedy longest-match-first algorithm to perform tokenization using the given voca

Checks whether the casing config is consistent with the checkpoint name.

Checks whether the casing config is consistent with the checkpoint name.