hidden layer between lstm layer and logits :param lstm_outputs: [batch_size, num_steps, emb_size] :return: [batch_size, num_

Read a SQuAD json file into a list of SquadExample.

Reshapes a rank 2 tensor back to its original rank >= 2 tensor.

用于保存模型

抽取序列特征

Split a full s3 path into the bucket name and path.

Serializes this instance to a JSON string.

Reference : https://github.com/tensorflow/tensorflow/blob/r1.10/tensorflow/python/ops/candidate_sampling_ops.py `P(class) = (log(

cache hidden states into memory.

Check if this is the 'max context' doc span for the token.

output1 - True - algorithm for matrix, False - vector; output2 - need reshape

Performs invalid character removal and whitespace cleanup on text.

Performs invalid character removal and whitespace cleanup on text.

Performs invalid character removal and whitespace cleanup on text.

Compute softmax probability over raw logits.

create causal attention mask.

Decodes a record to a TensorFlow example.

Decodes a record to a TensorFlow example.

Decodes a record to a TensorFlow example.

Whether to use L2 weight decay for `param_name`.

Whether to use L2 weight decay for `param_name`.

Get variable intializer.

Get a list of sharded variables with the given dtype.

Get the variable name from the tensor name.

Get the variable name from the tensor name.

Returns tokenized answer spans that better match the annotated answer.

Initialize the weights.

Checks whether CP is the codepoint of a CJK character.

Checks whether CP is the codepoint of a CJK character.

Checks whether CP is the codepoint of a CJK character.

Checks whether `chars` is a control character.

Checks whether `chars` is a control character.

Checks whether `chars` is a control character.

Checks whether `chars` is a punctuation character.

Checks whether `chars` is a punctuation character.

Checks whether `chars` is a punctuation character.

Checks whether `chars` is a whitespace character.

Checks whether `chars` is a whitespace character.

Checks whether `chars` is a whitespace character.

Prunes heads of the model. heads_to_prune: dict of {layer_num: list of heads to prune in this layer} See base class PreTraine

Splits punctuation on a piece of text.

Splits punctuation on a piece of text.

Splits punctuation on a piece of text.

Strips accents from a piece of text.

Strips accents from a piece of text.

Strips accents from a piece of text.

Threshold value could be adjusted to shrink eta_min and eta_max values.

Adds whitespace around any CJK character.

Adds whitespace around any CJK character.

Adds whitespace around any CJK character.

Truncates a sequence pair in place to the maximum length.

Truncates a sequence pair in place to the maximum length.

Core absolute positional attention operations.

See base class.

把batch整理为一个[5, ]的数组 :param batch: :return:

Checks that all the tensors in the graph are reachable from outputs.

Raises an exception if the tensor rank is not of the expected rank. Args: tensor: A tf.Tensor to check the rank of. expected_rank: Python i

Performs multi-headed attention from `from_tensor` to `to_tensor`. This is an implementation of multi-headed attention based on "Attention is all

:param lstm_inputs: [batch_size, num_steps, emb_size] :return: [batch_size, num_steps, 2*lstm_dim]