are all allocatable pages used

Desc: 统计元素的数量 Args: self : self Return: None Raise: None

transformer encode

Desc: 判断这个对象是否为空对象 Args: self : self point : Point Return: True, if empty; False, if not

Desc: 将region转换成spgeo.Polygon Args: self : self Return: spgeo.Polygon Raise:

Desc: self - region的并集 Args: self : self region : 另一个region Return: list of reg

bpe decoding

Pad the instances to the max sequence length in batch, and generate the corresponding position data and attention bias.

This function read a MRQA data file. :param filename: name of a MRQA data file. :return: original samples of a MRQA data file.

Make layer define support indicating block, by which we can add layers to other blocks within current block. This will make it easy to define

Make layer define support indicating block, by which we can add layers to other blocks within current block. This will make it easy to define

bpe decoding

Desc: 返回该对象的网格编号 网格编号为字符串, 编号的格式为"xgrid_ygrid" xgrid = int(x) / grid_size ygrid = int(y) /

Desc: 判断一个对象是否是空的 Args: self : Return: None Raise: None

Desc: 添加一个key, 如果key已经存在, 返回key对应的value Args: key : key value : value, 如果value == None, 则认为value = key

Pad the instances to the max sequence length in batch, and generate the corresponding position data and attention bias.

add_arg

:param dynamic_tensor: :param smaller_tensor: :return:

fc

fc

Args: Returns:

Args: Returns:

Returns a list of the text of each token Args: uncased: lower cases text

Block

calculate logit

create tensors

Transform a human-readable string into a sequence of int ids. The ids should be in the range [num_reserved_ids, vocab_size). Ids [0,

file_reader

get sequence output

Desc: 转换为spgeo.Point Args: self : self Return: spgeo.Point Raise: None

prepare embedding

run frame, default train

conv_bn_layer

Converts a sequence of [tokens|ids] using the vocab.

Converts a sequence of [tokens|ids] using the vocab.

Converts a sequence of [tokens|ids] using the vocab.

Converts a sequence of [tokens|ids] using the vocab.

Converts a sequence of [tokens|ids] using the vocab.

Converts a sequence of [tokens|ids] using the vocab.

create a col unit Args: col_id (TYPE): NULL Returns: TODO Raises: NULL

TBD

ernie_unsqueeze

evaluate

evaluate

init model checkpoint

is multi gpu or not

is multi gpu or not

must implement in subclass

pad