Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/DA-southampton/Read_Bert_Code
/ functions
Functions
740 in github.com/DA-southampton/Read_Bert_Code
⨍
Functions
740
◇
Types & classes
186
Method
get_dev_examples
See base class.
bert_read_step_to_step/processors/glue.py:464
Method
get_dev_examples
See base class.
bert_read_step_to_step/processors/glue.py:495
Method
get_dev_examples
See base class.
bert_read_step_to_step/processors/glue.py:562
Method
get_dev_examples
See base class.
bert_read_step_to_step/processors/glue.py:595
Method
get_dev_examples
See base class.
bert_read_step_to_step/processors/glue.py:627
Method
get_input_ids
(text)
bert_read_step_to_step/transformers/tokenization_utils.py:776
Method
get_iterator
(self, split, *args, **kwargs)
bert_read_step_to_step/transformers/tokenization_transfo_xl.py:533
Method
get_labels
Gets the list of labels for this data set.
bert_read_step_to_step/processors/utils.py:98
Method
get_labels
See base class.
bert_read_step_to_step/processors/glue.py:165
Method
get_labels
See base class.
bert_read_step_to_step/processors/glue.py:198
Method
get_labels
See base class.
bert_read_step_to_step/processors/glue.py:277
Method
get_labels
See base class.
bert_read_step_to_step/processors/glue.py:314
Method
get_labels
See base class.
bert_read_step_to_step/processors/glue.py:360
Method
get_labels
See base class.
bert_read_step_to_step/processors/glue.py:394
Method
get_labels
See base class.
bert_read_step_to_step/processors/glue.py:436
Method
get_labels
See base class.
bert_read_step_to_step/processors/glue.py:469
Method
get_labels
See base class.
bert_read_step_to_step/processors/glue.py:500
Method
get_labels
See base class.
bert_read_step_to_step/processors/glue.py:568
Method
get_labels
See base class.
bert_read_step_to_step/processors/glue.py:600
Method
get_labels
See base class.
bert_read_step_to_step/processors/glue.py:632
Function
get_lm_corpus
(datadir, dataset)
bert_read_step_to_step/transformers/tokenization_transfo_xl.py:550
Method
get_special_tokens_mask
Retrieves sequence ids from a token list that has no special tokens added. This method is called when adding special tokens using the
bert_read_step_to_step/transformers/tokenization_roberta.py:101
Method
get_special_tokens_mask
Retrieves sequence ids from a token list that has no special tokens added. This method is called when adding special tokens using the
bert_read_step_to_step/transformers/tokenization_xlm.py:771
Method
get_special_tokens_mask
Retrieves sequence ids from a token list that has no special tokens added. This method is called when adding special tokens using the
bert_read_step_to_step/transformers/tokenization_xlnet.py:198
Method
get_special_tokens_mask
Retrieves sequence ids from a token list that has no special tokens added. This method is called when adding special tokens using the
bert_read_step_to_step/transformers/tokenization_bert.py:210
Method
get_test_examples
See base class.
bert_read_step_to_step/processors/glue.py:309
Method
get_test_examples
See base class.
bert_read_step_to_step/processors/glue.py:389
Method
get_test_examples
See base class.
bert_read_step_to_step/processors/glue.py:431
Method
get_train_examples
Gets a collection of `InputExample`s for the train set.
bert_read_step_to_step/processors/utils.py:90
Method
get_train_examples
See base class.
bert_read_step_to_step/processors/glue.py:154
Method
get_train_examples
See base class.
bert_read_step_to_step/processors/glue.py:187
Method
get_train_examples
See base class.
bert_read_step_to_step/processors/glue.py:223
Method
get_train_examples
See base class.
bert_read_step_to_step/processors/glue.py:299
Method
get_train_examples
See base class.
bert_read_step_to_step/processors/glue.py:350
Method
get_train_examples
See base class.
bert_read_step_to_step/processors/glue.py:379
Method
get_train_examples
See base class.
bert_read_step_to_step/processors/glue.py:421
Method
get_train_examples
See base class.
bert_read_step_to_step/processors/glue.py:459
Method
get_train_examples
See base class.
bert_read_step_to_step/processors/glue.py:490
Method
get_train_examples
See base class.
bert_read_step_to_step/processors/glue.py:557
Method
get_train_examples
See base class.
bert_read_step_to_step/processors/glue.py:590
Method
get_train_examples
See base class.
bert_read_step_to_step/processors/glue.py:622
Method
get_varlen_iter
(self, start=0, std=5, min_len=5, max_deviation=3)
bert_read_step_to_step/transformers/tokenization_transfo_xl.py:314
Function
glue_convert_examples_to_features
Loads a data file into a list of ``InputFeatures`` Args: examples: List of ``InputExamples`` or ``tf.data.Dataset`` containing the ex
bert_read_step_to_step/processors/glue.py:50
Method
hidden_size
(self)
bert_read_step_to_step/transformers/configuration_ctrl.py:134
Method
hidden_size
(self)
bert_read_step_to_step/transformers/configuration_openai.py:125
Method
hidden_size
(self)
bert_read_step_to_step/transformers/configuration_xlm.py:172
Method
hidden_size
(self)
bert_read_step_to_step/transformers/configuration_distilbert.py:80
Method
hidden_size
(self)
bert_read_step_to_step/transformers/configuration_xlnet.py:161
Method
hidden_size
(self)
bert_read_step_to_step/transformers/configuration_transfo_xl.py:159
Method
hidden_size
(self)
bert_read_step_to_step/transformers/configuration_gpt2.py:135
Function
hook
(module, input, output=None)
bert_read_step_to_step/tools/common.py:262
Function
if_exist
(var)
bert_read_step_to_step/convert_ernie_original_pad_checkpoint_to_pytorch.py:95
Method
init_mems
(self, data)
bert_read_step_to_step/transformers/modeling_transfo_xl.py:861
Function
load_json
加载json文件 :param json_path: :param file_name: :return:
bert_read_step_to_step/tools/common.py:168
Function
load_model
加载模型 :param model: :param model_name: :param model_path: :param only_param: :return:
bert_read_step_to_step/tools/common.py:197
Function
load_pickle
读取pickle文件 :param pickle_path: :param file_name: :return:
bert_read_step_to_step/tools/common.py:140
Function
load_tf_weights_in_gpt2
Load tf checkpoints in a pytorch model
bert_read_step_to_step/transformers/modeling_gpt2.py:44
Function
load_tf_weights_in_openai_gpt
Load tf pre-trained weights in a pytorch model (from NumPy arrays here)
bert_read_step_to_step/transformers/modeling_openai.py:42
Function
load_tf_weights_in_transfo_xl
Load tf checkpoints in a pytorch model
bert_read_step_to_step/transformers/modeling_transfo_xl.py:120
Method
lr_lambda
(self, step)
bert_read_step_to_step/transformers/optimization.py:42
Method
lr_lambda
(self, step)
bert_read_step_to_step/transformers/optimization.py:58
Method
lr_lambda
(self, step)
bert_read_step_to_step/transformers/optimization.py:76
Method
lr_lambda
(self, step)
bert_read_step_to_step/transformers/optimization.py:96
Function
lru_cache
()
bert_read_step_to_step/transformers/tokenization_roberta.py:33
Function
lru_cache
()
bert_read_step_to_step/transformers/tokenization_gpt2.py:31
Method
mask_token
Mask token (string). E.g. when training a model with masked-language modeling. Log an error if used while not having been set.
bert_read_step_to_step/transformers/tokenization_utils.py:122
Method
mask_token_id
Id of the mask token in the vocabulary. E.g. when training a model with masked-language modeling. Log an error if used while not having been set.
bert_read_step_to_step/transformers/tokenization_utils.py:198
Method
max_position_embeddings
(self)
bert_read_step_to_step/transformers/configuration_ctrl.py:130
Method
max_position_embeddings
(self)
bert_read_step_to_step/transformers/configuration_openai.py:121
Method
max_position_embeddings
(self)
bert_read_step_to_step/transformers/configuration_xlnet.py:149
Method
max_position_embeddings
(self)
bert_read_step_to_step/transformers/configuration_transfo_xl.py:147
Method
max_position_embeddings
(self)
bert_read_step_to_step/transformers/configuration_gpt2.py:131
Function
model_device
判断环境 cpu还是gpu 支持单机多卡 :param n_gpu: :param model: :return:
bert_read_step_to_step/tools/common.py:85
Method
num_attention_heads
(self)
bert_read_step_to_step/transformers/configuration_ctrl.py:138
Method
num_attention_heads
(self)
bert_read_step_to_step/transformers/configuration_openai.py:129
Method
num_attention_heads
(self)
bert_read_step_to_step/transformers/configuration_xlm.py:176
Method
num_attention_heads
(self)
bert_read_step_to_step/transformers/configuration_distilbert.py:84
Method
num_attention_heads
(self)
bert_read_step_to_step/transformers/configuration_xlnet.py:165
Method
num_attention_heads
(self)
bert_read_step_to_step/transformers/configuration_transfo_xl.py:163
Method
num_attention_heads
(self)
bert_read_step_to_step/transformers/configuration_gpt2.py:139
Method
num_hidden_layers
(self)
bert_read_step_to_step/transformers/configuration_ctrl.py:142
Method
num_hidden_layers
(self)
bert_read_step_to_step/transformers/configuration_openai.py:133
Method
num_hidden_layers
(self)
bert_read_step_to_step/transformers/configuration_xlm.py:180
Method
num_hidden_layers
(self)
bert_read_step_to_step/transformers/configuration_distilbert.py:88
Method
num_hidden_layers
(self)
bert_read_step_to_step/transformers/configuration_xlnet.py:169
Method
num_hidden_layers
(self)
bert_read_step_to_step/transformers/configuration_transfo_xl.py:167
Method
num_hidden_layers
(self)
bert_read_step_to_step/transformers/configuration_gpt2.py:143
Method
pad_token
Padding token (string). Log an error if used while not having been set.
bert_read_step_to_step/transformers/tokenization_utils.py:108
Method
pad_token_id
Id of the padding token in the vocabulary. Log an error if used while not having been set.
bert_read_step_to_step/transformers/tokenization_utils.py:188
Function
predict
(args, model, tokenizer, prefix="")
bert_read_step_to_step/run_classifier.py:224
Function
print_config
(config)
bert_read_step_to_step/tools/common.py:13
Method
prune_heads
(self, heads)
bert_read_step_to_step/transformers/modeling_xlnet.py:226
Function
prune_layer
Prune a Conv1D or nn.Linear layer (a model parameters) to keep only entries in index. Return the pruned layer as a new layer with requires_gr
bert_read_step_to_step/transformers/modeling_utils.py:807
Function
register_hook
(module)
bert_read_step_to_step/tools/common.py:261
Method
rel_shift
perform relative shift to form the relative attention score.
bert_read_step_to_step/transformers/modeling_xlnet.py:230
Method
reset_length
(self, tgt_len, ext_len, mem_len)
bert_read_step_to_step/transformers/modeling_transfo_xl.py:858
Method
resize_token_embeddings
Resize input token embeddings matrix of the model if new_num_tokens != config.vocab_size. Take care of tying weights embeddings afterwards if
bert_read_step_to_step/transformers/modeling_utils.py:152
Function
restore_checkpoint
加载模型 :param resume_path: :param model: :param optimizer: :return: 注意： 如果是加载Bert模型的话，需要调整，不能使用该模式 可以使用模块自带的Bert_mod
bert_read_step_to_step/tools/common.py:103
Function
s3_request
Wrapper function for s3 requests in order to create more helpful error messages.
bert_read_step_to_step/transformers/file_utils.py:201
Function
save_json
保存成json文件 :param data: :param json_path: :param file_name: :return:
bert_read_step_to_step/tools/common.py:152
← previous
next →
601–700 of 740, ranked by callers