Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/microsoft/LoRA
/ functions
Functions
11,821 in github.com/microsoft/LoRA
⨍
Functions
11,821
◇
Types & classes
3,027
↳
Endpoints
107
↓ 1,116 callers
Method
to
Send all values to device by calling :obj:`v.to(device)` (PyTorch only). Args: device (:obj:`str` or :obj:`torch.device`
examples/NLU/src/transformers/feature_extraction_utils.py:173
↓ 996 callers
Function
model
r""" # Using torch.hub ! import torch model = torch.hub.load('huggingface/transformers', 'model', 'bert-base-unca
examples/NLU/hubconf.py:71
↓ 746 callers
Method
from_pretrained
r""" Instantiate a :class:`~transformers.ModelCard` from a pre-trained model model card. Parameters: pretrained_model_nam
examples/NLU/src/transformers/modelcard.py:83
↓ 613 callers
Function
shape_list
(*args, **kwargs)
examples/NLU/src/transformers/utils/dummy_tf_objects.py:38
↓ 581 callers
Function
ids_tensor
(shape, vocab_size, rng=None, name=None)
examples/NLU/tests/test_modeling_common.py:1224
↓ 563 callers
Function
requires_pytorch
(obj)
examples/NLU/src/transformers/file_utils.py:510
↓ 436 callers
Method
convert_to_tensor
(self, symbols)
examples/NLU/src/transformers/models/transfo_xl/tokenization_transfo_xl.py:462
↓ 419 callers
Method
items
(self)
examples/NLU/src/transformers/feature_extraction_utils.py:107
↓ 404 callers
Method
eval
(**kwargs)
examples/NLU/tests/test_flax_auto.py:62
↓ 371 callers
Method
keys
(self)
examples/NLU/src/transformers/feature_extraction_utils.py:99
↓ 369 callers
Method
pop
(self, *args, **kwargs)
examples/NLU/src/transformers/file_utils.py:1567
↓ 357 callers
Function
requires_tf
(obj)
examples/NLU/src/transformers/file_utils.py:522
↓ 354 callers
Function
is_torch_available
()
examples/NLU/src/transformers/file_utils.py:256
↓ 310 callers
Method
replace
(original_file: str, line_to_copy_below: str, lines_to_copy: List[str])
examples/NLU/src/transformers/commands/add_new_model.py:175
↓ 281 callers
Method
encode
(self, text)
examples/NLU/src/transformers/models/deberta/tokenization_deberta.py:165
↓ 242 callers
Function
get_initializer
Creates a :obj:`tf.initializers.TruncatedNormal` with the given range. Args: initializer_range (`float`, defaults to 0.02): Standard
examples/NLU/src/transformers/modeling_tf_utils.py:1595
↓ 235 callers
Method
from_pretrained
(cls, pretrained_model_name_or_path: str, **kwargs)
examples/NLU/examples/research_projects/lxmert/utils.py:178
↓ 226 callers
Function
is_tf_available
()
examples/NLU/src/transformers/file_utils.py:269
↓ 210 callers
Method
init_weights
(self)
examples/NLU/src/transformers/models/dpr/modeling_dpr.py:202
↓ 197 callers
Method
detach
Need to document this
examples/NLU/examples/research_projects/bertabs/modeling_bertabs.py:573
↓ 180 callers
Function
input_processing
Process the input of each TensorFlow model including the booleans. In case of a list of symbolic inputs, each input has to be named according
examples/NLU/src/transformers/modeling_tf_utils.py:311
↓ 180 callers
Method
save_pretrained
Save a model card object to the directory or file `save_directory_or_file`.
examples/NLU/src/transformers/modelcard.py:71
↓ 166 callers
Function
tokenizer
r""" # Using torch.hub ! import torch tokenizer = torch.hub.load('huggingface/transformers', 'tokenizer', 'bert-base-uncased'
examples/NLU/hubconf.py:57
↓ 157 callers
Method
generate
r""" Generates sequences for models with a language modeling head. The method currently supports greedy decoding, multinomial sampling
examples/NLU/src/transformers/generation_utils.py:658
↓ 153 callers
Method
load
(module: nn.Module, prefix="")
examples/NLU/src/transformers/modeling_utils.py:1114
↓ 137 callers
Method
decode
(self, *args, **kwargs)
examples/NLU/src/transformers/models/rag/tokenization_rag.py:68
↓ 116 callers
Method
update
(self, *args, **kwargs)
examples/NLU/src/transformers/file_utils.py:1570
↓ 112 callers
Method
tokenize
Tokenize the provided input and eventually returns corresponding tokens id: - **text_input**: String to tokenize - **return_ids**: Bo
examples/NLU/src/transformers/commands/serving.py:177
↓ 102 callers
Method
values
(self)
examples/NLU/src/transformers/feature_extraction_utils.py:103
↓ 101 callers
Method
encode_plus
Prepare a table and a string for the model. Args: table (:obj:`pd.DataFrame`): Table containing tabular
examples/NLU/src/transformers/models/tapas/tokenization_tapas.py:905
↓ 99 callers
Method
convert_tokens_to_ids
Converts a token string (or a sequence of tokens) in a single integer id (or a sequence of ids), using the vocabulary. Args:
examples/NLU/src/transformers/tokenization_utils.py:354
↓ 85 callers
Method
batch_decode
(self, *args, **kwargs)
examples/NLU/src/transformers/models/rag/tokenization_rag.py:65
↓ 85 callers
Method
batch_encode_plus
Prepare a table and a list of strings for the model. .. warning:: This method is deprecated, ``__call__`` should be used
examples/NLU/src/transformers/models/tapas/tokenization_tapas.py:641
↓ 85 callers
Method
run_common_tests
(self)
examples/NLU/tests/test_configuration_common.py:75
↓ 81 callers
Method
train
Main training entry point. Args: resume_from_checkpoint (:obj:`str` or :obj:`bool`, `optional`): If a :o
examples/NLU/src/transformers/trainer.py:824
↓ 71 callers
Method
get_output_embeddings
Returns the model's output embeddings. Returns: :obj:`nn.Module`: A torch module mapping hidden states to vocabulary.
examples/NLU/src/transformers/modeling_utils.py:485
↓ 69 callers
Function
prune_linear_layer
Prune a linear layer to keep only entries in index. Used to remove heads. Args: layer (:obj:`torch.nn.Linear`): The layer to pr
examples/NLU/src/transformers/modeling_utils.py:1661
↓ 68 callers
Method
__init__
(self, hidden_size)
examples/NLU/tests/test_trainer.py:197
↓ 67 callers
Function
is_tokenizers_available
()
examples/NLU/src/transformers/file_utils.py:330
↓ 67 callers
Function
requires_tokenizers
(obj)
examples/NLU/src/transformers/file_utils.py:534
↓ 66 callers
Function
get_tf_activation
(activation_string)
examples/NLU/src/transformers/activations_tf.py:90
↓ 65 callers
Method
prepare_config_and_inputs_for_common
(self)
examples/NLU/tests/test_modeling_fsmt.py:102
↓ 62 callers
Method
compute_loss
(self, labels: tf.Tensor, logits: tf.Tensor)
examples/NLU/src/transformers/models/bert/modeling_tf_bert.py:103
↓ 62 callers
Method
decoder
:obj:`tokenizers.decoders.Decoder`: The Rust decoder for this tokenizer.
examples/NLU/src/transformers/tokenization_utils_fast.py:158
↓ 62 callers
Method
save
(self, saveas=None)
examples/NLU/examples/research_projects/lxmert/visualizing_image.py:194
↓ 61 callers
Method
save
Save the provided data object with the representation for the current :class:`~transformers.pipelines.PipelineDataFormat`. A
examples/NLU/src/transformers/pipelines/base.py:198
↓ 60 callers
Method
get_tokenizers
(self, fast=True, **kwargs)
examples/NLU/tests/test_tokenization_common.py:150
↓ 60 callers
Method
to_tuple
Convert self to a tuple containing all the attributes/keys that are not ``None``.
examples/NLU/src/transformers/file_utils.py:1592
↓ 59 callers
Method
get_input_embeddings
(self)
examples/NLU/src/transformers/models/t5/modeling_t5.py:835
↓ 59 callers
Method
run
(self)
examples/NLU/src/transformers/commands/run.py:95
↓ 59 callers
Function
shape_list
copied from transformers.modeling_tf_utils
examples/NLU/tests/test_modeling_tf_longformer.py:40
↓ 58 callers
Method
apply
Args: inputs (`torch.FloatTensor`) The input matrix from which the binarizer computes the binary mask.
examples/NLU/examples/research_projects/movement-pruning/emmental/modules/binarizer.py:121
↓ 57 callers
Method
get_bias
Dict of bias attached to an LM head. The key represents the name of the bias attribute. Return: :obj:`tf.Variable`: The
examples/NLU/src/transformers/modeling_tf_utils.py:764
↓ 57 callers
Method
read
(self, n=-1)
examples/NLU/src/transformers/commands/lfs.py:135
↓ 54 callers
Function
pipeline
Utility factory method to build a :class:`~transformers.Pipeline`. Pipelines are made of: - A :doc:`tokenizer <tokenizer>` in charg
examples/NLU/src/transformers/pipelines/__init__.py:241
↓ 54 callers
Method
update
The main method to update the progress bar to :obj:`value`. Args: value (:obj:`int`): The value to use.
examples/NLU/src/transformers/utils/notebook.py:126
↓ 51 callers
Method
log
Log :obj:`logs` on the various objects watching training. Subclass and override this method to inject custom behavior. Args
examples/NLU/src/transformers/trainer.py:1403
↓ 50 callers
Method
tokenize
Basic Tokenization of a piece of text. Split on "white spaces" only, for sub-word tokenization, see WordPieceTokenizer. Args
examples/NLU/src/transformers/models/bert/tokenization_bert.py:383
↓ 49 callers
Function
get_regression_trainer
(a=0, b=0, double_output=False, train_len=64, eval_len=64, pretrained=True, **kwargs)
examples/NLU/tests/test_trainer.py:210
↓ 48 callers
Method
_prepare_for_class
(self, inputs_dict, model_class, return_labels=False)
examples/NLU/tests/test_modeling_xlm.py:354
↓ 48 callers
Function
is_sentencepiece_available
()
examples/NLU/src/transformers/file_utils.py:320
↓ 47 callers
Method
pad
When used in normal mode, this method forwards all its arguments to Wav2Vec2FeatureExtractor's :meth:`~transformers.Wav2Vec2FeatureEx
examples/NLU/src/transformers/models/wav2vec2/processing_wav2vec2.py:119
↓ 45 callers
Method
add
Add a new hypothesis to the list.
examples/NLU/src/transformers/generation_tf_utils.py:1114
↓ 44 callers
Method
_prepare_for_class
(self, inputs_dict, model_class, return_labels=False)
examples/NLU/tests/test_modeling_tf_common.py:89
↓ 43 callers
Method
_prepare_for_class
(self, inputs_dict, model_class, return_labels=False)
examples/NLU/tests/test_modeling_common.py:75
↓ 41 callers
Function
is_main_process
Whether or not the current process is the local process, based on `xm.get_ordinal()` (for TPUs) first, then on `local_rank`.
examples/NLU/src/transformers/trainer_utils.py:202
↓ 40 callers
Method
close
(self)
examples/NLU/src/transformers/hf_api.py:205
↓ 40 callers
Method
convert_ids_to_tokens
(self, ids: int, skip_special_tokens: bool = False)
examples/NLU/src/transformers/tokenization_utils.py:656
↓ 40 callers
Method
from_pretrained
r""" Examples:: >>> from transformers import AutoConfig, AutoModel >>> # Download model and configuration from hugg
examples/NLU/src/transformers/models/auto/modeling_auto.py:788
↓ 39 callers
Method
get_auto_remove_tmp_dir
Args: tmp_dir (:obj:`string`, `optional`): if :obj:`None`: - a unique temporary path will be
examples/NLU/src/transformers/testing_utils.py:793
↓ 39 callers
Method
model
(self)
examples/NLU/src/transformers/data/test_generation_utils.py:38
↓ 38 callers
Method
pad
(self, images)
examples/NLU/examples/research_projects/lxmert/processing_image.py:84
↓ 37 callers
Method
get_decoder
(self)
examples/NLU/src/transformers/models/t5/modeling_t5.py:1247
↓ 37 callers
Method
parse_args_into_dataclasses
Parse command-line args into instances of the specified dataclass types. This relies on argparse's `ArgumentParser.parse_known_args`
examples/NLU/src/transformers/hf_argparser.py:141
↓ 36 callers
Function
_get_word_embedding_weight
(model, embedding_layer)
examples/NLU/templates/adding_a_new_model/cookiecutter-template-{{cookiecutter.modelname}}/test_modeling_tf_{{cookiecutter.lowercase_modelname}}.py:518
↓ 36 callers
Function
requires_sentencepiece
(obj)
examples/NLU/src/transformers/file_utils.py:540
↓ 35 callers
Method
resize_token_embeddings
Resizes input token embeddings matrix of the model if :obj:`new_num_tokens != config.vocab_size`. Takes care of tying weights embedd
examples/NLU/src/transformers/modeling_utils.py:603
↓ 34 callers
Method
_read_tsv
Reads a tab separated value file.
examples/NLU/src/transformers/data/processors/utils.py:120
↓ 34 callers
Method
device
:obj:`torch.device`: The device on which the module is (assuming that all the module parameters are on the same device).
examples/NLU/src/transformers/modeling_utils.py:173
↓ 33 callers
Method
build_inputs_with_special_tokens
Build model inputs from a sequence or a pair of sequence for sequence classification tasks by concatenating and adding special tokens
examples/NLU/src/transformers/models/t5/tokenization_t5.py:203
↓ 33 callers
Function
create_custom_forward
(module)
examples/NLU/templates/adding_a_new_model/cookiecutter-template-{{cookiecutter.modelname}}/modeling_{{cookiecutter.lowercase_modelname}}.py:539
↓ 33 callers
Method
get_vocab
(self)
examples/NLU/src/transformers/models/t5/tokenization_t5.py:136
↓ 31 callers
Function
is_torch_tpu_available
()
examples/NLU/src/transformers/file_utils.py:281
↓ 30 callers
Method
backward
(ctx, grad_output)
examples/NLU/src/transformers/models/ibert/quant_modules.py:695
↓ 30 callers
Method
evaluate
Run evaluation and returns metrics. The calling script will be responsible for providing a method to compute metrics, as they are ta
examples/NLU/src/transformers/trainer.py:1644
↓ 30 callers
Method
is_world_process_zero
Whether or not this process is the global main process (when training in a distributed fashion on several machines, this is only goin
examples/NLU/src/transformers/trainer.py:1515
↓ 30 callers
Method
prepare_config_and_inputs
(self)
examples/NLU/tests/test_modeling_fsmt.py:74
↓ 30 callers
Function
set_seed
Helper function for reproducible behavior to set the seed in ``random``, ``numpy``, ``torch`` and/or ``tf`` (if installed). Args:
examples/NLU/src/transformers/trainer_utils.py:48
↓ 30 callers
Method
zero_grad
(self)
examples/NLU/examples/research_projects/bertabs/modeling_bertabs.py:1047
↓ 29 callers
Method
to_dict
Serializes this instance to a Python dictionary.
examples/NLU/src/transformers/modelcard.py:203
↓ 28 callers
Method
__init__
(self, feat_size, epsilon=None, **kwargs)
examples/NLU/src/transformers/models/mobilebert/modeling_tf_mobilebert.py:96
↓ 28 callers
Method
get_encoder
(self)
examples/NLU/src/transformers/models/t5/modeling_t5.py:1244
↓ 28 callers
Method
save_metrics
(self, latest_metrics, type_path)
examples/NLU/examples/research_projects/rag/finetune_rag.py:310
↓ 27 callers
Method
__init__
(self, feat_size, eps=None)
examples/NLU/src/transformers/models/mobilebert/modeling_mobilebert.py:149
↓ 27 callers
Method
from_pretrained
(cls, retriever_name_or_path, actor_handles, indexed_dataset=None, **kwargs)
examples/NLU/examples/research_projects/rag/distributed_ray_retriever.py:136
↓ 27 callers
Method
get_rust_tokenizer
(self, **kwargs)
examples/NLU/tests/test_tokenization_t5.py:128
↓ 27 callers
Method
train
The real training loop.
examples/NLU/examples/research_projects/distillation/distiller.py:330
↓ 26 callers
Method
print_fn
(self)
examples/NLU/src/transformers/benchmark/benchmark_utils.py:630
↓ 25 callers
Method
backward
(ctx, grad)
examples/NLU/examples/research_projects/lxmert/modeling_frcnn.py:412
↓ 25 callers
Method
from_dict
Constructs a `ModelCard` from a Python dictionary of parameters.
examples/NLU/src/transformers/modelcard.py:185
next →
1–100 of 11,821, ranked by callers