Functions — github.com/cedrickchee/transformers-llama

hub / github.com/cedrickchee/transformers-llama / functions

Functions36,568 in github.com/cedrickchee/transformers-llama

⨍ Functions 36,568◇ Types & classes 9,398↳ Endpoints 539

↓ 22 callersMethodtokenizer_integration_test_util

Util for integration test. Text is tokenized and then reverted back to text. Both results are then checked. Args:

tests/test_tokenization_common.py:224

↓ 21 callersMethod__init__

(self, config)

src/transformers/models/luke/modeling_luke.py:712

↓ 21 callersMethod__init__

(self, output_dim, mode="dense", **kwargs)

src/transformers/models/data2vec/modeling_tf_data2vec_vision.py:1051

↓ 21 callersMethod__init__

(self, config)

src/transformers/models/sew_d/modeling_sew_d.py:978

↓ 21 callersMethod__init__

(self, config)

src/transformers/models/fnet/modeling_fnet.py:252

↓ 21 callersMethod__init__

(self, config)

src/transformers/models/qdqbert/modeling_qdqbert.py:461

↓ 21 callersMethodconvolution

(self, hidden_state: tf.Tensor)

src/transformers/models/resnet/modeling_tf_resnet.py:65

↓ 21 callersMethodget_table

(self, tokenizer, length=5)

tests/models/tapex/test_tokenization_tapex.py:58

↓ 21 callersFunctionis_scipy_available

()

src/transformers/utils/import_utils.py:556

↓ 21 callersFunctionmockenv_context

Temporarily updates the `os.environ` dictionary in-place. Similar to mockenv The `os.environ` dictionary is updated in-place so that the mod

src/transformers/testing_utils.py:1314

↓ 20 callersMethod__init__

(self, config: BeitConfig, window_size: Optional[tuple] = None, drop_path_rate: float = 0.0)

src/transformers/models/beit/modeling_beit.py:376

↓ 20 callersMethod__init__

Args: in_dim: The final dimension of inputs to the layer out_dim: The final dimension

src/transformers/models/esm/modeling_esmfold.py:274

↓ 20 callersMethod__init__

(self, config: DebertaConfig, **kwargs)

src/transformers/models/deberta/modeling_tf_deberta.py:252

↓ 20 callersMethod__init__

(self, config: DebertaV2Config, **kwargs)

src/transformers/models/deberta_v2/modeling_tf_deberta_v2.py:239

↓ 20 callersMethod__init__

Creates an index. Args: indices: <int32> Tensor of indices, same shape as `values`. num_segments: <int32> Scalar

src/transformers/models/tapas/modeling_tf_tapas.py:1718

↓ 20 callersMethod__init__

(self, config: RoFormerConfig, **kwargs)

src/transformers/models/roformer/modeling_tf_roformer.py:414

↓ 20 callersMethod__init__

(self, config: ElectraConfig, **kwargs)

src/transformers/models/electra/modeling_tf_electra.py:297

↓ 20 callersMethod__init__

(self, config, **kwargs)

src/transformers/models/lxmert/modeling_tf_lxmert.py:432

↓ 20 callersMethod__init__

(self)

src/transformers/models/lxmert/modeling_lxmert.py:52

↓ 20 callersMethod__init__

(self, input_dim, hidden_dim, output_dim, num_layers)

src/transformers/models/conditional_detr/modeling_conditional_detr.py:1045

↓ 20 callersFunctioncheck_and_map_params

(hf_param, gluon_param)

src/transformers/models/bort/convert_bort_original_gluonnlp_checkpoint_to_pytorch.py:178

↓ 20 callersFunctiondefault_data_collator

Very simple data collator that simply collates batches of dict-like objects and performs special handling for potential keys named:

src/transformers/data/data_collator.py:52

↓ 20 callersMethodfrom_pretrained

(cls, retriever_name_or_path, actor_handles, indexed_dataset=None, **kwargs)

examples/research_projects/rag-end2end-retriever/distributed_ray_retriever.py:149

↓ 20 callersFunctionis_tf_tensor

Tests if `x` is a tensorflow tensor or not. Safe to call even if tensorflow is not installed.

src/transformers/utils/generic.py:147

↓ 20 callersMethodmodel

(self)

tests/models/t5/test_modeling_t5.py:887

↓ 20 callersMethodprepare

(self, image, target, return_segmentation_masks=None, masks_path=None)

src/transformers/models/deta/image_processing_deta.py:543

↓ 20 callersMethodshape

projection

src/transformers/models/t5/modeling_t5.py:483

↓ 20 callersMethodto_numpy_array

Converts `image` to a numpy array. Optionally rescales it and puts the channel dimension as the first dimension. Args:

src/transformers/image_utils.py:350

↓ 20 callersMethodtokenize

Basic Tokenization of a piece of text. Split on "white spaces" only, for sub-word tokenization, see WordPieceTokenizer. Args

src/transformers/models/roc_bert/tokenization_roc_bert.py:944

↓ 20 callersMethodtokenize

Basic Tokenization of a piece of text. Split on "white spaces" only, for sub-word tokenization, see WordPieceTokenizer. Args

src/transformers/models/tapas/tokenization_tapas.py:2068

↓ 19 callersMethod__init__

(self, config)

src/transformers/models/realm/modeling_realm.py:461

↓ 19 callersMethod__init__

( self, config: GroupViTVisionConfig, hidden_size: Optional[int] = None, inter

src/transformers/models/groupvit/modeling_tf_groupvit.py:715

↓ 19 callersMethod__init__

(self, config: HubertConfig, *inputs, **kwargs)

src/transformers/models/hubert/modeling_tf_hubert.py:1291

↓ 19 callersMethod__init__

(self, config)

src/transformers/models/roc_bert/modeling_roc_bert.py:519

↓ 19 callersMethod__init__

( self, config: Data2VecVisionConfig, window_size: Optional[tuple] = None, drop_path_rate: float = 0.0

src/transformers/models/data2vec/modeling_data2vec_vision.py:384

↓ 19 callersMethod__init__

(self, config)

src/transformers/models/deberta_v2/modeling_deberta_v2.py:381

↓ 19 callersMethod__init__

(self, config: Wav2Vec2Config, *inputs, **kwargs)

src/transformers/models/wav2vec2/modeling_tf_wav2vec2.py:1319

↓ 19 callersMethod__init__

(self, config)

src/transformers/models/roformer/modeling_roformer.py:448

↓ 19 callersMethod__init__

(self, config: AlignConfig)

src/transformers/models/align/modeling_align.py:1419

↓ 19 callersMethod__init__

(self, scale, num_features)

src/transformers/models/swin2sr/modeling_swin2sr.py:971

↓ 19 callersMethod__init__

(self, config, **kwargs)

src/transformers/models/convbert/modeling_tf_convbert.py:435

↓ 19 callersMethod_prepare_for_class

(self, inputs_dict, model_class, return_labels=False)

tests/models/deit/test_modeling_deit.py:265

↓ 19 callersMethod_prepare_for_class

(self, inputs_dict, model_class, return_labels=False)

tests/models/deformable_detr/test_modeling_deformable_detr.py:203

↓ 19 callersMethodget_input_embeddings

(self)

examples/research_projects/deebert/src/modeling_highway_bert.py:123

↓ 19 callersFunctionis_offline_mode

()

src/transformers/utils/hub.py:70

↓ 19 callersMethoditems

(self)

src/transformers/tokenization_utils_base.py:268

↓ 19 callersMethodnum_special_tokens_to_add

Just EOS

src/transformers/models/marian/tokenization_marian.py:373

↓ 19 callersMethodprepare_config_and_inputs

(self)

tests/models/switch_transformers/test_modeling_switch_transformers.py:108

↓ 19 callersFunctionreshape

Framework-agnostic version of `numpy.reshape` that will work on torch/TensorFlow/Jax tensors as well as NumPy arrays.

src/transformers/utils/generic.py:450

↓ 19 callersMethodtie_weights

Tie the weights between the input embeddings and the output embeddings. If the `torchscript` flag is set in the configuration, can't

src/transformers/modeling_utils.py:1217

↓ 18 callersMethod__init__

(self, config)

src/transformers/models/altclip/modeling_altclip.py:826

↓ 18 callersMethod__init__

(self, config: RobertaConfig, **kwargs)

src/transformers/models/roberta/modeling_tf_roberta.py:425

↓ 18 callersMethod__init__

(self, config: RobertaPreLayerNormConfig, **kwargs)

src/transformers/models/roberta_prelayernorm/modeling_tf_roberta_prelayernorm.py:429

↓ 18 callersMethod__init__

(self, config: RemBertConfig, **kwargs)

src/transformers/models/rembert/modeling_tf_rembert.py:376

↓ 18 callersMethod__init__

(self, config)

src/transformers/models/rembert/modeling_rembert.py:415

↓ 18 callersMethod__init__

(self, config)

src/transformers/models/xmod/modeling_xmod.py:437

↓ 18 callersMethod__init__

(self, config)

src/transformers/models/deberta/modeling_deberta.py:368

↓ 18 callersMethod__init__

(self, config, layer_id=0)

src/transformers/models/data2vec/modeling_data2vec_audio.py:1351

↓ 18 callersMethod__init__

(self, config, layer_id=0)

src/transformers/models/reformer/modeling_reformer.py:1416

↓ 18 callersMethod__init__

(self, config: UniSpeechConfig)

src/transformers/models/unispeech/modeling_unispeech.py:1072

↓ 18 callersMethod__init__

(self, config: CamembertConfig, **kwargs)

src/transformers/models/camembert/modeling_tf_camembert.py:520

↓ 18 callersMethod__init__

(self, config)

src/transformers/models/vilt/modeling_vilt.py:478

↓ 18 callersMethod__init__

(self, config: XLMRobertaConfig, **kwargs)

src/transformers/models/xlm_roberta/modeling_tf_xlm_roberta.py:514

↓ 18 callersMethod__init__

(self, config: MobileViTConfig, **kwargs)

src/transformers/models/mobilevit/modeling_tf_mobilevit.py:959

↓ 18 callersMethod__init__

(self, config)

src/transformers/models/visual_bert/modeling_visual_bert.py:355

↓ 18 callersMethod__init__

(self, config)

src/transformers/models/convbert/modeling_convbert.py:547

↓ 18 callersMethod__init__

(self, config)

src/transformers/models/electra/modeling_electra.py:446

↓ 18 callersMethod__init__

(self, config, block_index, **kwargs)

src/transformers/models/funnel/modeling_tf_funnel.py:577

↓ 18 callersMethod__init__

( self, config, dim, input_resolution: Tuple[int, int], num_heads: int, shift_size: int = 0, **kwargs

src/transformers/models/swin/modeling_tf_swin.py:651

↓ 18 callersMethod__init__

( self, config, local, always_attend_to_first_position, first_position

src/transformers/models/canine/modeling_canine.py:689

↓ 18 callersMethod__init__

(self, matcher, num_classes, eos_coef, losses)

src/transformers/models/detr/modeling_detr.py:1958

↓ 18 callersMethod_eventual_warn_about_too_long_sequence

Depending on the input and internal state we might trigger a warning about a sequence that is too long for its corresponding model

src/transformers/tokenization_utils_base.py:3548

↓ 18 callersMethod_get_input_ids_and_config

(self)

tests/generation/test_utils.py:82

↓ 18 callersMethodcheck_results_dict_not_empty

(self, results)

tests/benchmark/test_benchmark_tf.py:32

↓ 18 callersMethodget_from_offsets

(offsets, key)

tests/models/wav2vec2/test_tokenization_wav2vec2.py:477

↓ 18 callersMethodis_initialized

Returns `True` if index is already initialized.

src/transformers/models/rag/retrieval_rag.py:75

↓ 18 callersFunctionload_image

Loads `image` to a PIL Image. Args: image (`str` or `PIL.Image.Image`): The image to convert to the PIL Image format.

src/transformers/image_utils.py:252

↓ 18 callersMethodtrain_new_from_iterator

Trains a tokenizer on a new corpus with the same defaults (in terms of special tokens or tokenization pipeline) as the current one.

src/transformers/tokenization_utils_fast.py:605

↓ 18 callersMethodword_to_tokens

Get the encoded token span corresponding to a word in a sequence of the batch. Token spans are returned as a [`~tokenization_utils_b

src/transformers/tokenization_utils_base.py:445

↓ 17 callersMethod__init__

(self, config)

src/transformers/models/yoso/modeling_yoso.py:510

↓ 17 callersMethod__init__

(self, config)

src/transformers/models/tvlt/modeling_tvlt.py:501

↓ 17 callersMethod__init__

(self, config)

src/transformers/models/xlm_roberta_xl/modeling_xlm_roberta_xl.py:373

↓ 17 callersMethod__init__

(self, config)

src/transformers/models/roberta/modeling_roberta.py:385

↓ 17 callersMethod__init__

(self, config, name=None)

src/transformers/models/esm/modeling_tf_esm.py:515

↓ 17 callersMethod__init__

( self, matcher, num_classes, focal_alpha, losses, num_queries

src/transformers/models/deta/modeling_deta.py:2078

↓ 17 callersMethod__init__

(self, config)

src/transformers/models/roberta_prelayernorm/modeling_roberta_prelayernorm.py:387

↓ 17 callersMethod__init__

(self, config)

src/transformers/models/git/modeling_git.py:365

↓ 17 callersMethod__init__

(self, config, layer_id=0, **kwargs)

src/transformers/models/longformer/modeling_tf_longformer.py:1530

↓ 17 callersMethod__init__

(self, config)

src/transformers/models/data2vec/modeling_data2vec_text.py:385

↓ 17 callersMethod__init__

(self, config: ChineseCLIPConfig)

src/transformers/models/chinese_clip/modeling_chinese_clip.py:1349

↓ 17 callersMethod__init__

Creates an index Args: indices (`torch.LongTensor`, same shape as a *values* Tensor to which the indices refer):

src/transformers/models/tapas/modeling_tapas.py:1587

↓ 17 callersMethod__init__

(self, config)

src/transformers/models/camembert/modeling_camembert.py:399

↓ 17 callersMethod__init__

(self)

src/transformers/models/efficientformer/modeling_efficientformer.py:285

↓ 17 callersMethod__init__

(self, config)

src/transformers/models/nystromformer/modeling_nystromformer.py:319

↓ 17 callersMethod__init__

(self)

src/transformers/models/squeezebert/modeling_squeezebert.py:100

↓ 17 callersMethod__init__

(self, config)

src/transformers/models/xlm_roberta/modeling_xlm_roberta.py:386

↓ 17 callersMethod__init__

(self, config: MobileViTConfig)

src/transformers/models/mobilevit/modeling_mobilevit.py:909

↓ 17 callersMethod__init__

(self, config)

src/transformers/models/x_clip/modeling_x_clip.py:294

↓ 17 callersMethod__init__

(self, config: LayoutLMConfig, **kwargs)

src/transformers/models/layoutlm/modeling_tf_layoutlm.py:417

↓ 17 callersMethod__init__

(self, tensors, mask: Optional[Tensor])

src/transformers/models/deformable_detr/modeling_deformable_detr.py:2460

← previous next →301–400 of 36,568, ranked by callers