MCPcopy Create free account

hub / github.com/NVIDIA/FasterTransformer / functions

Functions4,228 in github.com/NVIDIA/FasterTransformer

↓ 7 callersMethodinit_optimizer_for_pruning
Call this method to monkey patch optimizer step function so that masks can be applied to gradients and weights during training. You mu
examples/pytorch/bert/bert-quantization-sparsity/apex_sparsity/asp.py:127
↓ 7 callersMethodlayerNormType
src/fastertransformer/layers/adapter_layers/LinearAdapterLayer.h:53
↓ 7 callersMethodmoe_test_helper
(self, dtype, quant_type, rtol, atol, activation_str="gelu", experts_list=[32], hidden_sizes=[1024], inter_siz
tests/moe/th_moe_unit_tests.py:372
↓ 7 callersFunctionprintPerfStructure
Utility function to print customMatmulPerf_t structure
src/fastertransformer/utils/gemm_test/gemm_func.cc:28
↓ 7 callersFunctionrecover_bpe
(src)
examples/pytorch/decoding/utils/recover_bpe.py:17
↓ 7 callersMethodreset
(self)
examples/pytorch/gpt/bloom_lambada.py:113
↓ 7 callersMethodrun
3rdparty/fp8_qgmma_1x1/sharedCubinLoader.h:112
↓ 7 callersFunctionsafe_free
examples/cpp/multi_gpu_gpt/gpt_example_utils.h:87
↓ 7 callersFunctionsavebin
(param, save_path)
examples/pytorch/gptj/utils/gptj_ckpt_convert.py:84
↓ 7 callersFunctionsavebin
(param, save_path)
examples/pytorch/gptj/utils/huggingface_gptj_ckpt_convert.py:16
↓ 7 callersFunctionsetByNpz
examples/cpp/xlnet/xlnet_correctness_example.cc:84
↓ 7 callersFunctionsimple_accuracy
(preds, labels)
examples/pytorch/bert/bert-quantization-sparsity/run_glue.py:102
↓ 7 callersMethodtoString
src/fastertransformer/utils/gemm.cc:50
↓ 7 callersFunctionzero
src/fastertransformer/kernels/decoder_masked_multihead_attention_utils.h:1301
↓ 6 callersMethod__init__
(self, in_features, hidden_features=None, out_features=None, act_layer=nn.GELU, drop=0.)
examples/pytorch/swin/Swin-Transformer-Quantization/models/swin_transformer.py:33
↓ 6 callersMethod__init__
(self, in_features, hidden_features=None, out_features=None, act_layer=nn.GELU, drop=0.)
examples/pytorch/swin/Swin-Transformer-Quantization/models/swin_transformer_v2.py:33
↓ 6 callersFunction__internal_halfraw2_to_float2
tests/unittests/fp8_gemm_test/2022_03_21__fp8_stride_batch_example/include/cuda_fp8.hpp:323
↓ 6 callersFunctionaccuracy
Computes the accuracy over the k top predictions for the specified values of k
examples/pytorch/vit/ViT-quantization/main.py:76
↓ 6 callersMethodcompute_range
calculate min/max values from collector if :func:`MaxCollector <quantization.MaxCollector>` is used, kwargs should be None. if :func:`Hist
examples/tensorflow/bert/bert-quantization/ft-tensorflow-quantization/ft_tensorflow_quantization/python/calib/calibrator.py:73
↓ 6 callersFunctionconv2d
src/fastertransformer/utils/conv2d.h:29
↓ 6 callersFunctionconvert_megatron_to_HF_naming_style_single
(saved_key, name_mapping)
examples/pytorch/t5/utils/megatron_t5_ckpt_convert.py:103
↓ 6 callersMethodconvert_tokens_to_ids
(self, tokens)
examples/tensorflow/bert/bert-quantization/tokenization.py:164
↓ 6 callersFunctioncreate_int_feature
(values)
examples/tensorflow/bert/bert-quantization/utils/create_pretraining_data.py:169
↓ 6 callersFunctiondropout
Perform dropout. Args: input_tensor: float Tensor. dropout_prob: Python float. The probability of dropping out a value (NOT of *keepi
examples/tensorflow/bert/tensorflow_bert/my_modeling.py:350
↓ 6 callersFunctionextract_layers_with_prefix
(model_, prefix)
examples/pytorch/nemo.py:70
↓ 6 callersMethodfrom_args
(cls, args: argparse.Namespace)
examples/pytorch/gpt/utils/bloom.py:67
↓ 6 callersMethodfrom_json_file
Constructs a `BertConfig` from a json file of parameters.
examples/pytorch/bert/bert-quantization-sparsity/modeling.py:286
↓ 6 callersFunctiongetDeviceName
src/fastertransformer/utils/cuda_utils.h:301
↓ 6 callersFunctiongetWeightNum
examples/cpp/swin/functions.h:26
↓ 6 callersFunctionget_args
()
examples/pytorch/gpt/bloom_lambada.py:118
↓ 6 callersMethodget_sentences_per_shard
(self, shard)
examples/pytorch/bert/bert-quantization-sparsity/data/TextSharding.py:138
↓ 6 callersMethodinterleave_tester
(self, quant_type, arch)
tests/weight_only_quant_ops/th_weight_quant_ops_unit_tests.py:49
↓ 6 callersMethodload
(self, checkpoint_path: PathLike, inference_data_type: Optional[Union[str, torch.dty
examples/pytorch/gpt/utils/gpt_decoder.py:865
↓ 6 callersFunctionmetrics_from_confusion_matrix
Precision, Recall and F1 from the confusion matrix Parameters ---------- cm : tf.Tensor of type tf.int32, of shape (num_classes, num_cl
examples/tensorflow/bert/bert-quantization/tf_metrics.py:168
↓ 6 callersFunctionread_word_list
src/fastertransformer/utils/word_list.cc:24
↓ 6 callersMethodresetInterSize
src/fastertransformer/layers/FfnLayer.h:120
↓ 6 callersFunctionsafe_div
Safe division, return 0 if denominator is 0
examples/tensorflow/bert/bert-quantization/tf_metrics.py:137
↓ 6 callersFunctionselect_field
(features, field)
examples/pytorch/bert/bert-quantization-sparsity/run_swag.py:237
↓ 6 callersFunctionsequence_mask
(lengths, max_len=None, is_2d=True)
examples/pytorch/bert/bert_example.py:36
↓ 6 callersFunctionsummarize_ft
(datapoint)
examples/pytorch/t5/summarization.py:230
↓ 6 callersMethodto_json_string
Serializes this instance to a JSON string.
examples/pytorch/bert/bert-quantization-sparsity/modeling.py:300
↓ 6 callersFunctiontransform_trt_mask
src/fastertransformer/th_op/swin/SwinOp.cc:173
↓ 6 callersFunctionunpack_nemo_ckpt
( nemo_archive_path: typing.Union[str, pathlib.Path], out_dir_path: typing.Union[str, pathlib.Path], )
examples/pytorch/nemo.py:29
↓ 5 callersFunction__internal_halfraw_to_float
tests/unittests/fp8_gemm_test/2022_03_21__fp8_stride_batch_example/include/cuda_fp8.hpp:284
↓ 5 callersMethod_map
(self, func)
examples/pytorch/gpt/utils/gpt_decoder.py:180
↓ 5 callersMethodbatchedGemm
src/fastertransformer/utils/gemm.cc:372
↓ 5 callersFunctionbuild_loader
(config, args)
examples/pytorch/vit/ViT-quantization/data.py:69
↓ 5 callersFunctioncalGemmTestBufSizeInByte
src/fastertransformer/utils/gemm_test/gemm_func.cc:855
↓ 5 callersMethodclone
src/fastertransformer/tensorrt_plugin/vit/ViTPlugin.cpp:169
↓ 5 callersMethodcreateCustomComms
src/fastertransformer/triton_backend/t5/T5TritonModel.cc:378
↓ 5 callersMethodcreateModelInstance
src/fastertransformer/triton_backend/t5/T5TritonModel.cc:170
↓ 5 callersMethodcreateNcclParams
src/fastertransformer/triton_backend/transformer_triton_backend.cpp:19
↓ 5 callersMethodcreateSharedWeights
src/fastertransformer/triton_backend/t5/T5TritonModel.cc:301
↓ 5 callersMethodcuLaunchKernel
3rdparty/trt_fused_multihead_attention/cudaDriverWrapper.cpp:132
↓ 5 callersMethodcuda
(self)
examples/pytorch/gptneox/utils/gptneox.py:247
↓ 5 callersFunctiondeserialize
src/fastertransformer/models/bert_fp8/serialize.hpp:57
↓ 5 callersFunctiondeserialize_h2d
src/fastertransformer/models/bert_fp8/serialize.hpp:77
↓ 5 callersFunctiondiv_up
src/fastertransformer/utils/cuda_utils.h:310
↓ 5 callersMethodflops
(self)
examples/pytorch/swin/Swin-Transformer-Quantization/models/swin_transformer.py:463
↓ 5 callersFunctionft_encoder_opennmt
Run the bert transformer layer by FasterTransformer. Args: inputs: A tf.Tensor with shape [batch_size, seq_len, hidden_dimension].
examples/tensorflow/encoder/utils/encoder.py:203
↓ 5 callersMethodgetPipelineParaSize
src/fastertransformer/triton_backend/t5/T5TritonModel.cc:392
↓ 5 callersMethodgetTensorParaSize
src/fastertransformer/triton_backend/t5/T5TritonModel.cc:386
↓ 5 callersMethodget_labels
Gets the list of labels for this data set.
examples/pytorch/bert/bert-quantization-sparsity/processors/glue.py:65
↓ 5 callersFunctionget_rank
()
examples/pytorch/bert/bert-quantization-sparsity/utils.py:20
↓ 5 callersFunctionigemm_config_INT8IO
src/fastertransformer/utils/gemm_test/swin_igemm_func.cc:136
↓ 5 callersFunctioninfer_latency_sli
(threshold)
examples/pytorch/bert/bert-quantization-sparsity/run_glue.py:875
↓ 5 callersFunctionlayer_norm
Run layer normalization on the last dimension of the tensor.
examples/tensorflow/bert/tensorflow_bert/my_modeling.py:368
↓ 5 callersMethodload_from_bin
(self, ckpt_path, model_type)
examples/pytorch/t5/utils/ft_decoding.py:168
↓ 5 callersMethodload_from_bin
(self, ckpt_path, model_type)
examples/pytorch/t5/utils/ft_encoder.py:134
↓ 5 callersFunctionparam2distributed
( pt_param, layer_id, save_dir, dest_key, n_inference_gpus, split_axis, )
examples/pytorch/gptj/utils/gptj_ckpt_convert.py:96
↓ 5 callersFunctionparam2distributed
( pt_param, layer_id, save_dir, dest_key, n_inference_gpus, split_axis, )
examples/pytorch/gptj/utils/huggingface_gptj_ckpt_convert.py:26
↓ 5 callersFunctionpositional_embedding
(pos_seq, inv_freq, bsz=None)
examples/tensorflow/xlnet/modeling.py:54
↓ 5 callersFunctionread_start_ids
examples/cpp/gpt/gpt_example.cc:73
↓ 5 callersFunctionserialize
src/fastertransformer/models/bert_fp8/serialize.hpp:13
↓ 5 callersFunctionserialize_d2h
src/fastertransformer/models/bert_fp8/serialize.hpp:33
↓ 5 callersMethodsize
src/fastertransformer/utils/Tensor.h:320
↓ 5 callersMethodstart
(self, tag)
examples/pytorch/gpt/utils/profiler.py:10
↓ 5 callersMethodstop
(self, tag)
examples/pytorch/gpt/utils/profiler.py:13
↓ 5 callersMethodto_half
(self)
examples/pytorch/t5/utils/ft_decoding.py:413
↓ 5 callersMethodto_half
(self)
examples/pytorch/t5/utils/ft_encoder.py:347
↓ 5 callersMethodtransposeWeight
src/fastertransformer/models/gpt_fp8/GptFP8Weight.cc:222
↓ 5 callersMethodupdate
(self, val, n=1)
examples/pytorch/vit/ViT-quantization/eval_engine.py:59
↓ 4 callersMethodGetSerializeSize
src/fastertransformer/models/vit/ViTWeight.h:156
↓ 4 callersMethod__init__
(self, optimizer, last_epoch=-1)
examples/pytorch/bert/bert-quantization-sparsity/schedulers.py:22
↓ 4 callersFunction_get_best_indices
Get the n-best logits from a list.
examples/pytorch/bert/bert-quantization-sparsity/run_squad.py:683
↓ 4 callersMethod_initialize_model
(self, force_init=False)
examples/pytorch/gpt/utils/gpt_decoder.py:338
↓ 4 callersMethod_map_int8
(self, func)
examples/pytorch/gpt/utils/gpt_decoder.py:188
↓ 4 callersMethod_mask_padded_vocab_weights
(self, weight: torch.Tensor)
examples/pytorch/gpt/utils/gpt_decoder.py:974
↓ 4 callersMethodany
src/fastertransformer/utils/Tensor.h:253
↓ 4 callersFunctionapply_rotary_embedding
src/fastertransformer/kernels/decoder_masked_multihead_attention_utils.h:1355
↓ 4 callersMethodbench_helper
(self, act_type, quant_type, rtol, atol)
tests/gemm_dequantize/th_gemm_dequantize.py:171
↓ 4 callersFunctioncastToFloat
examples/cpp/xlnet/xlnet_correctness_example.cc:62
↓ 4 callersFunctioncheck_quant_type_allowed
src/fastertransformer/th_op/common/WeightOnlyQuantOps.cc:30
↓ 4 callersFunctionconvert_megatron_to_HF_naming_style_multiple
(saved_key, name_mapping)
examples/pytorch/t5/utils/megatron_t5_ckpt_convert.py:112
↓ 4 callersFunctioncreate_record_worker
(filename_prefix, shard_id, output_format='tfrecord')
examples/pytorch/bert/bert-quantization-sparsity/data/bertPrep.py:149
↓ 4 callersFunctioncross_check
(name, tf_val, op_val, atol_threshold)
examples/tensorflow/bert/utils/common.py:90
↓ 4 callersFunctioncustomMatmulRun
src/fastertransformer/utils/gemm_test/encoder_igemm_func.cc:205
↓ 4 callersMethoddequantize_test_helper
(self, weight_type, quant_type)
tests/gemm_dequantize/th_gemm_dequantize.py:22
↓ 4 callersMethoddequantize_test_helper
(self, weight_type, quant_type)
tests/moe/th_moe_unit_tests.py:157
↓ 4 callersMethoddownload_wikicorpus
(self, language)
examples/pytorch/bert/bert-quantization-sparsity/data/Downloader.py:68
← previousnext →201–300 of 4,228, ranked by callers