MCPcopy Create free account

hub / github.com/NVIDIA/FasterTransformer / functions

Functions4,228 in github.com/NVIDIA/FasterTransformer

↓ 2 callersFunctioninput_fn_builder
Creates an `input_fn` closure to be passed to Estimator.
examples/tensorflow/bert/bert-quantization/run_pretraining.py:412
↓ 2 callersFunctioninvokeAddBiasGeluV2
src/fastertransformer/kernels/activation_kernels.h:98
↓ 2 callersFunctioninvokeAddFusedQKVBiasTranspose
src/fastertransformer/kernels/unfused_attention_kernels.h:117
↓ 2 callersFunctionisFusedMHA
src/fastertransformer/layers/attention_layers/BaseAttentionLayer.h:113
↓ 2 callersFunctionisPaddedMHA
src/fastertransformer/layers/attention_layers/BaseAttentionLayer.h:123
↓ 2 callersMethodisValid
src/fastertransformer/utils/Tensor.h:308
↓ 2 callersFunctionis_within_directory
(directory, target)
examples/pytorch/nemo.py:43
↓ 2 callersFunctionjoin
examples/cpp/multi_gpu_gpt/multi_gpu_gpt_async_example.cc:47
↓ 2 callersFunctionkl_loss
(x, y)
examples/tensorflow/bert/bert-quantization/run_squad.py:522
↓ 2 callersFunctionlayer_norm
(input_tensor, name=None)
examples/tensorflow/bert/utils/bert.py:33
↓ 2 callersMethodlisted_weights
(self)
examples/pytorch/vit/VisionTransformerINT8WeightLoader.py:115
↓ 2 callersMethodload
Loads a fragment
src/fastertransformer/cutlass_extensions/include/cutlass_extensions/epilogue/threadblock/epilogue_tensor_op_int32.h:271
↓ 2 callersFunctionloadWeightsPtr
src/fastertransformer/tensorrt_plugin/vit/ViTPlugin.cpp:416
↓ 2 callersFunctionloadWeightsPtrINT8
src/fastertransformer/tensorrt_plugin/vit/ViTINT8Plugin.cpp:431
↓ 2 callersMethodload_articles
(self)
examples/pytorch/bert/bert-quantization-sparsity/data/TextSharding.py:46
↓ 2 callersMethodload_from_model
(self, model)
examples/pytorch/t5/utils/ft_decoding.py:70
↓ 2 callersMethodload_from_model
(self, model)
examples/pytorch/t5/utils/ft_encoder.py:71
↓ 2 callersFunctionload_the_npz_array
examples/cpp/xlnet/cnpy.cpp:215
↓ 2 callersFunctionload_vocab
Loads a vocabulary file into a dictionary.
examples/tensorflow/bert/bert-quantization/tokenization.py:115
↓ 2 callersFunctionlskip
Return pointer to first non-whitespace char in given string. */
3rdparty/INIReader.h:127
↓ 2 callersMethodmerge
(self)
examples/pytorch/bert/bert-quantization-sparsity/data/WikicorpusTextFormatting.py:25
↓ 2 callersFunctionmetric_max_over_ground_truths
(metric_fn, prediction, ground_truths)
examples/tensorflow/bert/tensorflow_bert/squad_evaluate-v1.1.py:60
↓ 2 callersFunctionmetric_max_over_ground_truths
(metric_fn, prediction, ground_truths)
examples/tensorflow/bert/tensorflow_bert/squad_evaluate_v1_1.py:60
↓ 2 callersFunctionmkdir
(path)
examples/pytorch/bert/bert-quantization-sparsity/utils.py:58
↓ 2 callersFunctionmodel_fn_builder
(bert_config, transformer_model_fn)
examples/tensorflow/bert/tensorflow_bert/profile_transformer_inference.py:97
↓ 2 callersFunctionpad_in_time
Helper function to pad a tensor in the time dimension and retain the static depth dimension.
examples/tensorflow/bert/utils/reducer.py:18
↓ 2 callersFunctionpad_in_time
Helper function to pad a tensor in the time dimension and retain the static depth dimension.
examples/tensorflow/decoder/utils/reducer.py:18
↓ 2 callersFunctionpad_in_time
Helper function to pad a tensor in the time dimension and retain the static depth dimension.
examples/tensorflow/common_utils/reducer.py:18
↓ 2 callersFunctionpositionwise_ffn
Position-wise Feed-forward Network.
examples/tensorflow/xlnet/modeling.py:65
↓ 2 callersFunctionpr_re_fbeta
Uses a confusion matrix to compute precision, recall and fbeta
examples/tensorflow/bert/bert-quantization/tf_metrics.py:145
↓ 2 callersFunctionprepare_input
(question, passage_text, seq_len, batch_size, model_dir, data_type)
examples/pytorch/longformer/longformer_qa.py:58
↓ 2 callersFunctionprint_quant_summary
Print summary of all quantizer modules in the model.
examples/pytorch/vit/ViT-quantization/quant_utils.py:216
↓ 2 callersFunctionprint_quant_summary
Print summary of all quantizer modules in the model.
examples/pytorch/bert/bert-quantization-sparsity/quant_utils.py:216
↓ 2 callersMethodproblem_size
src/fastertransformer/cutlass_extensions/include/cutlass_extensions/gemm/kernel/moe_problem_visitor.h:169
↓ 2 callersMethodprof_run
(self)
examples/tensorflow/bert/tensorflow_bert/profile_util.py:32
↓ 2 callersFunctionread_squad_examples
Read a SQuAD json file into a list of SquadExample.
examples/pytorch/bert/bert-quantization-sparsity/run_squad.py:148
↓ 2 callersFunctionread_start_ids
examples/cpp/gpt_fp8/gpt_fp8_example.cc:58
↓ 2 callersFunctionread_swag_examples
(input_file, is_training)
examples/pytorch/bert/bert-quantization-sparsity/run_swag.py:108
↓ 2 callersFunctionrecover_bpe
(src)
examples/tensorflow/t5/translate_example.py:48
↓ 2 callersMethodreplace_encoder
(self, encoder)
examples/pytorch/bert/utils/modeling_bert.py:163
↓ 2 callersMethodreset
(self)
examples/pytorch/vit/ViT-quantization/main.py:51
↓ 2 callersMethodreset
(self)
examples/pytorch/vit/ViT-quantization/eval_engine.py:53
↓ 2 callersFunctionreshape_from_matrix
Reshapes a rank 2 tensor back to its original rank >= 2 tensor.
examples/tensorflow/bert/bert-quantization/modeling.py:1039
↓ 2 callersFunctionrun_swintransformernv_op
(args, config, model, images, data_type)
examples/pytorch/swin/infer_swintransformer_op.py:92
↓ 2 callersFunctionrun_torch
(model, images, mark)
examples/pytorch/vit/infer_visiontransformer_op.py:147
↓ 2 callersFunctionrun_vitnv_op
(args, config, model, images, use_fp16)
examples/pytorch/vit/infer_visiontransformer_op.py:79
↓ 2 callersFunctionrun_warp_mma
src/fastertransformer/cutlass_extensions/include/cutlass_extensions/gemm/threadblock/dq_mma_base.h:56
↓ 2 callersFunctionsafe_extract
(tar, path=".", members=None, *, numeric_owner=False)
examples/pytorch/nemo.py:52
↓ 2 callersMethodsample
inputs: logits: [batch_size, vocab_size], the values of log logits threshold: int when using top_k, and a probabi
examples/tensorflow/decoder/utils/sampling.py:30
↓ 2 callersFunctionsave_bloom_config
Save Bloom model configuration. Args: model_config: HF pretrained model configuration. save_dir: a directory to save the config
examples/pytorch/gpt/utils/huggingface_bloom_convert.py:254
↓ 2 callersMethodsegment_string
(self, article)
examples/pytorch/bert/bert-quantization-sparsity/data/TextSharding.py:325
↓ 2 callersMethodsetAdapterInterSize
src/fastertransformer/models/t5/T5AdapterWeight.h:44
↓ 2 callersMethodsetBartStructureDiff
src/fastertransformer/models/bart/BartEncoderWeight.cc:280
↓ 2 callersMethodsetBartWithBias
src/fastertransformer/models/bart/BartEncoderLayerWeight.cc:302
↓ 2 callersMethodsetT5WithBias
src/fastertransformer/models/t5/T5EncoderLayerWeight.cc:460
↓ 2 callersMethodset_k_partition
src/fastertransformer/cutlass_extensions/include/cutlass_extensions/epilogue/threadblock/epilogue_per_row_per_col_scale.h:211
↓ 2 callersFunctionset_params_struct
src/fastertransformer/kernels/decoder_masked_multihead_attention_fp8_test.cc:39
↓ 2 callersFunctionset_quantizer
Set attributes for mod.quantizer.
examples/pytorch/vit/ViT-quantization/quant_utils.py:255
↓ 2 callersFunctionset_quantizer
Set attributes for mod.quantizer.
examples/pytorch/bert/bert-quantization-sparsity/quant_utils.py:255
↓ 2 callersFunctionset_quantizer
Set attributes for mod.quantizer.
examples/pytorch/swin/Swin-Transformer-Quantization/quant_utils.py:224
↓ 2 callersFunctionset_quantizer_by_name
Set quantizer attributes for layers where name contains a substring in names.
examples/pytorch/vit/ViT-quantization/quant_utils.py:279
↓ 2 callersFunctionset_quantizer_by_name
Set quantizer attributes for layers where name contains a substring in names.
examples/pytorch/bert/bert-quantization-sparsity/quant_utils.py:279
↓ 2 callersFunctionset_quantizer_by_name
Set quantizer attributes for layers where name contains a substring in names.
examples/pytorch/swin/Swin-Transformer-Quantization/quant_utils.py:247
↓ 2 callersFunctionset_seed
(args)
examples/pytorch/vit/ViT-quantization/main.py:119
↓ 2 callersFunctionset_seed
(args)
examples/pytorch/vit/ViT-quantization/eval_engine.py:121
↓ 2 callersFunctionset_tensor_common_1
3rdparty/fp8_qgmma_1x1/utils.h:79
↓ 2 callersFunctionset_tensor_size
3rdparty/fp8_qgmma_1x1/utils.h:160
↓ 2 callersFunctionset_tensor_stride
3rdparty/fp8_qgmma_1x1/utils.h:136
↓ 2 callersMethodset_weight
(self, weight: GptLayerWeights)
examples/pytorch/gpt/utils/gpt_decoder.py:345
↓ 2 callersMethodsetup
src/fastertransformer/layers/sampling_layers/BaseSamplingLayer.cc:112
↓ 2 callersMethodsetup_experts_for_row
(self, num_rows, num_experts, active_experts)
tests/moe/th_moe_unit_tests.py:148
↓ 2 callersMethodslice_args
(self, idx)
examples/pytorch/gpt/utils/bloom.py:158
↓ 2 callersMethodsparse
(self)
examples/pytorch/gpt/utils/gpt.py:546
↓ 2 callersFunctionsplit_s3_path
Split a full s3 path into the bucket name and path.
examples/pytorch/bert/bert-quantization-sparsity/file_utils.py:127
↓ 2 callersMethodstart
(self)
examples/tensorflow/bert/utils/common.py:115
↓ 2 callersMethodstep
(self, parameters)
examples/pytorch/bert/bert-quantization-sparsity/run_squad.py:734
↓ 2 callersMethodstep
(self, parameters)
examples/pytorch/bert/bert-quantization-sparsity/run_glue.py:139
↓ 2 callersFunctionstrncpy0
Version of strncpy that ensures dest (size bytes) is null-terminated. */
3rdparty/INIReader.h:155
↓ 2 callersFunctionsummarize_hf
(datapoint)
examples/pytorch/gpt/gpt_summarization.py:254
↓ 2 callersFunctionsummarize_hf
(datapoint)
examples/pytorch/gpt/opt_summarization.py:252
↓ 2 callersFunctionsummarize_hf
(datapoint)
examples/pytorch/t5/summarization.py:257
↓ 2 callersMethodsummary
(self)
examples/pytorch/gpt/utils/profiler.py:29
↓ 2 callersFunctionsymmetric_quantize_helper
src/fastertransformer/th_op/common/WeightOnlyQuantOps.cc:139
↓ 2 callersFunctiontf_bert
Run the bert transformer layer by TensorFlow. Args: inputs: A tf.Tensor with shape [batch_size, seq_len, hidden_dimension].
examples/tensorflow/bert/utils/bert.py:159
↓ 2 callersFunctiontime_test
(sess, tensor, iterations=100, warmup=True)
examples/tensorflow/decoder/utils/common.py:260
↓ 2 callersMethodtoString
src/fastertransformer/layers/adapter_layers/LinearAdapterLayer.cc:40
↓ 2 callersMethodto_bfloat16
(self)
examples/pytorch/decoding/utils/decoding.py:123
↓ 2 callersMethodto_bfloat16
(self)
examples/pytorch/decoding/utils/ft_decoding.py:117
↓ 2 callersMethodto_bfloat16
(self)
examples/pytorch/decoder/utils/ft_decoder.py:115
↓ 2 callersMethodto_cuda
(self)
examples/pytorch/decoding/utils/decoding.py:107
↓ 2 callersMethodto_cuda
(self)
examples/pytorch/decoding/utils/ft_decoding.py:109
↓ 2 callersMethodto_cuda
(self)
examples/pytorch/decoder/utils/ft_decoder.py:107
↓ 2 callersMethodto_cuda
(self)
examples/pytorch/swin/SwinTransformerWeightTransposeQKVWeight.py:190
↓ 2 callersMethodto_float32
(self)
examples/pytorch/swin/SwinTransformerWeightTransposeQKVWeight.py:194
↓ 2 callersMethodto_half
(self)
examples/pytorch/decoding/utils/decoding.py:115
↓ 2 callersMethodto_half
(self)
examples/pytorch/decoding/utils/ft_decoding.py:113
↓ 2 callersMethodto_half
(self)
examples/pytorch/decoder/utils/ft_decoder.py:111
↓ 2 callersMethodto_half
(self)
examples/pytorch/swin/SwinTransformerWeightTransposeQKVWeight.py:198
↓ 2 callersMethodto_int8
(self, sparse=False, ths_path='./lib/libth_transformer.so')
examples/pytorch/bert/utils/encoder.py:222
↓ 2 callersMethodto_single
(self)
examples/pytorch/t5/utils/ft_decoding.py:417
← previousnext →601–700 of 4,228, ranked by callers