MCPcopy Create free account

hub / github.com/bytedance/ABQ-LLM / functions

Functions14,558 in github.com/bytedance/ABQ-LLM

↓ 33 callersFunctionload_with_pointer_offset
Loads a fragment from memory
fastertransformer/3rdparty/cutlass/include/cutlass/transform/threadblock/regular_tile_iterator_tensor_op_sm70.h:201
↓ 32 callersFunctionTensorRef_aligned
fastertransformer/3rdparty/cutlass/include/cutlass/tensor_ref.h:397
↓ 32 callersFunctiona
(e)
fastertransformer/3rdparty/cutlass/docs/jquery.js:23
↓ 32 callersFunctiondiffTime
fastertransformer/src/fastertransformer/utils/cuda_utils.h:264
↓ 32 callersFunctionget_workspace_size
fastertransformer/3rdparty/cutlass/include/cutlass/gemm/kernel/grouped_problem_visitor.h:417
↓ 32 callersFunctionis_main_process
()
fastertransformer/examples/pytorch/bert/bert-quantization-sparsity/utils.py:36
↓ 32 callersMethodpush
fastertransformer/3rdparty/cutlass/examples/43_dual_gemm/threadblock/dual_epilogue.h:375
↓ 31 callersMethodat
Returns a reference to the element at a given Coord
fastertransformer/3rdparty/cutlass/include/cutlass/tensor_ref.h:321
↓ 31 callersMethoddecode
(self, tokens)
fastertransformer/examples/pytorch/gpt/utils/gpt_token_encoder.py:141
↓ 31 callersFunctionftNcclAllGather
fastertransformer/src/fastertransformer/utils/nccl_utils.cc:70
↓ 31 callersMethodreset
Replaces the managed object, deleting the old object.
fastertransformer/3rdparty/cutlass/include/cutlass/platform/platform.h:787
↓ 31 callersFunctionstore_with_pointer_offset
Store a fragment to memory
fastertransformer/3rdparty/cutlass/include/cutlass/transform/threadblock/regular_tile_iterator_tensor_op_sm70.h:237
↓ 30 callersFunctionSubstituteTemplate
(template, values)
fastertransformer/3rdparty/cutlass/tools/library/scripts/pycutlass/src/pycutlass/__init__.py:4
↓ 30 callersMethodget
Returns a pointer to the vector starting at the current coordinate
fastertransformer/3rdparty/cutlass/include/cutlass/conv/threadblock/conv3d_fprop_filter_tile_access_iterator_optimized.h:231
↓ 30 callersFunctiongetDevice
fastertransformer/src/fastertransformer/utils/cuda_utils.h:317
↓ 30 callersFunctionsafe_transpose
(param: torch.nn.Parameter)
fastertransformer/examples/pytorch/gpt/utils/huggingface_bloom_convert.py:126
↓ 30 callersMethodvalid
Returns whether access is valid or not
fastertransformer/3rdparty/cutlass/examples/42_fused_multi_head_attention/iterators/predicated_tile_access_iterator_residual_last.h:877
↓ 29 callersMethodbegin
Returns a const iterator
fastertransformer/3rdparty/cutlass/tools/library/src/manifest.cpp:91
↓ 29 callersMethodfrom_pretrained
Instantiate a PreTrainedBertModel from a pre-trained model file. Download and cache the pre-trained model file if needed.
fastertransformer/examples/tensorflow/bert/bert-quantization/tokenization.py:207
↓ 29 callersMethoduniform
Constructs a matrix from a uniform element
fastertransformer/3rdparty/cutlass/include/cutlass/matrix.h:114
↓ 29 callersMethodupdate
(self, update_params: dict)
fastertransformer/examples/pytorch/gpt/utils/gpt.py:742
↓ 28 callersMethodgetPtrWithOffset
fastertransformer/src/fastertransformer/utils/Tensor.h:180
↓ 28 callersMethodisUseSparse
fastertransformer/src/fastertransformer/utils/cublasAlgoMap.cc:217
↓ 28 callersMethodloadModel
fastertransformer/src/fastertransformer/models/bert/BertWeight.cc:120
↓ 28 callersMethodnorm
Returns the sum of squared elements
fastertransformer/3rdparty/cutlass/include/cutlass/matrix.h:571
↓ 28 callersFunctionnp2th
Possibly convert HWIO to OIHW.
fastertransformer/examples/pytorch/vit/ViT-quantization/vit_int8.py:57
↓ 28 callersFunctionnp2th
Possibly convert HWIO to OIHW.
fastertransformer/examples/pytorch/vit/ViT-quantization/ViT-pytorch/models/modeling.py:38
↓ 28 callersMethodstride
Returns the layout object's stride vector
fastertransformer/3rdparty/cutlass/include/cutlass/tensor_ref.h:291
↓ 27 callersFunctionCreateConv2dOperator
(manifest, layout, tile_descriptions, data_type, alignment_constraints, \ conv_kinds = [ConvKind.Fprop, Conv
fastertransformer/3rdparty/cutlass/tools/library/scripts/generator.py:338
↓ 27 callersMethodTensor
fastertransformer/src/fastertransformer/utils/Tensor.cc:84
↓ 27 callersFunctionTensorFillRandomGaussian
< Layout function
fastertransformer/3rdparty/cutlass/tools/util/include/cutlass/util/reference/host/tensor_fill.h:387
↓ 27 callersFunctionget_cutlass_status
//////////////////////////////////////////////////////////////////////////////////////////// Converts a cuDNN status to cutlass::Status
fastertransformer/3rdparty/cutlass/tools/profiler/src/cudnn_helpers.cpp:45
↓ 27 callersFunctionpad_to_multiple_of_16
fastertransformer/src/fastertransformer/kernels/moe_kernels.h:26
↓ 27 callersMethodsetGemmConfig
fastertransformer/src/fastertransformer/utils/cublasMMWrapper.cc:356
↓ 26 callersMethodbackward
(ctx, grad_in)
fastertransformer/examples/pytorch/swin/Swin-Transformer-Quantization/SwinTransformer/kernels/window_process/unit_test.py:28
↓ 26 callersFunctioncheckCudaStatus
fastertransformer/tests/unittests/fp8_gemm_test/2022_03_21__fp8_stride_batch_example/worker.cpp:15
↓ 26 callersMethodcompressMatrix
fastertransformer/src/fastertransformer/utils/cublasMMWrapper.cc:770
↓ 26 callersFunctioncreate_initializer
(initializer_range=0.02, data_type=tf.float32)
fastertransformer/examples/tensorflow/decoder/utils/common.py:247
↓ 25 callersFunctionTensorForEach
< rank of index space
fastertransformer/3rdparty/cutlass/tools/util/include/cutlass/util/reference/host/tensor_foreach.h:93
↓ 25 callersMethod__init__
(self, config)
fastertransformer/examples/pytorch/bert/bert-quantization-sparsity/modeling.py:534
↓ 25 callersMethodadd_pointer_offset
Adds a pointer offset in units of Element
fastertransformer/3rdparty/cutlass/include/cutlass/epilogue/threadblock/predicated_tile_iterator_v2.h:247
↓ 25 callersMethodall
fastertransformer/src/fastertransformer/utils/Tensor.h:277
↓ 25 callersFunctionbert_example
(args)
fastertransformer/examples/pytorch/bert/bert_example.py:90
↓ 25 callersFunctioncheckCublasStatus
fastertransformer/tests/unittests/fp8_gemm_test/worker.cpp:89
↓ 25 callersMethoddevice_view
Accesses the tensor reference pointing to data
fastertransformer/3rdparty/cutlass/tools/util/include/cutlass/util/host_tensor.h:298
↓ 25 callersFunctionencoder_example
(args)
fastertransformer/examples/pytorch/encoder/encoder_example.py:60
↓ 25 callersFunctionftNcclInitialize
fastertransformer/src/fastertransformer/utils/nccl_utils.cc:308
↓ 25 callersMethodmk
Obtains a Coord<2> from GemmCoord
fastertransformer/3rdparty/cutlass/include/cutlass/gemm/gemm.h:181
↓ 25 callersFunctionswap
fastertransformer/3rdparty/cutlass/include/cutlass/fast_math.h:58
↓ 24 callersMethodadd
Allocate a chunk of memory from the buffer to tensor and copy the values.
fastertransformer/3rdparty/Megatron-LM/megatron/memory.py:89
↓ 24 callersFunctionconst_max
fastertransformer/3rdparty/cutlass/include/cutlass/fast_math.h:594
↓ 24 callersFunctionftNcclAllReduceSum
fastertransformer/src/fastertransformer/utils/nccl_utils.cc:56
↓ 24 callersFunctionftNcclStreamSynchronize
fastertransformer/src/fastertransformer/utils/nccl_utils.cc:215
↓ 24 callersMethodget
Return a tensor with the input `shape` as a view into the 1-D data starting at `start_index`.
fastertransformer/3rdparty/Megatron-LM/megatron/model/distributed.py:44
↓ 24 callersMethodraw_data
fastertransformer/3rdparty/cutlass/include/cutlass/array.h:416
↓ 24 callersFunctionstore_with_pointer_offset
Stores a fragment to memory at the location pointed to by the iterator
fastertransformer/3rdparty/cutlass/include/cutlass/gemm/warp/mma_simt_tile_iterator.h:507
↓ 24 callersFunctiontest_all_gemm
(operation: 'GemmOperationUniversal', testcase="universal")
fastertransformer/3rdparty/cutlass/tools/library/scripts/pycutlass/src/pycutlass/test/gemm_testbed.py:459
↓ 24 callersMethodto_host_vec
fastertransformer/src/fastertransformer/utils/gpu_buf.h:65
↓ 23 callersMethodend
(self, session)
fastertransformer/examples/tensorflow/bert/bert-quantization/run_squad.py:243
↓ 23 callersFunctionfast_sqrt
fastertransformer/3rdparty/cutlass/include/cutlass/fast_math.h:695
↓ 23 callersFunctionget_tokenizer
Return tokenizer.
fastertransformer/3rdparty/Megatron-LM/megatron/global_vars.py:57
↓ 23 callersFunctionhalf2_to_float2
fastertransformer/src/fastertransformer/kernels/decoder_masked_multihead_attention_utils.h:331
↓ 23 callersFunctionk
(q)
fastertransformer/3rdparty/cutlass/docs/jquery.js:61
↓ 23 callersMethodload
(module, prefix='')
fastertransformer/examples/pytorch/bert/bert-quantization-sparsity/modeling.py:832
↓ 23 callersMethodset_kgroup_index
Notify the iterator which k-group it is currently pointing to. This does not advance the iterator. Rather, it overrides its internal tracking with co
fastertransformer/3rdparty/cutlass/include/cutlass/conv/warp/mma_depthwise_simt_tile_iterator.h:242
↓ 22 callersMethodGemmCoord
Default ctor
fastertransformer/3rdparty/cutlass/include/cutlass/gemm/gemm.h:121
↓ 22 callersFunctionadd
fastertransformer/src/fastertransformer/kernels/decoder_masked_multihead_attention_utils.h:181
↓ 22 callersMethodcopy_from_host
fastertransformer/3rdparty/cutlass/tools/util/include/cutlass/util/device_memory.h:307
↓ 22 callersFunctionfma
fastertransformer/src/fastertransformer/kernels/decoder_masked_multihead_attention_utils.h:404
↓ 22 callersFunctionftNcclGroupEnd
fastertransformer/src/fastertransformer/utils/nccl_utils.cc:208
↓ 22 callersFunctionftNcclGroupStart
fastertransformer/src/fastertransformer/utils/nccl_utils.cc:201
↓ 22 callersFunctiongetCublasDataType
fastertransformer/src/fastertransformer/utils/gemm.cc:1024
↓ 22 callersFunctionget_timers
Return timers.
fastertransformer/3rdparty/Megatron-LM/megatron/global_vars.py:75
↓ 22 callersMethodinsertIfValid
fastertransformer/src/fastertransformer/utils/Tensor.h:345
↓ 22 callersMethodlayout
Returns the layout object
fastertransformer/3rdparty/cutlass/include/cutlass/thread/matrix.h:125
↓ 22 callersFunctionprint_mem_usage
fastertransformer/src/fastertransformer/utils/cuda_utils.h:271
↓ 22 callersMethodset_iteration_index
Overrides the internal iteration index
fastertransformer/3rdparty/cutlass/include/cutlass/transform/threadblock/predicated_tile_access_iterator.h:234
↓ 21 callersFunctionTensorHash
fastertransformer/3rdparty/cutlass/test/unit/conv/device/cache_testbed_output.h:505
↓ 21 callersMethodargument
(cupy_ndarray: 'cp.ndarray')
fastertransformer/3rdparty/cutlass/tools/library/scripts/pycutlass/src/pycutlass/frontend.py:103
↓ 21 callersMethodgenerate
# Args. input_token_ids: IntTensor, (batch_size, max_input_length), input hidden state to decoder. i
fastertransformer/examples/pytorch/gpt/utils/gpt_decoder.py:1013
↓ 21 callersMethodget_grid_shape
Computes the grid shape
fastertransformer/3rdparty/cutlass/include/cutlass/gemm/device/gemv.h:109
↓ 21 callersFunctionreduction_op
(tensor, direction, math, factor)
fastertransformer/3rdparty/cutlass/tools/library/scripts/pycutlass/src/pycutlass/epilogue.py:422
↓ 21 callersFunctionresetScope
fastertransformer/src/fastertransformer/utils/nvtx_utils.cc:39
↓ 21 callersMethodsetStream
fastertransformer/src/fastertransformer/models/t5/T5Encoder.cc:248
↓ 21 callersMethodzero_grad
Copied from torch.optim.optimizer
fastertransformer/3rdparty/Megatron-LM/megatron/optimizer/optimizer.py:503
↓ 20 callersFunctionTensorReLu
< Layout function
fastertransformer/3rdparty/cutlass/tools/util/include/cutlass/util/reference/device/tensor_relu.h:123
↓ 20 callersMethodadd_pointer_offset
Adds a pointer offset in units of Element
fastertransformer/3rdparty/cutlass/examples/42_fused_multi_head_attention/iterators/predicated_tile_iterator_residual_last.h:815
↓ 20 callersFunctioncp_async_wait<0>
fastertransformer/3rdparty/cutlass/include/cutlass/arch/memory_sm80.h:454
↓ 20 callersMethodmultiply
Elementwise multiply operator (1-by-2)
fastertransformer/3rdparty/cutlass/include/cutlass/matrix.h:332
↓ 20 callersMethodstart
(self, tag='__default')
fastertransformer/examples/pytorch/gpt/bloom_lambada.py:98
↓ 20 callersMethodupdate
fastertransformer/3rdparty/cutlass/tools/library/scripts/pycutlass/src/cpp/include/gemm/gemm_universal_with_visitor.h:344
↓ 19 callersFunctionadd
fastertransformer/tests/unittests/gtest_utils.h:142
↓ 19 callersFunctioncopy_to_device
fastertransformer/3rdparty/cutlass/tools/util/include/cutlass/util/device_memory.h:97
↓ 19 callersFunctioncopy_to_host
fastertransformer/3rdparty/cutlass/tools/util/include/cutlass/util/device_memory.h:102
↓ 19 callersMethodencode
(self, text)
fastertransformer/examples/pytorch/gpt/utils/gpt_token_encoder.py:134
↓ 19 callersFunctionfast_divmod
* Find quotient and remainder using device-side intrinsics */
fastertransformer/3rdparty/cutlass/include/cutlass/fast_math.h:229
↓ 19 callersMethodforward
fastertransformer/src/fastertransformer/th_op/vit/ViTOp.cc:99
↓ 19 callersFunctiongetDeviceCount
fastertransformer/src/fastertransformer/utils/cuda_utils.h:324
↓ 19 callersFunctiongetLocalBatchSize
fastertransformer/src/fastertransformer/utils/nccl_utils.cc:420
↓ 19 callersFunctiongetTensorRef
(tensor: np.ndarray, problem_size: cutlass.gemm.GemmCoord, operand: str, layout: cutlass.layout)
fastertransformer/3rdparty/cutlass/tools/library/scripts/pycutlass/src/pycutlass/test/gemm_testbed.py:55
← previousnext →201–300 of 14,558, ranked by callers