MCPcopy Create free account

hub / github.com/NVIDIA/TensorRT / functions

Functions8,179 in github.com/NVIDIA/TensorRT

↓ 6 callersFunctionmeta
(dtype)
tools/Polygraphy/tests/comparator/test_data_loader.py:28
↓ 6 callersMethodnbBytes
\brief Returns the size (in bytes) of the buffer.
samples/common/buffers.h:136
↓ 6 callersMethodnumpy
Get the NumPy array, deserializing from the disk if it was stored earlier. Returns: np.ndarray: The NumPy array
tools/Polygraphy/polygraphy/comparator/struct.py:51
↓ 6 callersMethodpow
Power implementation. \param base value to exponentiate \param exp power to expontiate to \return function value stored in single-preicision
samples/common/half.h:1879
↓ 6 callersFunctionref
(inputs, attributes, version = "1")
plugin/groupNormalizationPlugin/GroupNormalizationPlugin_PluginReference.py:3
↓ 6 callersFunctionremove_if_empty
Removes an entire folder if folder is empty. Provides print info statements. Args: fpath: Location to folder success_msg: Su
demo/HuggingFace/NNDF/general_utils.py:128
↓ 6 callersMethodrun
plugin/bertQKVToContextPlugin/fused_multihead_attention/include/fused_multihead_attention.h:433
↓ 6 callersMethodserialize
samples/python/onnx_custom_plugin/plugin/customHardmaxPlugin.cpp:240
↓ 6 callersMethodsetAllowedFormats
\brief Set allowed formats for this tensor. By default all formats are allowed. Shape tensors (for which isShapeTensor() returns true) may only have r
include/NvInfer.h:413
↓ 6 callersMethodsetPaddingMode
\brief Set the padding mode. Padding mode takes precedence if both setPaddingMode and setPre/PostPadding are used. Default: kEXPLICIT_ROUND_DOWN \s
include/NvInfer.h:1969
↓ 6 callersMethodsetPluginNamespace
plugin/proposalPlugin/proposalPlugin.cpp:511
↓ 6 callersMethodsetPluginNamespace
plugin/efficientNMSPlugin/tftrt/efficientNMSImplicitTFTRTPlugin.cpp:92
↓ 6 callersMethodsetPluginNamespace
plugin/batchedNMSPlugin/batchedNMSPlugin.cpp:532
↓ 6 callersMethodsetPluginNamespace
Set plugin namespace
plugin/nmsPlugin/nmsPlugin.cpp:419
↓ 6 callersMethodsetPluginNamespace
plugin/cropAndResizePlugin/cropAndResizePlugin.cpp:377
↓ 6 callersMethodsetReportableSeverity
\brief Method for controlling the verbosity of logging output \param severity The logger will only emit messages that have severity of this level or
quickstart/common/logging.h:255
↓ 6 callersMethodsetShapeValues
\brief Set the minimum / optimum / maximum values for an input shape tensor. This function must be called three times for every input tensor t that i
include/NvInferRuntime.h:1380
↓ 6 callersMethodsetStride
\brief Set the stride for computing the output slice data. \param stride The dimensions of the stride to compute the values to store in the output sl
include/NvInfer.h:4311
↓ 6 callersMethodset_default_quant_desc_weight
Args: value: An instance of :class:`QuantDescriptor <pytorch_quantization.tensor_quant.QuantDescriptor>`
tools/pytorch-quantization/pytorch_quantization/nn/modules/_utils.py:48
↓ 6 callersMethodset_encoder_hidden_states_for_inference_cycle
Used to cache encoder hidden state runs across same encoder sessions
demo/HuggingFace/BART/trt.py:322
↓ 6 callersMethodset_input_metadata
Set the input metadata for the data loader. Args: input_metadata (TensorMetadata): Input Metadata, i
tools/Polygraphy/polygraphy/comparator/data_loader.py:361
↓ 6 callersFunctionset_output_name
(layer, prefix, name, out_idx = 0)
demo/BERT/builder_varseqlen.py:92
↓ 6 callersFunctionset_output_name
(layer, prefix, name, out_idx = 0)
demo/BERT/builder.py:82
↓ 6 callersMethodsuper_verbose
Logs a message to stdout with SUPER_VERBOSE severity. Args: message (Union[str, Callable() -> str]):
tools/Polygraphy/polygraphy/logger/logger.py:476
↓ 6 callersFunctionswapEndianness
samples/common/common.h:285
↓ 6 callersFunctiontime_func
(func, warm_up=25, iters=100)
tools/Polygraphy/tests/helper.py:49
↓ 6 callersMethodtop_k
Creates a function that applies a Top-K operation to a IterationResult. Top-K will return the indices of the k largest values in the
tools/Polygraphy/polygraphy/comparator/postprocess.py:30
↓ 6 callersFunctiontrex_base_layout
White background with colored grid
tools/experimental/trt-engine-explorer/trex/plotting.py:110
↓ 6 callersFunctionvolume
plugin/common/bertCommon.h:152
↓ 6 callersFunctionvolume
Helper function to compute unpadded volume of a Dims (1 if 0 dimensional)
parsers/common/parserUtils.h:48
↓ 5 callersFunctionCUASSERT
(cuda_ret)
demo/Diffusion/utilities.py:63
↓ 5 callersFunctionTacticReplayer
A TensorRT algorithm selector that can replay tactics according to a tactic replay file. Args: replay (Union[path, file-like, Tactic
tools/Polygraphy/polygraphy/backend/trt/algorithm_selector.py:330
↓ 5 callersMethod__call__
(self)
demo/HuggingFace/NNDF/interface.py:474
↓ 5 callersMethod_generate_name
(self, prefix)
tools/onnx-graphsurgeon/onnx_graphsurgeon/ir/graph.py:1024
↓ 5 callersMethod_get_previous_node_specs
Get a previously generated ONNX node (skip those that were not generated). Target index can be passed for jumping to a specific index.
samples/python/yolov3_onnx/yolov3_to_onnx.py:463
↓ 5 callersMethod_local_tensors
(self)
tools/onnx-graphsurgeon/onnx_graphsurgeon/ir/graph.py:194
↓ 5 callersMethod_remove_from_elem
(self, elem)
tools/onnx-graphsurgeon/onnx_graphsurgeon/util/misc.py:94
↓ 5 callersMethodadd
Add a single entry for a single error in a subgraph. Multiple node ranges may apply to a single op/error combination. Args:
tools/Polygraphy/polygraphy/tools/inspect/subtool/capability.py:44
↓ 5 callersMethodaddScale
\brief Add a Scale layer to the network. \param input The input tensor to the layer. This tensor is required to have a minimum of 3 dimensions in imp
include/NvInfer.h:7049
↓ 5 callersMethodas_onnx_model
Converts current model into an ONNX model. Uses provided converter to convert object or default_convert is used instead if available.
demo/HuggingFace/NNDF/models.py:202
↓ 5 callersFunctionbuild_engine
(model_file, shapes, max_ws=512*1024*1024, fp16=False, timing_cache=None, disable_preview_dynamic_shapes=False
demo/Tacotron2/tensorrt/trt_utils.py:110
↓ 5 callersMethodcallback
(module_severity)
tools/Polygraphy/tests/logger/test_logger.py:56
↓ 5 callersFunctioncast
(self, input, type, **kwargs)
tools/Polygraphy/tests/models/make_models.py:82
↓ 5 callersMethodcheck_model
(self, model)
tools/Polygraphy/tests/backend/onnx/test_loader.py:293
↓ 5 callersFunctionconv
(self, input, weights, kernel_shape, **kwargs)
tools/Polygraphy/tests/models/make_models.py:92
↓ 5 callersFunctionconvert_conv_1d_to_2d
(conv1d)
demo/Tacotron2/tensorrt/convert_waveglow2onnx.py:40
↓ 5 callersMethodcopy
Copy the graph. This makes copies of all nodes and tensors in the graph, but will not do a deep-copy of weights or attribute
tools/onnx-graphsurgeon/onnx_graphsurgeon/ir/graph.py:1095
↓ 5 callersMethoddynamicRangeIsSet
\brief Query whether dynamic range is set. \return True if dynamic range is set, false otherwise.
include/NvInfer.h:366
↓ 5 callersFunctionenableDLA
samples/common/common.h:593
↓ 5 callersFunctionevaluate
(dataset, predictions, f1_acc)
demo/BERT/squad/evaluate-v1.1.py:72
↓ 5 callersMethodexport_tensor_proto
(tensor: Constant)
tools/onnx-graphsurgeon/onnx_graphsurgeon/exporters/onnx_exporter.py:34
↓ 5 callersMethodfinish
(self)
tools/Polygraphy/polygraphy/tools/debug/subtool/reduce.py:66
↓ 5 callersMethodfloor
Floor implementation. \param arg value to round \return rounded value
samples/common/half.h:2079
↓ 5 callersMethodfree
(self)
demo/BERT/perf.py:37
↓ 5 callersMethodfrom_trt
Creates a Polygraphy ``Algorithm`` instance from a TensorRT ``IAlgorithmContext`` and ``IAlgorithm``. Args: cont
tools/Polygraphy/polygraphy/backend/trt/algorithm_selector.py:132
↓ 5 callersMethodgenerate_param_name
Generates a name based on two string inputs, and checks if the combination is valid.
samples/python/yolov3_onnx/yolov3_to_onnx.py:185
↓ 5 callersFunctiongetC
parsers/common/parserUtils.h:116
↓ 5 callersFunctiongetCHW
parsers/common/parserUtils.h:110
↓ 5 callersMethodgetNullWeights
parsers/caffe/caffeWeightFactory/caffeWeightFactory.cpp:195
↓ 5 callersMethodgetOnnxPath
(self, model_name, onnx_dir, opt=True)
demo/Diffusion/stable_diffusion_pipeline.py:178
↓ 5 callersFunctiongetPerformanceResult
samples/common/sampleReporting.cpp:173
↓ 5 callersMethodgetReportableSeverity
quickstart/common/logging.h:371
↓ 5 callersMethodgetTensorFormat
include/NvInfer.h:8470
↓ 5 callersFunctionget_mask_from_lengths
(lengths)
demo/Tacotron2/common/utils.py:40
↓ 5 callersFunctionget_path
(version, inpaint=False)
demo/Diffusion/models.py:71
↓ 5 callersFunctionget_resnet_model
Creates a native tf.keras ResNet model. Args: resnet_depth (str): ResNet depth. Options=[50 (default), 101, 152]. resnet_ver
tools/tensorflow-quantization/examples/resnet/utils.py:24
↓ 5 callersMethodinfer
(self, spect, sigma=1.0)
demo/Tacotron2/waveglow/model.py:234
↓ 5 callersMethodinfer
(self, x, input_lengths)
demo/Tacotron2/tacotron2/model.py:221
↓ 5 callersFunctioninfer_shapes
python/src/infer/pyCore.cpp:109
↓ 5 callersMethodinitialize
plugin/fcPlugin/fcPlugin.cpp:652
↓ 5 callersMethodinverse
(self, magnitude, phase)
demo/Tacotron2/common/stft.py:124
↓ 5 callersMethodis_empty
Returns whether this tensor is considered empty in the graph. *Note: 'Empty' here refers to the name of the tensor, which is omitted
tools/onnx-graphsurgeon/onnx_graphsurgeon/ir/tensor.py:52
↓ 5 callersMethodisinf
Classification implementation. \param arg value to classify \retval true if infinite number \retval false else
samples/common/half.h:2352
↓ 5 callersFunctionlgamma
Natural logarithm of gamma function. \param arg function argument \return natural logarith of gamma function for \a arg template<typename T> typename
samples/common/half.h:3456
↓ 5 callersFunctionlgamma
Natural logarithm of gamma function. \param arg function argument \return natural logarith of gamma function for \a arg template<typename T> typename
parsers/common/ieee_half.h:2550
↓ 5 callersMethodload_engine
Loads a TensorRT engine according to arguments provided on the command-line. Args: network (Tuple[trt.Builder, trt.INetw
tools/Polygraphy/polygraphy/tools/args/backend/trt/loader.py:636
↓ 5 callersFunctionload_network
(builder, network, parser)
tools/Polygraphy/examples/api/03_interoperating_with_tensorrt/example.py:39
↓ 5 callersFunctionlobelia_28_28
()
tools/tensorflow-quantization/tests/network_pool.py:237
↓ 5 callersFunctionmake_var
(name)
tools/onnx-graphsurgeon/tests/ir/test_graph.py:473
↓ 5 callersFunctionmerge_eval
(main_eval, new_eval, prefix)
demo/BERT/squad/evaluate-v2.0.py:148
↓ 5 callersFunctionparam_names
(params)
tools/Polygraphy/polygraphy/mod/exporter.py:136
↓ 5 callersMethodpartition
Partitions a set of subgraphs into supported and unsupported subgraphs. Args: nodelists (List[Tuple[List[int
tools/Polygraphy/polygraphy/tools/inspect/subtool/capability.py:174
↓ 5 callersFunctionprepare_input_sequence
(texts, cpu_run=False)
demo/Tacotron2/inference.py:147
↓ 5 callersMethodquery
samples/common/sampleInference.cpp:720
↓ 5 callersFunctionread_json
(json_file: str)
tools/experimental/trt-engine-explorer/trex/parser.py:28
↓ 5 callersMethodregister
Registers a dictionary of all available argument groups with this argument group. Args: arg_groups (ArgGroups): Maps arg
tools/Polygraphy/polygraphy/tools/args/base.py:91
↓ 5 callersFunctionremoveSingleQuotationMarks
samples/common/sampleOptions.cpp:301
↓ 5 callersFunctionrotate_columns
(df: pd.DataFrame)
tools/experimental/trt-engine-explorer/trex/plotting.py:248
↓ 5 callersFunctionrun
(batcher, inferer, framework, nms_threshold=None)
samples/python/efficientdet/compare_tf.py:32
↓ 5 callersMethodrunEngine
(self, model_name, feed_dict)
demo/Diffusion/stable_diffusion_pipeline.py:324
↓ 5 callersFunctionrun_trt_engine
(context, engine, tensors)
demo/Tacotron2/tensorrt/trt_utils.py:46
↓ 5 callersFunctionsandboxed_install_run
A special fixture that runs commands, but sandboxes any `pip install`s in a virtual environment. Packages from the test environment are still
tools/Polygraphy/tests/conftest.py:31
↓ 5 callersMethodsanitize
Sanitize the graph by cleaning any unconnected nodes, do a topological resort, and fold constant inputs values. When possible, run sh
samples/python/efficientdet/create_onnx.py:73
↓ 5 callersMethodsanitize
Sanitize the graph by cleaning any unconnected nodes, do a topological resort, and fold constant inputs values. When possible, run sh
samples/python/tensorflow_object_detection_api/create_onnx.py:135
↓ 5 callersMethodselect_algorithms
(self, context, choices)
tools/Polygraphy/polygraphy/backend/trt/algorithm_selector.py:279
↓ 5 callersFunctionsetAllDynamicRanges
Ensures that every tensor used by a network has a dynamic range set. All tensors in a network must have a dynamic range specified if a calibrator is
samples/common/common.h:538
↓ 5 callersMethodsetAlpha
\brief Set the LRN alpha value. The valid range is [-1e20, 1e20]. \see getAlpha()
include/NvInfer.h:2111
↓ 5 callersMethodsetBindingDimensions
\brief Set the dynamic dimensions of an input binding. \param bindingIndex index of an input tensor whose dimensions must be compatible with the netw
include/NvInferRuntime.h:2838
↓ 5 callersMethodsetErrorRecorder
\brief Set the ErrorRecorder for this interface Assigns the ErrorRecorder to this interface. The ErrorRecorder will track all errors during execution
include/NvInfer.h:10128
↓ 5 callersMethodsetPadding
\brief Set the padding for pooling. Default: 0 If executing this layer on DLA, both height and width of padding must be in the range [0,7]. \see ge
include/NvInfer.h:1830
← previousnext →401–500 of 8,179, ranked by callers