Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/NVIDIA/TensorRT
/ functions
Functions
8,179 in github.com/NVIDIA/TensorRT
⨍
Functions
8,179
◇
Types & classes
1,602
↳
Endpoints
43
↓ 2 callers
Function
checkSafeEngine
samples/common/sampleEngines.cpp:1705
↓ 2 callers
Function
check_decoded
(obj)
tools/Polygraphy/polygraphy/json/serde.py:333
↓ 2 callers
Function
check_model
(model_name)
demo/DeBERTa/deberta_onnx_modify.py:175
↓ 2 callers
Function
clean_for_display
Prepare the dataframe for display
tools/experimental/trt-engine-explorer/trex/df_preprocessing.py:257
↓ 2 callers
Method
cleanup
Cleans up any saved models or loaded models from memory.
demo/HuggingFace/NNDF/models.py:253
↓ 2 callers
Method
clearFlag
\brief clear a single build mode flag. clears the builder mode flag from the enabled flags. \see setFlags()
include/NvInfer.h:9262
↓ 2 callers
Method
combine
\brief Combine input timing cache into local instance. This function allows combining entries in the input timing cache to local cache object. \para
include/NvInfer.h:8914
↓ 2 callers
Function
compute_max
(buffer)
tools/Polygraphy/polygraphy/comparator/util.py:61
↓ 2 callers
Function
convert_keras_model_to_onnx
Convert in-memory Keras model into ONNX format. Works directly with CreateAssetsFolder object path. Args: keras_model (tf.keras.Model
tools/tensorflow-quantization/tensorflow_quantization/utils.py:140
↓ 2 callers
Function
convert_to_ascii
(text)
demo/Tacotron2/tacotron2/text/cleaners.py:80
↓ 2 callers
Method
create
plugin/fcPlugin/fcPlugin.h:270
↓ 2 callers
Function
createRefitter
samples/common/sampleEntrypoints.h:89
↓ 2 callers
Function
createSafeInferRuntime
samples/common/sampleEngines.cpp:1652
↓ 2 callers
Method
create_network
Parse the ONNX graph and create the corresponding TensorRT network definition. :param onnx_path: The path to the ONNX graph to load.
samples/python/efficientdet/build_engine.py:138
↓ 2 callers
Function
customMatmulRun
plugin/fcPlugin/fcPlugin.cpp:73
↓ 2 callers
Function
custom_fc
(config, network, input_tensor, out_dims, W)
demo/BERT/builder.py:191
↓ 2 callers
Method
destroy
plugin/fcPlugin/fcPlugin.cpp:684
↓ 2 callers
Method
destroy
\brief Destroy this object. \deprecated Deprecated in TensorRT 8.0. Superseded by `delete`. \warning Calling destroy on a managed pointer will resul
include/NvInfer.h:10016
↓ 2 callers
Function
detectionForwardPostNMSSize
plugin/common/nmsHelper.cpp:63
↓ 2 callers
Function
detectionForwardPreNMSSize
plugin/common/nmsHelper.cpp:57
↓ 2 callers
Method
deviceToHost
samples/common/sampleDevice.h:459
↓ 2 callers
Function
div
(self, a, b, **kwargs)
tools/Polygraphy/tests/models/make_models.py:41
↓ 2 callers
Function
divUp
samples/common/safeCommon.h:91
↓ 2 callers
Function
draw_engine
(engine_json_fname: str)
tools/experimental/trt-engine-explorer/utils/draw_engine.py:34
↓ 2 callers
Function
dump
samples/common/sampleReporting.cpp:533
↓ 2 callers
Method
enable_clip
Enable clip stage
tools/pytorch-quantization/pytorch_quantization/nn/modules/tensor_quantizer.py:164
↓ 2 callers
Method
enable_quant
(self)
tools/pytorch-quantization/pytorch_quantization/nn/modules/tensor_quantizer.py:187
↓ 2 callers
Method
encode_image
(self, init_image)
demo/Diffusion/stable_diffusion_pipeline.py:441
↓ 2 callers
Method
endCapture
samples/common/sampleDevice.h:192
↓ 2 callers
Method
enqueue
plugin/fcPlugin/fcPlugin.cpp:568
↓ 2 callers
Method
enqueue
samples/python/onnx_custom_plugin/plugin/customHardmaxPlugin.cpp:152
↓ 2 callers
Method
entering
(self, marker)
tools/Polygraphy/tests/test_examples.py:99
↓ 2 callers
Function
evaluate_acc
(model, validation_data)
tools/tensorflow-quantization/examples/efficientnet/run_qat_workflow.py:59
↓ 2 callers
Method
execute
(self, args: argparse.Namespace)
demo/HuggingFace/run.py:63
↓ 2 callers
Method
execute_inference
( self, metadata: NetworkMetadata, onnx_fpaths: Dict[str, NetworkModel], infer
demo/HuggingFace/T5/onnxrt.py:121
↓ 2 callers
Method
execute_inference
( self, metadata: NetworkMetadata, onnx_fpaths: Dict[str, NetworkModel], infer
demo/HuggingFace/T5/trt.py:505
↓ 2 callers
Method
execute_inference
( self, metadata: NetworkMetadata, network_fpaths: NetworkModels, inference_in
demo/HuggingFace/T5/frameworks.py:175
↓ 2 callers
Method
execute_inference
( self, metadata: NetworkMetadata, onnx_fpaths: Dict[str, NetworkModel], infer
demo/HuggingFace/BART/onnxrt.py:117
↓ 2 callers
Method
execute_inference
( self, metadata: NetworkMetadata, onnx_fpaths: Dict[str, NetworkModel], infer
demo/HuggingFace/BART/trt.py:684
↓ 2 callers
Method
execute_inference
( self, metadata: NetworkMetadata, network_fpaths: NetworkModels, inference_in
demo/HuggingFace/BART/frameworks.py:200
↓ 2 callers
Method
execute_inference
( self, metadata: NetworkMetadata, onnx_fpaths: Dict[str, NetworkModel], infer
demo/HuggingFace/GPT2/trt.py:374
↓ 2 callers
Method
execute_inference
( self, metadata: NetworkMetadata, network_fpaths: NetworkModels, inference_in
demo/HuggingFace/GPT2/frameworks.py:162
↓ 2 callers
Method
exiting
(self, marker)
tools/Polygraphy/tests/test_examples.py:102
↓ 2 callers
Method
export_graph
(self, graph, do_type_check=False)
tools/Polygraphy/polygraphy/tools/surgeon/subtool/base.py:39
↓ 2 callers
Method
export_node
(node: Node, do_type_check: bool)
tools/onnx-graphsurgeon/onnx_graphsurgeon/exporters/onnx_exporter.py:62
↓ 2 callers
Function
export_onnx
Exports an onnx-graphsurgeon Graph to an ONNX model. Args: graph (Graph): The graph to export do_type_check (bool): Whether
tools/onnx-graphsurgeon/onnx_graphsurgeon/exporters/onnx_exporter.py:130
↓ 2 callers
Function
fail
()
tools/Polygraphy/polygraphy/mod/importer.py:126
↓ 2 callers
Function
fake_context
(name)
tools/Polygraphy/tests/backend/trt/test_algorithm_selector.py:34
↓ 2 callers
Function
fake_tensor_quant
tools/pytorch-quantization/src/tensor_quant.cpp:33
↓ 2 callers
Function
filer_layer
(layer, layer_type)
tools/experimental/trt-engine-explorer/trex/compare_engines.py:475
↓ 2 callers
Function
find_best_thresh
(preds, scores, na_probs, qid_to_has_ans)
demo/BERT/squad/evaluate-v2.0.py:222
↓ 2 callers
Function
find_method
(symbol, method)
tools/Polygraphy/polygraphy/mod/exporter.py:102
↓ 2 callers
Method
forward
(self, input)
tools/pytorch-quantization/pytorch_quantization/nn/modules/quant_instancenorm.py:45
↓ 2 callers
Function
freq_to_int
(clk_freq: str, max_clk_freq: int)
tools/experimental/trt-engine-explorer/utils/process_engine.py:167
↓ 2 callers
Method
from_inference_args
(args)
demo/HuggingFace/NNDF/interface.py:73
↓ 2 callers
Method
from_name
(name)
tools/Polygraphy/tests/test_examples.py:39
↓ 2 callers
Method
from_yaml
Create descriptor from yaml str
tools/pytorch-quantization/pytorch_quantization/tensor_quant.py:211
↓ 2 callers
Function
full_inference
( gpt2, input_ids, tokenizer, timing_profile, max_length, min_length = 0, use_cuda
demo/HuggingFace/GPT2/measurements.py:51
↓ 2 callers
Method
generate
( self, input_ids, min_length: int = None, max_length: int = None, num
demo/HuggingFace/BART/trt.py:604
↓ 2 callers
Method
generate_and_download_framework
( self, metadata: NetworkMetadata, workspace: NNFolderWorkspace )
demo/HuggingFace/BART/frameworks.py:68
↓ 2 callers
Method
generate_roi_name
Generates the roi input name for the Resize node.
samples/python/yolov3_onnx/yolov3_to_onnx.py:221
↓ 2 callers
Function
get
Gets a command-line argument if it exists, otherwise returns a default value. Args: args: The command-line arguments. attr (
tools/Polygraphy/polygraphy/tools/args/util/util.py:100
↓ 2 callers
Method
getAlpha
\brief Get the LRN alpha value. \see setAlpha()
include/NvInfer.h:2121
↓ 2 callers
Function
getAndDelRepeatedOption
samples/common/sampleOptions.cpp:273
↓ 2 callers
Method
getBeta
\brief Get the LRN beta value. \see setBeta()
include/NvInfer.h:2142
↓ 2 callers
Method
getConstantValue
If isConstant(), returns value of the constant. If !isConstant(), return std::numeric_limits<int32_t>::min().
include/NvInferRuntime.h:254
↓ 2 callers
Function
getCudaDriverVersion
samples/common/sampleDevice.h:538
↓ 2 callers
Function
getCudaRuntimeVersion
samples/common/sampleDevice.h:545
↓ 2 callers
Method
getDynamicRangeMax
\brief Get maximum of dynamic range. \return Maximum of dynamic range, or quiet NaN if range was not set.
include/NvInfer.h:394
↓ 2 callers
Method
getDynamicRangeMin
\brief Get minimum of dynamic range. \return Minimum of dynamic range, or quiet NaN if range was not set.
include/NvInfer.h:384
↓ 2 callers
Method
getEnginePath
(self, model_name, engine_dir)
demo/Diffusion/stable_diffusion_pipeline.py:181
↓ 2 callers
Method
getFlag
\brief Returns true if the build mode flag is set \see getFlags() \return True if flag is set, false if unset.
include/NvInfer.h:9286
↓ 2 callers
Method
getKernelSizeNd
\brief Get the multi-dimension kernel size of the convolution. \see setKernelSizeNd()
include/NvInfer.h:1383
↓ 2 callers
Function
getLayerInformation
samples/common/sampleInference.cpp:1272
↓ 2 callers
Function
getLayerWeightsRolePair
samples/common/sampleEngines.cpp:1285
↓ 2 callers
Method
getMaxBatchSize
< set the Max Batch Size
samples/common/sampleConfig.h:179
↓ 2 callers
Function
getMemorySize
quickstart/common/util.cpp:32
↓ 2 callers
Method
getMissingWeights
\brief Get names of missing weights. For example, if some Weights have been set, but the engine was optimized in a way that combines weights, any uns
include/NvInferRuntime.h:1179
↓ 2 callers
Method
getNbDLACores
\brief Return the number of DLA engines available to this builder.
include/NvInfer.h:10036
↓ 2 callers
Method
getNbGroups
\brief Get the number of groups of the convolution. \see setNbGroups()
include/NvInfer.h:1203
↓ 2 callers
Method
getNbOutputMaps
\brief Get the number of output maps for the convolution. \see setNbOutputMaps()
include/NvInfer.h:1115
↓ 2 callers
Method
getNbOutputs
plugin/batchedNMSPlugin/batchedNMSPlugin.cpp:120
↓ 2 callers
Method
getNbOutputs
\brief Get the number of outputs of a layer.
include/NvInfer.h:603
↓ 2 callers
Method
getPadding
\brief Get the padding for pooling. Default: 0 \see setPadding() \deprecated Superseded by getPaddingNd. Deprecated prior to TensorRT 8.0 and will
include/NvInfer.h:1844
↓ 2 callers
Method
getPaddingMode
\brief Get the padding mode. Default: kEXPLICIT_ROUND_DOWN \see setPaddingMode()
include/NvInfer.h:1980
↓ 2 callers
Method
getPaddingNd
\brief Get the multi-dimension padding for pooling. If the padding is asymmetric, the pre-padding is returned. \see setPaddingNd()
include/NvInfer.h:2059
↓ 2 callers
Function
getParamWordType
plugin/skipLayerNormPlugin/skipLayerNormPlugin.cpp:50
↓ 2 callers
Function
getPluginLogger
plugin/common/vfcCommon.cpp:65
↓ 2 callers
Method
getPluginName
plugin/fcPlugin/fcPlugin.cpp:724
↓ 2 callers
Method
getReshapeDimensions
\brief Get the reshaped dimensions. \return The reshaped dimensions. If a second input is present and non-null, or setReshapeDimensions has not yet
include/NvInfer.h:4070
↓ 2 callers
Method
getScale
\brief Get the scale value. \see setScale()
include/NvInfer.h:2280
↓ 2 callers
Method
getScales
\brief Copies resize scales to scales[0, ..., nbScales-1], where nbScales is the number of scales that were set. \param size The number of scales to
include/NvInfer.h:5079
↓ 2 callers
Method
getShift
\brief Get the shift value. \see setShift()
include/NvInfer.h:2260
↓ 2 callers
Method
getStrideNd
\brief Get the multi-dimension stride for pooling. \see setStrideNd()
include/NvInfer.h:2028
↓ 2 callers
Method
getTacticSources
\brief Get tactic sources. Get the tactic sources currently set in the engine build configuration. \see setTacticSources() \return tactic sources
include/NvInfer.h:9630
↓ 2 callers
Method
getTensorBytesPerComponent
\brief Return the number of bytes per component of an element, or -1 if the provided name does not map to an input or output tensor. The vector compo
include/NvInferRuntime.h:1906
↓ 2 callers
Method
getTensorDataType
\brief Determine the required data type for a buffer from its tensor name. \param tensorName The name of an input or output tensor. \return The type
include/NvInferRuntime.h:1697
↓ 2 callers
Method
getTensorFormatDesc
\brief Return the human readable description of the tensor format, or empty string if the provided name does not map to an input or output tensor. Th
include/NvInferRuntime.h:2070
↓ 2 callers
Method
getTensorStrides
\brief Return the strides of the buffer for the given tensor name. The strides are in units of elements, not components or bytes. For example, for Te
include/NvInferRuntime.h:2747
↓ 2 callers
Method
getTensorsWithDynamicRange
\brief Get names of all tensors that have refittable dynamic ranges. \param size The number of items that can be safely written to a non-null tensorN
include/NvInferRuntime.h:1104
← previous
next →
1,001–1,100 of 8,179, ranked by callers