Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/NVIDIA/TensorRT
/ functions
Functions
8,179 in github.com/NVIDIA/TensorRT
⨍
Functions
8,179
◇
Types & classes
1,602
↳
Endpoints
43
↓ 6 callers
Function
meta
(dtype)
tools/Polygraphy/tests/comparator/test_data_loader.py:28
↓ 6 callers
Method
nbBytes
\brief Returns the size (in bytes) of the buffer.
samples/common/buffers.h:136
↓ 6 callers
Method
numpy
Get the NumPy array, deserializing from the disk if it was stored earlier. Returns: np.ndarray: The NumPy array
tools/Polygraphy/polygraphy/comparator/struct.py:51
↓ 6 callers
Method
pow
Power implementation. \param base value to exponentiate \param exp power to expontiate to \return function value stored in single-preicision
samples/common/half.h:1879
↓ 6 callers
Function
ref
(inputs, attributes, version = "1")
plugin/groupNormalizationPlugin/GroupNormalizationPlugin_PluginReference.py:3
↓ 6 callers
Function
remove_if_empty
Removes an entire folder if folder is empty. Provides print info statements. Args: fpath: Location to folder success_msg: Su
demo/HuggingFace/NNDF/general_utils.py:128
↓ 6 callers
Method
run
plugin/bertQKVToContextPlugin/fused_multihead_attention/include/fused_multihead_attention.h:433
↓ 6 callers
Method
serialize
samples/python/onnx_custom_plugin/plugin/customHardmaxPlugin.cpp:240
↓ 6 callers
Method
setAllowedFormats
\brief Set allowed formats for this tensor. By default all formats are allowed. Shape tensors (for which isShapeTensor() returns true) may only have r
include/NvInfer.h:413
↓ 6 callers
Method
setPaddingMode
\brief Set the padding mode. Padding mode takes precedence if both setPaddingMode and setPre/PostPadding are used. Default: kEXPLICIT_ROUND_DOWN \s
include/NvInfer.h:1969
↓ 6 callers
Method
setPluginNamespace
plugin/proposalPlugin/proposalPlugin.cpp:511
↓ 6 callers
Method
setPluginNamespace
plugin/efficientNMSPlugin/tftrt/efficientNMSImplicitTFTRTPlugin.cpp:92
↓ 6 callers
Method
setPluginNamespace
plugin/batchedNMSPlugin/batchedNMSPlugin.cpp:532
↓ 6 callers
Method
setPluginNamespace
Set plugin namespace
plugin/nmsPlugin/nmsPlugin.cpp:419
↓ 6 callers
Method
setPluginNamespace
plugin/cropAndResizePlugin/cropAndResizePlugin.cpp:377
↓ 6 callers
Method
setReportableSeverity
\brief Method for controlling the verbosity of logging output \param severity The logger will only emit messages that have severity of this level or
quickstart/common/logging.h:255
↓ 6 callers
Method
setShapeValues
\brief Set the minimum / optimum / maximum values for an input shape tensor. This function must be called three times for every input tensor t that i
include/NvInferRuntime.h:1380
↓ 6 callers
Method
setStride
\brief Set the stride for computing the output slice data. \param stride The dimensions of the stride to compute the values to store in the output sl
include/NvInfer.h:4311
↓ 6 callers
Method
set_default_quant_desc_weight
Args: value: An instance of :class:`QuantDescriptor <pytorch_quantization.tensor_quant.QuantDescriptor>`
tools/pytorch-quantization/pytorch_quantization/nn/modules/_utils.py:48
↓ 6 callers
Method
set_encoder_hidden_states_for_inference_cycle
Used to cache encoder hidden state runs across same encoder sessions
demo/HuggingFace/BART/trt.py:322
↓ 6 callers
Method
set_input_metadata
Set the input metadata for the data loader. Args: input_metadata (TensorMetadata): Input Metadata, i
tools/Polygraphy/polygraphy/comparator/data_loader.py:361
↓ 6 callers
Function
set_output_name
(layer, prefix, name, out_idx = 0)
demo/BERT/builder_varseqlen.py:92
↓ 6 callers
Function
set_output_name
(layer, prefix, name, out_idx = 0)
demo/BERT/builder.py:82
↓ 6 callers
Method
super_verbose
Logs a message to stdout with SUPER_VERBOSE severity. Args: message (Union[str, Callable() -> str]):
tools/Polygraphy/polygraphy/logger/logger.py:476
↓ 6 callers
Function
swapEndianness
samples/common/common.h:285
↓ 6 callers
Function
time_func
(func, warm_up=25, iters=100)
tools/Polygraphy/tests/helper.py:49
↓ 6 callers
Method
top_k
Creates a function that applies a Top-K operation to a IterationResult. Top-K will return the indices of the k largest values in the
tools/Polygraphy/polygraphy/comparator/postprocess.py:30
↓ 6 callers
Function
trex_base_layout
White background with colored grid
tools/experimental/trt-engine-explorer/trex/plotting.py:110
↓ 6 callers
Function
volume
plugin/common/bertCommon.h:152
↓ 6 callers
Function
volume
Helper function to compute unpadded volume of a Dims (1 if 0 dimensional)
parsers/common/parserUtils.h:48
↓ 5 callers
Function
CUASSERT
(cuda_ret)
demo/Diffusion/utilities.py:63
↓ 5 callers
Function
TacticReplayer
A TensorRT algorithm selector that can replay tactics according to a tactic replay file. Args: replay (Union[path, file-like, Tactic
tools/Polygraphy/polygraphy/backend/trt/algorithm_selector.py:330
↓ 5 callers
Method
__call__
(self)
demo/HuggingFace/NNDF/interface.py:474
↓ 5 callers
Method
_generate_name
(self, prefix)
tools/onnx-graphsurgeon/onnx_graphsurgeon/ir/graph.py:1024
↓ 5 callers
Method
_get_previous_node_specs
Get a previously generated ONNX node (skip those that were not generated). Target index can be passed for jumping to a specific index.
samples/python/yolov3_onnx/yolov3_to_onnx.py:463
↓ 5 callers
Method
_local_tensors
(self)
tools/onnx-graphsurgeon/onnx_graphsurgeon/ir/graph.py:194
↓ 5 callers
Method
_remove_from_elem
(self, elem)
tools/onnx-graphsurgeon/onnx_graphsurgeon/util/misc.py:94
↓ 5 callers
Method
add
Add a single entry for a single error in a subgraph. Multiple node ranges may apply to a single op/error combination. Args:
tools/Polygraphy/polygraphy/tools/inspect/subtool/capability.py:44
↓ 5 callers
Method
addScale
\brief Add a Scale layer to the network. \param input The input tensor to the layer. This tensor is required to have a minimum of 3 dimensions in imp
include/NvInfer.h:7049
↓ 5 callers
Method
as_onnx_model
Converts current model into an ONNX model. Uses provided converter to convert object or default_convert is used instead if available.
demo/HuggingFace/NNDF/models.py:202
↓ 5 callers
Function
build_engine
(model_file, shapes, max_ws=512*1024*1024, fp16=False, timing_cache=None, disable_preview_dynamic_shapes=False
demo/Tacotron2/tensorrt/trt_utils.py:110
↓ 5 callers
Method
callback
(module_severity)
tools/Polygraphy/tests/logger/test_logger.py:56
↓ 5 callers
Function
cast
(self, input, type, **kwargs)
tools/Polygraphy/tests/models/make_models.py:82
↓ 5 callers
Method
check_model
(self, model)
tools/Polygraphy/tests/backend/onnx/test_loader.py:293
↓ 5 callers
Function
conv
(self, input, weights, kernel_shape, **kwargs)
tools/Polygraphy/tests/models/make_models.py:92
↓ 5 callers
Function
convert_conv_1d_to_2d
(conv1d)
demo/Tacotron2/tensorrt/convert_waveglow2onnx.py:40
↓ 5 callers
Method
copy
Copy the graph. This makes copies of all nodes and tensors in the graph, but will not do a deep-copy of weights or attribute
tools/onnx-graphsurgeon/onnx_graphsurgeon/ir/graph.py:1095
↓ 5 callers
Method
dynamicRangeIsSet
\brief Query whether dynamic range is set. \return True if dynamic range is set, false otherwise.
include/NvInfer.h:366
↓ 5 callers
Function
enableDLA
samples/common/common.h:593
↓ 5 callers
Function
evaluate
(dataset, predictions, f1_acc)
demo/BERT/squad/evaluate-v1.1.py:72
↓ 5 callers
Method
export_tensor_proto
(tensor: Constant)
tools/onnx-graphsurgeon/onnx_graphsurgeon/exporters/onnx_exporter.py:34
↓ 5 callers
Method
finish
(self)
tools/Polygraphy/polygraphy/tools/debug/subtool/reduce.py:66
↓ 5 callers
Method
floor
Floor implementation. \param arg value to round \return rounded value
samples/common/half.h:2079
↓ 5 callers
Method
free
(self)
demo/BERT/perf.py:37
↓ 5 callers
Method
from_trt
Creates a Polygraphy ``Algorithm`` instance from a TensorRT ``IAlgorithmContext`` and ``IAlgorithm``. Args: cont
tools/Polygraphy/polygraphy/backend/trt/algorithm_selector.py:132
↓ 5 callers
Method
generate_param_name
Generates a name based on two string inputs, and checks if the combination is valid.
samples/python/yolov3_onnx/yolov3_to_onnx.py:185
↓ 5 callers
Function
getC
parsers/common/parserUtils.h:116
↓ 5 callers
Function
getCHW
parsers/common/parserUtils.h:110
↓ 5 callers
Method
getNullWeights
parsers/caffe/caffeWeightFactory/caffeWeightFactory.cpp:195
↓ 5 callers
Method
getOnnxPath
(self, model_name, onnx_dir, opt=True)
demo/Diffusion/stable_diffusion_pipeline.py:178
↓ 5 callers
Function
getPerformanceResult
samples/common/sampleReporting.cpp:173
↓ 5 callers
Method
getReportableSeverity
quickstart/common/logging.h:371
↓ 5 callers
Method
getTensorFormat
include/NvInfer.h:8470
↓ 5 callers
Function
get_mask_from_lengths
(lengths)
demo/Tacotron2/common/utils.py:40
↓ 5 callers
Function
get_path
(version, inpaint=False)
demo/Diffusion/models.py:71
↓ 5 callers
Function
get_resnet_model
Creates a native tf.keras ResNet model. Args: resnet_depth (str): ResNet depth. Options=[50 (default), 101, 152]. resnet_ver
tools/tensorflow-quantization/examples/resnet/utils.py:24
↓ 5 callers
Method
infer
(self, spect, sigma=1.0)
demo/Tacotron2/waveglow/model.py:234
↓ 5 callers
Method
infer
(self, x, input_lengths)
demo/Tacotron2/tacotron2/model.py:221
↓ 5 callers
Function
infer_shapes
python/src/infer/pyCore.cpp:109
↓ 5 callers
Method
initialize
plugin/fcPlugin/fcPlugin.cpp:652
↓ 5 callers
Method
inverse
(self, magnitude, phase)
demo/Tacotron2/common/stft.py:124
↓ 5 callers
Method
is_empty
Returns whether this tensor is considered empty in the graph. *Note: 'Empty' here refers to the name of the tensor, which is omitted
tools/onnx-graphsurgeon/onnx_graphsurgeon/ir/tensor.py:52
↓ 5 callers
Method
isinf
Classification implementation. \param arg value to classify \retval true if infinite number \retval false else
samples/common/half.h:2352
↓ 5 callers
Function
lgamma
Natural logarithm of gamma function. \param arg function argument \return natural logarith of gamma function for \a arg template<typename T> typename
samples/common/half.h:3456
↓ 5 callers
Function
lgamma
Natural logarithm of gamma function. \param arg function argument \return natural logarith of gamma function for \a arg template<typename T> typename
parsers/common/ieee_half.h:2550
↓ 5 callers
Method
load_engine
Loads a TensorRT engine according to arguments provided on the command-line. Args: network (Tuple[trt.Builder, trt.INetw
tools/Polygraphy/polygraphy/tools/args/backend/trt/loader.py:636
↓ 5 callers
Function
load_network
(builder, network, parser)
tools/Polygraphy/examples/api/03_interoperating_with_tensorrt/example.py:39
↓ 5 callers
Function
lobelia_28_28
()
tools/tensorflow-quantization/tests/network_pool.py:237
↓ 5 callers
Function
make_var
(name)
tools/onnx-graphsurgeon/tests/ir/test_graph.py:473
↓ 5 callers
Function
merge_eval
(main_eval, new_eval, prefix)
demo/BERT/squad/evaluate-v2.0.py:148
↓ 5 callers
Function
param_names
(params)
tools/Polygraphy/polygraphy/mod/exporter.py:136
↓ 5 callers
Method
partition
Partitions a set of subgraphs into supported and unsupported subgraphs. Args: nodelists (List[Tuple[List[int
tools/Polygraphy/polygraphy/tools/inspect/subtool/capability.py:174
↓ 5 callers
Function
prepare_input_sequence
(texts, cpu_run=False)
demo/Tacotron2/inference.py:147
↓ 5 callers
Method
query
samples/common/sampleInference.cpp:720
↓ 5 callers
Function
read_json
(json_file: str)
tools/experimental/trt-engine-explorer/trex/parser.py:28
↓ 5 callers
Method
register
Registers a dictionary of all available argument groups with this argument group. Args: arg_groups (ArgGroups): Maps arg
tools/Polygraphy/polygraphy/tools/args/base.py:91
↓ 5 callers
Function
removeSingleQuotationMarks
samples/common/sampleOptions.cpp:301
↓ 5 callers
Function
rotate_columns
(df: pd.DataFrame)
tools/experimental/trt-engine-explorer/trex/plotting.py:248
↓ 5 callers
Function
run
(batcher, inferer, framework, nms_threshold=None)
samples/python/efficientdet/compare_tf.py:32
↓ 5 callers
Method
runEngine
(self, model_name, feed_dict)
demo/Diffusion/stable_diffusion_pipeline.py:324
↓ 5 callers
Function
run_trt_engine
(context, engine, tensors)
demo/Tacotron2/tensorrt/trt_utils.py:46
↓ 5 callers
Function
sandboxed_install_run
A special fixture that runs commands, but sandboxes any `pip install`s in a virtual environment. Packages from the test environment are still
tools/Polygraphy/tests/conftest.py:31
↓ 5 callers
Method
sanitize
Sanitize the graph by cleaning any unconnected nodes, do a topological resort, and fold constant inputs values. When possible, run sh
samples/python/efficientdet/create_onnx.py:73
↓ 5 callers
Method
sanitize
Sanitize the graph by cleaning any unconnected nodes, do a topological resort, and fold constant inputs values. When possible, run sh
samples/python/tensorflow_object_detection_api/create_onnx.py:135
↓ 5 callers
Method
select_algorithms
(self, context, choices)
tools/Polygraphy/polygraphy/backend/trt/algorithm_selector.py:279
↓ 5 callers
Function
setAllDynamicRanges
Ensures that every tensor used by a network has a dynamic range set. All tensors in a network must have a dynamic range specified if a calibrator is
samples/common/common.h:538
↓ 5 callers
Method
setAlpha
\brief Set the LRN alpha value. The valid range is [-1e20, 1e20]. \see getAlpha()
include/NvInfer.h:2111
↓ 5 callers
Method
setBindingDimensions
\brief Set the dynamic dimensions of an input binding. \param bindingIndex index of an input tensor whose dimensions must be compatible with the netw
include/NvInferRuntime.h:2838
↓ 5 callers
Method
setErrorRecorder
\brief Set the ErrorRecorder for this interface Assigns the ErrorRecorder to this interface. The ErrorRecorder will track all errors during execution
include/NvInfer.h:10128
↓ 5 callers
Method
setPadding
\brief Set the padding for pooling. Default: 0 If executing this layer on DLA, both height and width of padding must be in the range [0,7]. \see ge
include/NvInfer.h:1830
← previous
next →
401–500 of 8,179, ranked by callers