Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/NVIDIA/TensorRT
/ functions
Functions
8,179 in github.com/NVIDIA/TensorRT
⨍
Functions
8,179
◇
Types & classes
1,602
↳
Endpoints
43
↓ 8 callers
Method
module_path
Converts a given path to a path relative to the Polygraphy root module. If the path is not part of the Polygraphy module, returns a p
tools/Polygraphy/polygraphy/logger/logger.py:287
↓ 8 callers
Method
parse
Run argument parsing for all argument groups. Args: args (Namespace): The namespace returned by ``pa
tools/Polygraphy/polygraphy/tools/base/tool.py:145
↓ 8 callers
Method
reportTestStart
\brief Report that a test has started. \pre reportTestStart() has not been called yet for the given testAtom \param[in] testAtom The handle to the t
samples/common/logging.h:395
↓ 8 callers
Method
run
demo/BERT/infer_c/bert_infer.h:220
↓ 8 callers
Method
save
Save the ONNX model to the given location. :param output_path: Path pointing to the location where to write out the updated ONNX mode
samples/python/efficientdet/create_onnx.py:105
↓ 8 callers
Method
setAxis
\brief Set the axis parameter. \see IOneHotLayer
include/NvInfer.h:6411
↓ 8 callers
Method
setDynamicRange
\brief Sets custom dynamic range for network tensors
samples/sampleINT8API/sampleINT8API.cpp:307
↓ 8 callers
Method
setOperation
\brief Set the operation for the layer. \see getOperation(), TopKOperation
include/NvInfer.h:4441
↓ 8 callers
Method
setType
\brief Set the data type of a tensor. \param type The data type of the tensor. The type is unchanged if the tensor is not a network input tensor, or
include/NvInfer.h:250
↓ 8 callers
Function
sqrt
Square root. \param arg function argument \return square root of \a arg template<typename T> typename enable<expr,T>::type sqrt(T arg) { return functi
samples/common/half.h:3167
↓ 8 callers
Method
step
(self, success, num_nodes)
tools/Polygraphy/polygraphy/tools/debug/subtool/reduce.py:54
↓ 8 callers
Method
step
(self, output, latents, step_index, timestep)
demo/Diffusion/utilities.py:965
↓ 8 callers
Method
ultra_verbose
Logs a message to stdout with ULTRA_VERBOSE severity. Args: message (Union[str, Callable() -> str]):
tools/Polygraphy/polygraphy/logger/logger.py:463
↓ 7 callers
Method
__init__
(self, in_channels, out_channels, kernel_size,
tools/pytorch-quantization/pytorch_quantization/nn/modules/quant_conv.py:97
↓ 7 callers
Method
__init__
Saves an engine to the provided path. Args: engine (Union[trt.ICudaEngine, Callable() -> trt.ICudaEngine]):
tools/Polygraphy/polygraphy/backend/trt/loader.py:712
↓ 7 callers
Method
__init__
(self)
tools/tensorflow-quantization/tensorflow_quantization/custom_qdq_cases.py:84
↓ 7 callers
Method
_get_node_id
(self, node)
tools/onnx-graphsurgeon/onnx_graphsurgeon/ir/graph.py:184
↓ 7 callers
Method
add_folder
Create the experiment directory (sub-folder in the base directory passed to this class). Args: folder_name (str): name o
tools/tensorflow-quantization/tensorflow_quantization/utils.py:84
↓ 7 callers
Method
add_runner
Adds a runner to the script. Args: runner_str (str): A string constructing the runner.
tools/Polygraphy/polygraphy/tools/script.py:348
↓ 7 callers
Method
allocate_buffers
(self, shape_dict=None, device='cuda')
demo/Diffusion/utilities.py:231
↓ 7 callers
Function
append_layer
(merged: List, layer1: pd.Series, layer2: pd.Series)
tools/experimental/trt-engine-explorer/trex/compare_engines.py:408
↓ 7 callers
Method
axis
(self)
tools/pytorch-quantization/pytorch_quantization/tensor_quant.py:120
↓ 7 callers
Method
bindingIsInput
\brief Determine whether a binding is an input binding. \param bindingIndex The binding index. \return True if the index corresponds to an input bind
include/NvInferRuntime.h:1625
↓ 7 callers
Function
builtin_isinf
samples/common/half.h:565
↓ 7 callers
Function
builtin_isinf
parsers/common/ieee_half.h:421
↓ 7 callers
Method
check
(self, status)
tools/Polygraphy/polygraphy/cuda/cuda.py:94
↓ 7 callers
Method
check_model
(self, model)
tools/Polygraphy/tests/backend/onnx/test_loader.py:134
↓ 7 callers
Method
critical
(self, message)
tools/onnx-graphsurgeon/onnx_graphsurgeon/logger/logger.py:231
↓ 7 callers
Method
data
\brief Returns pointer to underlying array.
samples/common/buffers.h:112
↓ 7 callers
Function
display_df
(df: pd.DataFrame, **kwargs)
tools/experimental/trt-engine-explorer/trex/notebook.py:104
↓ 7 callers
Method
enable_calib
(self)
tools/pytorch-quantization/pytorch_quantization/nn/modules/tensor_quantizer.py:177
↓ 7 callers
Function
ensure_safe
Ensures that the input is marked as a safe string (i.e. Script.String(safe=True)).
tools/Polygraphy/polygraphy/tools/script.py:66
↓ 7 callers
Method
find_head_end
(self, head_name, descendant, end_op)
samples/python/tensorflow_object_detection_api/create_onnx.py:268
↓ 7 callers
Method
free
Frees all device buffers associated with this calibrator
tools/Polygraphy/polygraphy/backend/trt/calibrator.py:251
↓ 7 callers
Function
frodo_32_32
Dummy network with resnet like architecture.
tools/tensorflow-quantization/tests/network_pool.py:93
↓ 7 callers
Method
getBindingDataType
\brief Determine the required data type for a buffer from its binding index. \param bindingIndex The binding index. \return The type of the data in t
include/NvInferRuntime.h:1682
↓ 7 callers
Function
hasSafeRuntime
samples/common/sampleEngines.cpp:1643
↓ 7 callers
Function
insertShapesBuild
samples/common/sampleOptions.cpp:289
↓ 7 callers
Method
isConstant
Return true if expression is a build-time constant.
include/NvInferRuntime.h:247
↓ 7 callers
Function
isnan
Check for NaN. \param arg number to check \retval true for NaNs \retval false else template<typename T> typename enable<bool,T>::type isnan(T arg) { r
samples/common/half.h:3836
↓ 7 callers
Function
isnan
Check for NaN. \param arg number to check \retval true for NaNs \retval false else template<typename T> typename enable<bool,T>::type isnan(T arg) { r
parsers/common/ieee_half.h:2761
↓ 7 callers
Method
isnan
Classification implementation. \param arg value to classify \retval true if not a number \retval false else
samples/common/half.h:2361
↓ 7 callers
Method
log
(self, message, severity, mode=LogMode.EACH, stack_depth=2)
tools/onnx-graphsurgeon/onnx_graphsurgeon/logger/logger.py:149
↓ 7 callers
Function
make_nested_graph
()
tools/onnx-graphsurgeon/tests/ir/test_graph.py:144
↓ 7 callers
Function
make_trt_enum_val
Helper function to create inline TRT enums for usage across various TRT classes.
tools/Polygraphy/polygraphy/tools/args/backend/trt/helper.py:24
↓ 7 callers
Method
node_ids
Returns a context manager that supplies unique integer IDs for Nodes in the Graph. For example: :: with graph.n
tools/onnx-graphsurgeon/onnx_graphsurgeon/ir/graph.py:168
↓ 7 callers
Function
np_dtype_from_trt
(trt_dtype)
tools/Polygraphy/polygraphy/backend/trt/util.py:169
↓ 7 callers
Function
parseArgs
\brief Populates the Args struct with the provided command-line parameters. \throw invalid_argument if any of the arguments are not valid \return bo
samples/common/argsParser.h:99
↓ 7 callers
Function
pippin_28_28
()
tools/tensorflow-quantization/tests/network_pool.py:263
↓ 7 callers
Function
preprocess
(text)
samples/python/engine_refit_onnx_bidaf/data_processing.py:25
↓ 7 callers
Function
process_onnx
(config: List[OnnxProcessOperation], onnx_input_fpath, onnx_output_fpath, keep_input = False, **kwargs)
demo/HuggingFace/NNDF/tensorrt_utils.py:188
↓ 7 callers
Method
round
Nearest integer implementation. \param arg value to round \return rounded value
samples/common/half.h:2103
↓ 7 callers
Method
setReportableSeverity
\brief Method for controlling the verbosity of logging output \param severity The logger will only emit messages that have severity of this level or
samples/common/logging.h:322
↓ 7 callers
Method
setup
plugin/bertQKVToContextPlugin/qkvToContextPlugin.h:61
↓ 7 callers
Method
tanh
Hyperbolic tangent implementation. \param arg function argument \return function value stored in single-preicision
samples/common/half.h:1960
↓ 7 callers
Function
toDims
samples/common/sampleUtils.cpp:62
↓ 7 callers
Method
to_constant
Modifies this tensor in-place to convert it to a Constant. This means that all consumers/producers of the tensor will see the update.
tools/onnx-graphsurgeon/onnx_graphsurgeon/ir/tensor.py:64
↓ 7 callers
Function
try_register_tool
(module, tool_class)
tools/Polygraphy/polygraphy/tools/registry.py:39
↓ 7 callers
Function
volume
python/include/utils.h:57
↓ 7 callers
Function
warnx
samples/common/getopt.c:122
↓ 6 callers
Method
Normalize
plugin/normalizePlugin/normalizePlugin.cpp:38
↓ 6 callers
Method
__init__
(self, *args, **kwargs)
tools/pytorch-quantization/pytorch_quantization/nn/modules/quant_rnn.py:312
↓ 6 callers
Method
__init__
(self, in_dim, sizes)
demo/Tacotron2/tacotron2/model.py:110
↓ 6 callers
Method
_create_param_tensors
Creates the initializers with weights from the weights file together with the input tensors. Keyword arguments: conv_params -
samples/python/yolov3_onnx/yolov3_to_onnx.py:305
↓ 6 callers
Method
_get_input_tensor_parent
Get input Tensors parent recursively. Here we want to know id DequantizeLinear is tensors parent. Recursively we go up the gr
tools/tensorflow-quantization/tests/onnx_graph_qdq_validator.py:157
↓ 6 callers
Method
_quant
Apply quantization on input and weight Function called by the classes lower in the hierarchy, which actually performs the quantization before
tools/pytorch-quantization/pytorch_quantization/nn/modules/quant_conv.py:75
↓ 6 callers
Function
add
plugin/instanceNormalizationPlugin/instanceNormCommon.h:417
↓ 6 callers
Method
add_parser_args
Add arguments to the command-line parser. This will also add arguments for any subtools reported by `get_subtools()`. Args:
tools/Polygraphy/polygraphy/tools/base/tool.py:127
↓ 6 callers
Method
allocate
samples/common/sampleDevice.h:268
↓ 6 callers
Method
check_insert_model
(self, path, expected_node_ops, expected_graph_input_names, expected_graph_output_names)
tools/Polygraphy/tests/tools/test_surgeon.py:117
↓ 6 callers
Function
check_is_instance
(obj, cls, name)
tools/Polygraphy/polygraphy/backend/trt/algorithm_selector.py:38
↓ 6 callers
Method
cleanup
(graph)
tools/Polygraphy/polygraphy/tools/debug/subtool/reduce.py:298
↓ 6 callers
Function
compile_model
(model)
tools/tensorflow-quantization/examples/utils_finetuning.py:73
↓ 6 callers
Method
createOptimizationProfile
\brief Create a new optimization profile. If the network has any dynamic input tensors, the appropriate calls to setDimensions() must be made. Likewi
include/NvInfer.h:10109
↓ 6 callers
Method
executeV2
\brief Synchronously execute inference a network. This method requires an array of input and output buffers. The mapping from tensor names to indices
include/NvInferRuntime.h:3071
↓ 6 callers
Function
exp
Exponential function. \param arg function argument \return e raised to \a arg template<typename T> typename enable<expr,T>::type exp(T arg) { return f
parsers/common/ieee_half.h:2343
↓ 6 callers
Method
flatten_parameters
Resets parameter data pointer so that they can use faster code paths. Right now, this works only if the module is on the GPU and cuDNN is ena
tools/pytorch-quantization/pytorch_quantization/nn/modules/quant_rnn.py:110
↓ 6 callers
Function
floor
Nearest integer not greater than half value. \param arg half to round \return nearest integer not greater than \a arg template<typename T> typename en
samples/common/half.h:3499
↓ 6 callers
Method
getAxis
\brief Get the value of the axis parameter.
include/NvInfer.h:6419
↓ 6 callers
Method
getBlob
parsers/caffe/caffeWeightFactory/caffeWeightFactory.cpp:106
↓ 6 callers
Method
getBufferSize
samples/sampleIOFormats/sampleIOFormats.cpp:141
↓ 6 callers
Method
getProfileDimensions
\brief Get the minimum / optimum / maximum dimensions for a particular input binding under an optimization profile. \param bindingIndex The input bin
include/NvInferRuntime.h:2200
↓ 6 callers
Function
getShapesBuild
samples/common/sampleOptions.cpp:371
↓ 6 callers
Method
getStrides
\brief Return strides of the input/output tensor of algorithm. For vectorized formats, strides are given in units of vectors. \return the strides of
include/NvInfer.h:8491
↓ 6 callers
Method
getWeights
\brief Get the weights for the layer. \see setWeights
include/NvInfer.h:4764
↓ 6 callers
Method
get_layer_config
Return dictionary with information about layers to quantize for quantize config object. Args: None Return
tools/tensorflow-quantization/tensorflow_quantization/quantize_config.py:174
↓ 6 callers
Function
get_tfkeras_model
(model_name: str = "mobilenet_v1", shape: Tuple = None)
tools/tensorflow-quantization/examples/utils.py:37
↓ 6 callers
Method
get_timing_profile
Get TimingProfile settings given current args.
demo/HuggingFace/NNDF/interface.py:223
↓ 6 callers
Function
group_sum_attr
(df, grouping_attr, reduced_attr)
tools/experimental/trt-engine-explorer/trex/misc.py:34
↓ 6 callers
Method
infer_shapes
Run shape inference on an ONNX model if `do_shape_inference` is True according to arguments provided on the command-line. Ar
tools/Polygraphy/polygraphy/tools/args/backend/onnx/loader.py:141
↓ 6 callers
Method
infer_shapes
(self, return_onnx=False)
demo/Diffusion/models.py:60
↓ 6 callers
Function
isDebug
samples/common/common.h:360
↓ 6 callers
Method
isShapeTensor
\brief Whether the tensor is a shape tensor. A shape tensor is a tensor that is related to shape calculations. It must have type Int32, Bool, or Floa
include/NvInfer.h:461
↓ 6 callers
Function
is_dimension_dynamic
(dim)
tools/Polygraphy/polygraphy/util/util.py:706
↓ 6 callers
Method
is_onnx
(self)
tools/Polygraphy/polygraphy/tools/args/model.py:63
↓ 6 callers
Function
ldexp
Multiply by power of two. \param arg number to modify \param exp power of two to multiply with \return \a arg multplied by 2 raised to \a exp template
samples/common/half.h:3637
↓ 6 callers
Function
ldexp
Multiply by power of two. \param arg number to modify \param exp power of two to multiply with \return \a arg multplied by 2 raised to \a exp template
parsers/common/ieee_half.h:2652
↓ 6 callers
Function
load_data
( hyperparams: Dict, model_name: str = "resnet_v1" )
tools/tensorflow-quantization/examples/data/data_loader.py:322
↓ 6 callers
Function
make_invocable_if_nondefault
Similar to `make_invocable`, but will return ``None`` if all arguments are ``None``. For example: :: >>> make_invocable_if_nond
tools/Polygraphy/polygraphy/tools/script.py:152
↓ 6 callers
Function
make_memory_node_name
(region: Region, generation: RegionGeneration)
tools/experimental/trt-engine-explorer/trex/graphing.py:205
← previous
next →
301–400 of 8,179, ranked by callers