Method enqueueV3

include/NvInferRuntime.h:3460–3463

\brief Enqueue inference on a stream. \param stream A cuda stream on which the inference kernels will be enqueued. \return True if the kernels were enqueued successfully, false otherwise. Modifying or releasing memory that has been registered for the tensors before stream synchronization or the event passed to setInputConsumedEvent has been being triggered results in undefined behavior. Input t

    //! synchronization.
    //!
    bool enqueueV3(cudaStream_t stream) noexcept
    {
        return mImpl->enqueueV3(stream);
    }

    //! \brief Set the maximum size for persistent cache usage.
    //!