MCPcopy Index your code
hub / github.com/NVIDIA/TensorRT-LLM / from_serialized_engine

Method from_serialized_engine

tensorrt_llm/runtime/session.py:111–118  ·  view source on GitHub ↗

@brief: Create a session from a serialized engine @param engine: a serialized engine @return: a Session object

(engine)

Source from the content-addressed store, hash-verified

109
110 @staticmethod
111 def from_serialized_engine(engine) -> Session:
112 '''
113 @brief: Create a session from a serialized engine
114 @param engine: a serialized engine
115 @return: a Session object
116 '''
117 session = Session()
118 return session._init(engine)
119
120 @staticmethod
121 def from_engine(engine) -> Session:

Callers 15

_construct_executionMethod · 0.80
_construct_executionMethod · 0.80
test_plugin_no_cacheMethod · 0.80
_fp8_rowwise_gemmMethod · 0.80
test_fp4_gemmMethod · 0.80
test_mamba_conv1dMethod · 0.80
test_nvfp4_qdqMethod · 0.80
test_nvfp4_gemm_ootbMethod · 0.80
test_rg_lruMethod · 0.80
test_selective_scanMethod · 0.80

Calls 2

_initMethod · 0.95
SessionClass · 0.85

Tested by 15

_construct_executionMethod · 0.64
_construct_executionMethod · 0.64
test_plugin_no_cacheMethod · 0.64
_fp8_rowwise_gemmMethod · 0.64
test_fp4_gemmMethod · 0.64
test_mamba_conv1dMethod · 0.64
test_nvfp4_qdqMethod · 0.64
test_nvfp4_gemm_ootbMethod · 0.64
test_rg_lruMethod · 0.64
test_selective_scanMethod · 0.64