MCPcopy Index your code
hub / github.com/NVIDIA/TensorRT-LLM / serialize_engine

Function serialize_engine

tensorrt_llm/_common.py:133–142  ·  view source on GitHub ↗
(engine, path)

Source from the content-addressed store, hash-verified

131
132
133def serialize_engine(engine, path):
134 logger.info(f"Serializing engine to {path}...")
135 tik = time.time()
136 if isinstance(engine, trt.ICudaEngine):
137 engine = engine.serialize()
138 with open(path, "wb") as f:
139 f.write(engine)
140 tok = time.time()
141 t = time.strftime("%H:%M:%S", time.gmtime(tok - tik))
142 logger.info(f"Engine serialized. Total time: {t}")
143
144
145def deserialize_engine(path):

Callers 3

test_dora_scalingMethod · 0.90
saveMethod · 0.70

Calls 2

infoMethod · 0.45
serializeMethod · 0.45

Tested by 2

test_dora_scalingMethod · 0.72