MCPcopy
hub / github.com/NVIDIA/TensorRT-LLM / serialize

Method serialize

tensorrt_llm/_ipc_utils.py:86–91  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

84 IpcMemory.close_ipc_memory(self.mapping, self.peer_ptrs)
85
86 def serialize(self) -> List[int]:
87 buffer = bytes(0)
88 for ptr in self.peer_ptrs:
89 buffer += struct.pack("P", ptr)
90
91 return array.array("Q", buffer).tolist()
92
93 @staticmethod
94 def open_ipc_memory(

Callers 8

allocate_workspaceMethod · 0.95
_fp8_rowwise_gemmMethod · 0.45
refit_engineMethod · 0.45
save_timing_cacheMethod · 0.45
serialize_engineFunction · 0.45

Calls

no outgoing calls

Tested by 2

_fp8_rowwise_gemmMethod · 0.36