MCPcopy Index your code
hub / github.com/NVIDIA/TensorRT-LLM / RPCRequest

Class RPCRequest

tensorrt_llm/executor/rpc/rpc_common.py:67–83  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

65
66@dataclass
67class RPCRequest:
68 request_id: str
69 _: KW_ONLY
70 method_name: str
71 args: tuple
72 kwargs: dict
73 need_response: bool = True
74 timeout: float = 0.5
75 is_streaming: bool = False
76 creation_timestamp: Optional[
77 float] = None # Unix timestamp when request was created
78 routing_id: Optional[bytes] = None
79
80 def __post_init__(self):
81 """Initialize creation_timestamp if not provided."""
82 if self.creation_timestamp is None:
83 self.creation_timestamp = time.time()
84
85
86@dataclass

Callers 2

_call_asyncMethod · 0.85
_call_streamingMethod · 0.85

Calls

no outgoing calls

Tested by

no test coverage detected