MCPcopy Create free account
hub / github.com/NVIDIA/TensorRT-LLM / remote

Method remote

tensorrt_llm/executor/rpc/rpc_client.py:52–57  ·  view source on GitHub ↗

Synchronous remote call with optional RPC parameters.

(self,
               timeout: Optional[float] = None,
               need_response: bool = True)

Source from the content-addressed store, hash-verified

50 return client_method(self.method_name, *self.args, **self.kwargs)
51
52 def remote(self,
53 timeout: Optional[float] = None,
54 need_response: bool = True) -> Any:
55 """Synchronous remote call with optional RPC parameters."""
56 return self._prepare_and_call(timeout, need_response, "sync",
57 "_call_sync")
58
59 def remote_async(self,
60 timeout: Optional[float] = None,

Callers 15

setup_rl_llmFunction · 0.80
generate_single_promptFunction · 0.80
test_multi_instanceFunction · 0.80
test_placement_env_varsFunction · 0.80
test_allgather_pg_opFunction · 0.80
test_reducescatter_pg_opFunction · 0.80
test_allreduce_pg_opFunction · 0.80
test_cp_broadcast_tensorFunction · 0.80

Calls 1

_prepare_and_callMethod · 0.95