MCPcopy
hub / github.com/NVIDIA/TensorRT-LLM / apply

Method apply

tensorrt_llm/_torch/modules/linear.py:307–309  ·  view source on GitHub ↗
(self, module: Linear, input: torch.Tensor,
              bias: Optional[torch.Tensor], *args, **kwargs)

Source from the content-addressed store, hash-verified

305
306 @abstractmethod
307 def apply(self, module: Linear, input: torch.Tensor,
308 bias: Optional[torch.Tensor], *args, **kwargs):
309 raise NotImplementedError
310
311 def apply_linear_allreduce(self, module: Linear, input: torch.Tensor,
312 bias: Optional[torch.Tensor], tp_rank: int,

Callers 6

anno_gpu_kernnameMethod · 0.45
apply_linearMethod · 0.45
optimizeMethod · 0.45
_sample_stepMethod · 0.45

Calls

no outgoing calls

Tested by

no test coverage detected