Function _add_plugin_info

tensorrt_llm/functional.py:666–669 · view source on GitHub ↗

(layer, plugin_creator: trt.IPluginCreator,
                     plugin_name: str, pfc: trt.PluginFieldCollection)

Source from the content-addressed store, hash-verified

664
665
666	def _add_plugin_info(layer, plugin_creator: trt.IPluginCreator,
667	plugin_name: str, pfc: trt.PluginFieldCollection) -> None:
668	plugin_info = PluginInfo(plugin_creator, plugin_name, pfc)
669	set_plugin_info(default_net().trt_network, layer.name, plugin_info)
670
671
672	class RotaryScalingType(IntEnum):

cumsumFunction · 0.85

_lookup_pluginFunction · 0.85

identityFunction · 0.85

allreduceFunction · 0.85

allgatherFunction · 0.85

reduce_scatterFunction · 0.85

sendFunction · 0.85

recvFunction · 0.85

gemm_allreduceFunction · 0.85

bert_attentionFunction · 0.85

gpt_attentionFunction · 0.85

dora_pluginFunction · 0.85

set_plugin_infoFunction · 0.85

default_netFunction · 0.85

PluginInfoClass · 0.70

no test coverage detected