MCPcopy Index your code
hub / github.com/NVIDIA/TensorRT-LLM / build

Method build

tensorrt_llm/network.py:842–857  ·  view source on GitHub ↗
(self, network: "Network")

Source from the content-addressed store, hash-verified

840 name_to_layer: Dict[str, "Layer"] = field(default_factory=dict)
841
842 def build(self, network: "Network") -> None:
843 from .graph_rewriting import Layer
844 self.inputs = network.get_inputs()
845 self.outputs = network.get_outputs()
846
847 for layer in network.get_layers():
848 self.name_to_layer[layer.name] = Layer(
849 network=network, trt_layer=layer.trt_layer)
850 for i in range(layer.num_inputs):
851 input_tensor = layer.get_inputs(i)[0]
852 if input_tensor.is_trt_wrapper():
853 self.tensor_to_consumers[input_tensor].append(layer)
854 for i in range(layer.num_outputs):
855 output_tensor = layer.get_outputs(i)[0]
856 if output_tensor.is_trt_wrapper():
857 self.tensor_to_producer[output_tensor] = layer
858
859 def _get_network_hash(self, lightweight=True) -> bytes:
860 # TODO: Ask TensorRT team to add a hash function for INetworkDefinition instead of using this hacky way

Callers 2

_get_graph_implMethod · 0.45

Calls 6

LayerClass · 0.85
get_layersMethod · 0.80
is_trt_wrapperMethod · 0.80
get_inputsMethod · 0.45
get_outputsMethod · 0.45
appendMethod · 0.45

Tested by

no test coverage detected