Method clone

tensorrt_llm/scaffolding/controller.py:20–21 · view source on GitHub ↗

(self)

Source from the content-addressed store, hash-verified

18	self.task_collections = {}
19
20	def clone(self):
21	return copy.deepcopy(self)
22
23	def generate(self, prompt: str, **kwargs) -> GenerationResult:
24	task = GenerationTask.create_from_prompt(prompt)

_prepare_input_tensors_with_batchesMethod · 0.45

apply_interleaved_ropeMethod · 0.45

shuffle_weight_for_activation_kernelFunction · 0.45

_process_requestMethod · 0.45

save_metadata_stateFunction · 0.45

forwardMethod · 0.45

prepareMethod · 0.45

prepare_for_spec_decMethod · 0.45

sendMethod · 0.45

load_buffers_and_paramsFunction · 0.45

capture_graphMethod · 0.45

repeat_kvFunction · 0.45

no outgoing calls

no test coverage detected