Method cuda

lightllm/models/vit/model.py:200–201 · view source on GitHub ↗

(self)

Source from the content-addressed store, hash-verified

198	return all_img_embeds, uuids, valid_ids
199
200	def cuda(self):
201	return self
202
203	def load_model(self, weight_dir):
204	pass

exposed_init_modelMethod · 0.45

sampleFunction · 0.45

_get_post_sample_tensorsFunction · 0.45

beam_prefillMethod · 0.45

prefill_normalMethod · 0.45

prefill_overlapMethod · 0.45

prefill_mtpMethod · 0.45

decode_mtpMethod · 0.45

prefill_overlap_mtpMethod · 0.45

decode_overlap_mtpMethod · 0.45

prefill_normalMethod · 0.45

prefill_mtpMethod · 0.45

no outgoing calls

test_scatter_token_to_cpuFunction · 0.36

test_gather_tokenFunction · 0.36

test_tma_alignFunction · 0.36

test_per_token_group_quant_fp8Function · 0.36

tppart_model_inferFunction · 0.36

test_decode_attentionsFunction · 0.36

test_kernelFunction · 0.36

test_fp8_block_gemmFunction · 0.36

test_gen_prefill_params_basicFunction · 0.36

test_multimodal_embFunction · 0.36

test_gen_mtp_new_input_ids_0Function · 0.36