Functionapply_lora(model, device_to, transformer_load_device, params_to_keep=None, dtype=None, base_dtype=None, state_dict=None,
wan/utils/utils.py:361
Functionattention(
q,
k,
v,
q_lens=None,
k_lens=None,
dropout_p=0.,
softmax_scale=None,
q_scale
wan/modules/attention.py:142
Methodforward(
self,
x,
e,
seq_lens,
grid_sizes,
freqs,
context,
wan/modules/multitalk_model.py:274