Function_build_alibi_tensor(self: BloomModel, batch_size: int, query_length: int, key_length: int, dtype: torch.dtype, device: torch.devi
projects/DualFocus/dualfocus/model/language_model/mpt/hf_prefixlm_converter.py:140
Function_bwd_kernel(Q, K, V, Bias, DO, DQ, DK, DV, LSE, D, softmax_scale, stride_qb, stride_qh, stride_qm, stride_kb, stride_kh,
projects/DualFocus/dualfocus/model/language_model/mpt/flash_attn_triton.py:306
Function_bwd_preprocess_do_o_dot(Out, DO, Delta, stride_ob, stride_oh, stride_om, stride_dob, stride_doh, stride_dom, nheads, seqlen_q, seqlen
projects/DualFocus/dualfocus/model/language_model/mpt/flash_attn_triton.py:155
Function_fwd_kernel(Q, K, V, Bias, Out, Lse, TMP, softmax_scale, stride_qb, stride_qh, stride_qm, stride_kb, stride_kh, stride_kn
projects/DualFocus/dualfocus/model/language_model/mpt/flash_attn_triton.py:51