Method__init__No state; the op is a pure function over (q, k_cache, v_cache, k_new, v_new, ...).
rl_engine/kernels/ops/pytorch/attention/kv_cache.py:50
Function_bwd_kernel(
Q,
K,
V,
sm_scale,
Out,
DO,
DQ,
DK,
DV,
L,
M,
Delta,
str
rl_engine/kernels/ops/triton/triton_attn.py:186
Function_bwd_preprocess(
Out,
DO,
Delta,
stride_oz,
stride_oh,
stride_om,
stride_on,
stride_doz,
rl_engine/kernels/ops/triton/triton_attn.py:135
Function_fwd_kernel(
Q,
K,
V,
sm_scale,
L,
M,
Out,
stride_qz,
stride_qh,
stride_qm,
s
rl_engine/kernels/ops/triton/triton_attn.py:7
Function_ratio_kl_bwd_kernel(
policy_ptr,
action_ptr,
mask_ptr,
ratio_ptr,
diff_ptr,
logz_ptr,
grad_ratio_ptr,
rl_engine/kernels/ops/triton/loss/ratio_kl.py:87
Function_ratio_kl_fwd_kernel(
policy_ptr,
ref_ptr,
action_ptr,
mask_ptr,
old_ptr,
ratio_ptr,
kl_ptr,
diff_
rl_engine/kernels/ops/triton/loss/ratio_kl.py:22