Commonly used utility functions

Initialize params member

Computes the inverse of a 2-by-2 matrix given the matrix's determinant

Obtains a Coord<2> from GemmCoord

Loads a fragment

Perform a Producer Epilogue to prevent early exit of ctas in a Cluster

Perform a Producer Epilogue to prevent early exit of ctas in a Cluster

Perform a Producer Epilogue to prevent early exit of blocks in a Cluster

Load

Perform a threadblock mainloop iteration of matrix multiply-accumulate

Obtains a Coord<2> from GemmCoord

Issue Tma Descriptor Prefetch -- ideally from a single thread for best performance

Build all tensors required for rope_norm_store_kv[_fp8] tests. For prefill (is_prefill=True): variable Q tokens per request (random suffix sampl

GEMM prologue. Bootstrap the global->shared memory pipeline by fetching the global fragments needed by the first kStages-1 threadblock mainloop itera

PyTorch reference for temperature-only Gumbel-max sampling.

Unified PyTorch reference: RoPE + optional RMSNorm + paged KV write. Handles prefill, decode (mtp=0), and MTP decode (mtp>=1) uniformly via q_ind

Overrides the internal iteration index

Overrides the internal iteration index

Sets the predicate mask, overriding value stored in predicate iterator

Sets the predicate mask, overriding value stored in predicate iterator

Set base smem address

Store

Returns the layout object's stride vector

Computes starting Dx coord (h, w) for given starting filter postion

Returns arguments for the transposed matrices

Whether this block will perform the last iteration of this tile