Infer LLType for ast.Constant nodes (handles primitives and LLType constants)

Checks if 'npu-smi' is available on the system's PATH.

Downstream projects and distributions which bootstrap their own dependencies from scratch and run builds in offline sandboxes may set `TR

Check if the type is a struct

Convert an LLType instance to a valid C++ type string.

Fused dispatch + grouped GEMM-1. Returns ``(gemm1_out[M, inter], desc)``.

Fused grouped GEMM-2 + combine (serial/gather). Returns ``[num_tokens, hidden]``.

Run function with warmup, return last result and avg time in ms.

Register a unary operator handler.

Resolve method return type using multiple strategies. Args: var_name: Name of the variable (e.g., 'scheduler')

Scans a list of statements for variable definitions and adds them to current scope. This follows Python's semantics: any ass

Seed everything for better reproducibility. (some pytorch operation is non-deterministic like the backprop of grid_samples)

Sort 2D tensor rows lexicographically (order-agnostic comparison).

if we choose tile first in N within group_size_N, maybe each group with N = 1024, for BLOCK_SIZE_N = 64, then 16 tiles per tiled_m. maybe too muc

if we choose tile first in N within group_size_N, maybe each group with N = 1024, for BLOCK_SIZE_N = 64, then 16 tiles per tiled_m. maybe too muc

Reference PyTorch all-to-all implementation

Write to code buffer without newline (for mixin compatibility).

Compute, in torch, everything the fused kernel needs that is cheaper / safer to derive on the host: the cross-rank split exchange, the destination

Format an attribute value for display.

Get method return type from class definition by parsing its AST.

Get method return type from class definition by parsing its AST.

Get next valid K group.

Core inlining logic: - is_statement: True if call is standalone (e.g., 'func()'), False if assigned (e.g., 'x = func()') - lh

Checks if 'rocm-smi' is available on the system's PATH.

Check if function is a special struct constructor. Returns the struct name if it's a registered special struct constructor,

Simple LLType to C++ type conversion for simple_builtin. This is a simplified version that doesn't require a full emitter context.

Resolve a callable from AST node.

Applies Rotary Position Embedding inplace.

Check if two tensors are close within a tolerance.