MCPcopy Create free account

hub / github.com/NVIDIA/SOL-ExecBench / functions

Functions597 in github.com/NVIDIA/SOL-ExecBench

Methodget_axes_values_from_inputs
Get concrete variable axis values directly from input values. Convenience method that combines extract_shapes and get_var_axes_values.
src/sol_execbench/core/data/definition.py:428
Methodget_entry_path
Extract the file path from the entry point specification. The entry point format is '{file_path}::{function_name}', and this method r
src/sol_execbench/core/data/solution.py:285
Methodget_entry_source
Get the entry source file specified in the build spec. Returns ------- Optional[SourceFile] The SourceFile object
src/sol_execbench/core/data/solution.py:312
Methodget_entry_symbol
Extract the function/symbol name from the entry point specification. The entry point format is '{file_path}::{function_name}', and this metho
src/sol_execbench/core/data/solution.py:298
Methodhash
Return the memoized deterministic hash of the solution content. This hash is computed from all fields that affect the solution's behavior:
src/sol_execbench/core/data/solution.py:346
Functionis_cuda_available
()
src/sol_execbench/core/utils.py:28
Methodkernel
(a)
tests/sol_execbench/core/bench/test_timing.py:368
Functionlist_cuda_devices
()
src/sol_execbench/core/utils.py:34
Functionload_json_file
Load a Pydantic BaseModel object from a JSON file. Parameters ---------- model_cls : Type[BaseModel] The Pydantic BaseModel
src/sol_execbench/core/data/json_utils.py:44
Functionload_jsonl_file
Load a list of Pydantic BaseModel objects from a JSONL file. Each line in the JSONL file should contain a valid JSON object that can be deser
src/sol_execbench/core/data/json_utils.py:93
Functionmatmul_kernel
(A, B, C, tm: ConstInt, tn: ConstInt, tk: ConstInt)
examples/cutile/jamba_attn_proj/kernel.py:26
Methodmodel_post_init
(self, __context: Any)
src/sol_execbench/core/data/solution.py:326
Methodnon_negative
(cls, v: float)
src/sol_execbench/core/data/trace.py:52
Methodpatched
(fn, args, device, warmup=None, **kwargs)
tests/sol_execbench/core/bench/test_reward_hack.py:164
Functionpytest_collection_modifyitems
Skip tests based on hardware availability. Also skips timing_serial tests unless explicitly selected with -m.
tests/conftest.py:49
Functionpytest_configure
Register custom markers.
tests/conftest.py:41
Functionpython_solution
()
tests/sol_execbench/driver/test_problem_packager.py:97
Methodreal_time_runnable
(fn, args, device, warmup=10, rep=50)
tests/sol_execbench/core/bench/test_reward_hack.py:155
Functionredirect_stdio_to_file
Redirect stdout/stderr to log file. Returns original stdout and stderr file descriptors for printing to terminal.
src/sol_execbench/core/utils.py:89
Functionrmsnorm_fwd
Wrapper for Triton kernel (destination-passing style).
examples/triton/rmsnorm/kernel.py:40
Functionrun
(x, y)
tests/sol_execbench/samples/evil_monkey_patch/kernel.py:30
Functionrun
(x, y)
tests/sol_execbench/samples/evil_lazy_output/kernel.py:29
Functionrun
(x, y)
tests/sol_execbench/samples/evil_thread_inject/kernel.py:27
Functionrun
(sublayer_output, residual, weight, eps)
examples/triton/olmo3_post_norm/kernel.py:25
Functionrun
Post-normalization residual connection: output = residual + RMSNorm(sublayer_output) RMSNorm computation: 1. Compute variance: mean
examples/triton/olmo3_post_norm/reference.py:4
Functionrun
(hidden_states, weight)
examples/triton/rmsnorm/reference.py:4
Functionrun
(hidden_states, residual, weight, eps)
examples/triton/nemotron_rms_norm/kernel.py:29
Functionrun
(hidden_states: torch.Tensor, residual: torch.Tensor, weight: torch.Tensor, eps: float)
examples/triton/nemotron_rms_norm/reference.py:4
Functionrun
(A, B)
examples/cutlass/gemm/reference.py:4
Functionrun
examples/cutlass/gemm/main.cpp:5
Functionrun
(attn_output, residual, o_proj_weight)
examples/cute_dsl/jamba_attn_proj/kernel.py:60
Functionrun
Fused attention output projection with residual addition. This performs: 1. Linear projection: attn_output @ o_proj_weight.T 2.
examples/cute_dsl/jamba_attn_proj/reference.py:5
Functionrun
(input)
examples/cudnn/softmax/reference.py:4
Functionrun
(hidden_states, weight)
examples/cuda_cpp/rmsnorm/reference.py:4
Functionrun
* @brief Python-bindable 'run' function for RMSNorm. * * This function serves as the entry point from Python. It performs extensive * validation on
examples/cuda_cpp/rmsnorm/main.cpp:24
Functionrun
Apply rotary position embeddings to query or key tensor. The rotation is applied using the formula: - Split features into pairs (x1,
examples/cuda_cpp/flux_rope/reference.py:4
Functionrun
(attn_output, residual, o_proj_weight)
examples/cutile/jamba_attn_proj/kernel.py:54
Functionrun
Fused attention output projection with residual addition. This performs: 1. Linear projection: attn_output @ o_proj_weight.T 2.
examples/cutile/jamba_attn_proj/reference.py:5
Functionrun
(x: torch.Tensor, gate_proj: torch.Tensor, up_proj: torch.Tensor)
examples/pytorch/gemma3_swiglu/kernel.py:5
Functionrun
Fused gate and up projection with GELU-tanh activation. Computes: gelu_tanh(x @ gate_proj.T) * (x @ up_proj.T) Args: x:
examples/pytorch/gemma3_swiglu/reference.py:5
Functionrun
(grad_output, x, weight)
examples/pytorch/linear_backward/kernel.py:4
Functionrun
(grad_output, x, weight)
examples/pytorch/linear_backward/reference.py:13
Functionsave_json_file
Save a Pydantic BaseModel object to a JSON file. Parameters ---------- object : BaseModel The Pydantic BaseModel instance to
src/sol_execbench/core/data/json_utils.py:26
Functionsave_jsonl_file
Save a list of Pydantic BaseModel objects to a JSONL file. Each object is serialized as a separate JSON object on its own line. Paramete
src/sol_execbench/core/data/json_utils.py:72
Methodsetup
()
tests/sol_execbench/core/bench/test_timing.py:118
Methodside_effect
(*args, **kwargs)
tests/sol_execbench/core/bench/test_clock_lock.py:221
Functionsol_score
Compute anchored score S(T_k). S(T_k) = 1 / (1 + (T_k - T_SOL) / (T_b - T_SOL)) T_b can be set as any fast implementation of the refere
src/sol_execbench/sol_score.py:1
Methodstream_hidden_kernel
(x)
tests/sol_execbench/core/bench/test_timing.py:813
Methodstream_hide_with_wait
(x)
tests/sol_execbench/core/bench/test_timing.py:836
Methodtest_1d_always_false
(self)
tests/sol_execbench/core/bench/test_io.py:129
Methodtest_1d_false
(self)
tests/sol_execbench/core/bench/test_io.py:180
Methodtest_a100_with_full_product_name
(self)
tests/sol_execbench/core/bench/test_clock_lock.py:392
Methodtest_all
(self)
tests/sol_execbench/core/bench/test_timing.py:82
Methodtest_all_axis_types_combined
(self)
tests/sol_execbench/core/data/test_definition.py:66
Methodtest_all_custom_returns_empty
(self)
tests/sol_execbench/core/data/test_workload.py:54
Methodtest_all_inf_output
Entirely inf output fails when reference is finite.
tests/sol_execbench/core/bench/test_correctness.py:385
Methodtest_all_matching_neg_inf_passes_when_allowed
All elements are matching -inf — treated as fully correct.
tests/sol_execbench/core/bench/test_correctness.py:414
Methodtest_all_nan_output
Entirely NaN output fails.
tests/sol_execbench/core/bench/test_correctness.py:378
Methodtest_all_zeros_output_returns_finite_errors
All-zeros output (nonzero ref) returns finite error values, no flags.
tests/sol_execbench/core/bench/test_correctness.py:574
Methodtest_already_named_correctly
(self, tmp_path)
tests/sol_execbench/driver/test_build_ext.py:252
Methodtest_asserts_on_python_solution
( self, tmp_path, definition, workloads, python_solution, config )
tests/sol_execbench/driver/test_problem_packager.py:230
Methodtest_atol_dominates_for_small_reference
For near-zero references, atol term dominates tolerance.
tests/sol_execbench/core/bench/test_correctness.py:160
Methodtest_b200
(self)
tests/sol_execbench/core/bench/test_clock_lock.py:378
Methodtest_bench_time_with_cuda_events_calls_setup_for_each_rep
setup() is called once per timed iteration (not during measurement).
tests/sol_execbench/core/bench/test_timing.py:109
Methodtest_bench_time_with_cuda_events_return_modes
Different return_mode values produce correct summaries.
tests/sol_execbench/core/bench/test_timing.py:141
Methodtest_bench_time_with_cuda_events_warmup_and_rep
Warmup and rep counts are respected.
tests/sol_execbench/core/bench/test_timing.py:129
Methodtest_bfloat16
(self)
tests/sol_execbench/core/bench/test_io.py:58
Methodtest_bfloat16_inputs
bfloat16 inputs are upcast to float32 internally.
tests/sol_execbench/core/bench/test_correctness.py:262
Methodtest_binary_mask_values
(self)
tests/sol_execbench/core/bench/test_io.py:277
Methodtest_bool
(self)
tests/sol_execbench/core/bench/test_io.py:70
Methodtest_both_zero
Both output and reference are zero — no error.
tests/sol_execbench/core/bench/test_correctness.py:113
Methodtest_build_directory_is_cwd
(self, tmp_path)
tests/sol_execbench/driver/test_build_ext.py:273
Methodtest_build_ext_staged
( self, tmp_path, definition, workloads, cuda_solution, config )
tests/sol_execbench/driver/test_problem_packager.py:195
Methodtest_calls_rgc_and_rmc
(self)
tests/sol_execbench/core/bench/test_clock_lock.py:336
Methodtest_causal_mask_name
(self)
tests/sol_execbench/core/bench/test_io.py:169
Methodtest_causal_mask_upper_triangular
(self)
tests/sol_execbench/core/bench/test_io.py:266
Methodtest_cflags_default_empty
(self, tmp_path)
tests/sol_execbench/driver/test_build_ext.py:201
Functiontest_cli_gqa_paged_decode
CLI e2e: run sol-execbench on a GQA paged-decode problem with safetensors inputs.
tests/sol_execbench/test_e2e.py:309
Methodtest_clocks_locked_no
When clocks are not locked, log starts with 'Clocks locked: no'.
tests/sol_execbench/core/bench/test_make_eval_clock_warn.py:49
Methodtest_clocks_locked_yes
When clocks are locked, log starts with 'Clocks locked: yes'.
tests/sol_execbench/core/bench/test_make_eval_clock_warn.py:44
Methodtest_clones_tensors
Tensor arguments are cloned (different storage).
tests/sol_execbench/core/bench/test_timing.py:43
Methodtest_collects_multiple_sources
(self, tmp_path)
tests/sol_execbench/driver/test_build_ext.py:164
Methodtest_collects_supported_extensions
(self, tmp_path, suffix)
tests/sol_execbench/driver/test_build_ext.py:146
Methodtest_compute_error_stats_nan_returns_finite
compute_error_stats with NaN output returns finite abs/rel error values.
tests/sol_execbench/core/bench/test_correctness.py:614
Methodtest_compute_scales_with_size
Doubling matmul dimension should roughly 8x the FLOPs and increase time.
tests/sol_execbench/core/bench/test_timing.py:201
Methodtest_compute_scales_with_size
Doubling matmul dimension should roughly 8x the FLOPs and increase time.
tests/sol_execbench/core/bench/test_timing.py:461
Methodtest_config_json_written
( self, tmp_path, definition, workloads, python_solution, config )
tests/sol_execbench/driver/test_problem_packager.py:157
Functiontest_consistency
Verify extracted source files match the content in definition.json and solution JSON.
tests/examples/test_examples.py:276
Methodtest_const_axis_included
(self)
tests/sol_execbench/core/data/test_definition.py:48
Methodtest_correctness_error_values_are_json_safe
All Correctness instances from compute_error_stats have JSON-safe floats.
tests/sol_execbench/core/bench/test_correctness.py:585
Functiontest_cpp_getCurrentCUDAStream_allowed
C++ files may use getCurrentCUDAStream (the default stream).
tests/sol_execbench/driver/test_eval_driver.py:386
Methodtest_cpp_language_accepts_valid_suffixes
(self, suffix)
tests/sol_execbench/core/data/test_solution.py:137
Methodtest_cpp_language_rejects_py_entry
(self, lang)
tests/sol_execbench/core/data/test_solution.py:128
Methodtest_cuda_sources_written
( self, tmp_path, definition, workloads, cuda_solution, config )
tests/sol_execbench/driver/test_problem_packager.py:174
Methodtest_cupti_leq_cuda_events
CUPTI median should be <= CUDA events median. For short kernels CUPTI is strictly less due to the ~4-6us event overhead. For long ke
tests/sol_execbench/core/bench/test_timing.py:689
Methodtest_custom_cflags
(self, tmp_path)
tests/sol_execbench/driver/test_build_ext.py:207
Methodtest_custom_cuda_cflags
(self, tmp_path)
tests/sol_execbench/driver/test_build_ext.py:194
Methodtest_custom_cutlass_dir
(self, tmp_path)
tests/sol_execbench/driver/test_build_ext.py:232
Methodtest_custom_ld_flags
(self, tmp_path)
tests/sol_execbench/driver/test_build_ext.py:213
Methodtest_custom_tolerance
tolerance_mhz=10 makes a 30 MHz deviation fail.
tests/sol_execbench/core/bench/test_clock_lock.py:325
← previousnext →201–300 of 597, ranked by callers