MCPcopy Create free account

hub / github.com/NVIDIA/SOL-ExecBench / functions

Functions597 in github.com/NVIDIA/SOL-ExecBench

Methodtest_data_ptr_shifts_by_alignment
Consecutive calls shift data_ptr by _POOL_ALIGNMENT bytes.
tests/sol_execbench/core/bench/test_io.py:460
Methodtest_deep_overlap
Blob root contains multiple leading components of the relative path.
tests/sol_execbench/core/bench/test_io.py:384
Methodtest_default_cuda_cflags
(self, tmp_path)
tests/sol_execbench/driver/test_build_ext.py:180
Methodtest_default_cutlass_dir
(self, tmp_path)
tests/sol_execbench/driver/test_build_ext.py:223
Methodtest_definition_json_written
( self, tmp_path, definition, workloads, python_solution, config )
tests/sol_execbench/driver/test_problem_packager.py:132
Methodtest_description_match
(self)
tests/sol_execbench/core/bench/test_io.py:172
Methodtest_description_match
(self)
tests/sol_execbench/core/bench/test_io.py:239
Methodtest_dict_passthrough
(self)
tests/sol_execbench/core/bench/test_io.py:669
Methodtest_does_not_raise_on_failure
unlock_clocks is best-effort — exceptions are swallowed.
tests/sol_execbench/core/bench/test_clock_lock.py:348
Methodtest_dram_outside_tolerance
(self)
tests/sol_execbench/core/bench/test_clock_lock.py:291
Methodtest_dtype_preserved
Returned tensors have the same dtype as the original input.
tests/sol_execbench/core/bench/test_io.py:501
Functiontest_e2e
End-to-end evaluation: load sample -> package -> compile (if C++) -> execute -> assert PASSED.
tests/sol_execbench/test_e2e.py:184
Functiontest_emit_uses_strict_json
_emit() must use allow_nan=False so NaN/Inf crashes loudly (no torch required).
tests/sol_execbench/driver/test_eval_driver.py:423
Methodtest_empty_inputs_and_outputs
Works with no inputs and no outputs.
tests/sol_execbench/core/bench/test_io.py:607
Methodtest_empty_output
(self)
tests/sol_execbench/core/bench/test_clock_lock.py:315
Methodtest_empty_snapshot_always_passes
(self)
tests/sol_execbench/core/bench/test_reward_hack.py:149
Methodtest_empty_string_raises
(self)
tests/sol_execbench/core/data/test_dtypes.py:57
Methodtest_empty_string_raises
(self)
tests/sol_execbench/core/data/test_dtypes.py:89
Methodtest_empty_string_returns_none
(self)
tests/sol_execbench/core/bench/test_clock_lock.py:401
Methodtest_empty_tensors
(self)
tests/sol_execbench/core/bench/test_correctness.py:69
Methodtest_env_var_overrides_preset
SOL_EXECBENCH_GPU_CLK_MHZ and SOL_EXECBENCH_DRAM_CLK_MHZ override preset values.
tests/sol_execbench/core/bench/test_clock_lock.py:160
Methodtest_env_var_overrides_unknown_device
Env var overrides allow locking even for unknown devices.
tests/sol_execbench/core/bench/test_clock_lock.py:181
Methodtest_error_message_includes_actual_type_name
(self)
tests/sol_execbench/core/bench/test_reward_hack.py:103
Methodtest_error_message_includes_both_counts
(self)
tests/sol_execbench/core/bench/test_reward_hack.py:67
Functiontest_eval_driver_is_valid_python
build_driver() must produce a syntactically valid Python script.
tests/sol_execbench/driver/test_eval_driver.py:164
Methodtest_eval_driver_staged
( self, tmp_path, definition, workloads, python_solution, config )
tests/sol_execbench/driver/test_problem_packager.py:249
Methodtest_every_language_accepted_alone
(self, lang)
tests/sol_execbench/core/data/test_solution.py:97
Methodtest_exact_match
Full relative path exists directly under blob root.
tests/sol_execbench/core/bench/test_io.py:367
Methodtest_exact_tolerance_boundary
Error exactly at the tolerance boundary.
tests/sol_execbench/core/bench/test_correctness.py:170
Functiontest_example
End-to-end evaluation: load example -> package -> compile (if C++) -> execute -> assert PASSED.
tests/examples/test_examples.py:196
Methodtest_exceeds_tolerance
(self)
tests/sol_execbench/core/bench/test_correctness.py:59
Methodtest_expanded_tensor_preserves_strides
Expanded (stride-0) tensors store only physical elements, not logical numel.
tests/sol_execbench/core/bench/test_io.py:565
Methodtest_expr_axis_evaluated
(self)
tests/sol_execbench/core/data/test_definition.py:58
Methodtest_falls_through_to_second_root
Falls through to second blob root when first has no match.
tests/sol_execbench/core/bench/test_io.py:422
Methodtest_false_cases
(self, name)
tests/sol_execbench/core/bench/test_io.py:126
Methodtest_false_cases
(self, name)
tests/sol_execbench/core/bench/test_io.py:148
Methodtest_false_cases
(self, name)
tests/sol_execbench/core/bench/test_io.py:161
Methodtest_false_cases
(self)
tests/sol_execbench/core/bench/test_io.py:208
Methodtest_false_cases
(self)
tests/sol_execbench/core/bench/test_io.py:219
Methodtest_false_cases
(self)
tests/sol_execbench/core/bench/test_io.py:228
Methodtest_false_cases
(self)
tests/sol_execbench/core/bench/test_io.py:242
Methodtest_float16
(self)
tests/sol_execbench/core/bench/test_io.py:54
Methodtest_float16_inputs
float16 inputs are upcast to float32 internally.
tests/sol_execbench/core/bench/test_correctness.py:255
Methodtest_float32
(self)
tests/sol_execbench/core/bench/test_io.py:49
Methodtest_float8_e4m3fn
(self)
tests/sol_execbench/core/bench/test_io.py:62
Methodtest_float8_e5m2
(self)
tests/sol_execbench/core/bench/test_io.py:66
Methodtest_float_dtypes
(self, dtype)
tests/sol_execbench/core/data/test_dtypes.py:108
Methodtest_fp8_dtype_returns_none
FP8 dtypes must skip heuristics (torch.randn etc. don't support FP8).
tests/sol_execbench/core/bench/test_io.py:353
Methodtest_gencode_injected_for_blackwell
( self, tmp_path, definition, workloads, cuda_solution, config )
tests/sol_execbench/driver/test_problem_packager.py:204
Methodtest_gencode_not_injected_when_explicit
( self, tmp_path, definition, workloads, config )
tests/sol_execbench/driver/test_problem_packager.py:213
Methodtest_h100_exact
(self)
tests/sol_execbench/core/bench/test_clock_lock.py:382
Methodtest_h100_with_full_product_name
(self)
tests/sol_execbench/core/bench/test_clock_lock.py:386
Methodtest_identical_tensors
(self)
tests/sol_execbench/core/bench/test_correctness.py:46
Methodtest_ignores_non_source_files
(self, tmp_path)
tests/sol_execbench/driver/test_build_ext.py:154
Methodtest_inf_among_valid_elements
A single spurious inf in an otherwise correct tensor fails.
tests/sol_execbench/core/bench/test_correctness.py:329
Methodtest_inf_in_output
Inf in output produces inf abs_error and fails.
tests/sol_execbench/core/bench/test_correctness.py:299
Methodtest_inf_in_reference_only
Inf in reference (but not output) is also incorrect.
tests/sol_execbench/core/bench/test_correctness.py:357
Functiontest_inf_kernel_produces_valid_json
Kernel that outputs Inf must produce strictly valid JSON traces.
tests/sol_execbench/driver/test_eval_driver.py:464
Methodtest_inf_output_sets_has_inf_flag
Inf in output returns Correctness with has_inf=True and finite errors.
tests/sol_execbench/core/bench/test_correctness.py:546
Methodtest_input_data_preserved
Returned views contain the same data as the original input.
tests/sol_execbench/core/bench/test_io.py:469
Methodtest_input_data_survives_inplace_mutation
Source data is re-copied each call, so in-place mutation of a view does not corrupt subsequent calls.
tests/sol_execbench/core/bench/test_io.py:478
Methodtest_input_name_colliding_with_axis_name_raises
(self)
tests/sol_execbench/core/data/test_definition.py:109
Methodtest_int32
(self)
tests/sol_execbench/core/bench/test_io.py:81
Methodtest_int64
(self)
tests/sol_execbench/core/bench/test_io.py:85
Methodtest_int8
(self)
tests/sol_execbench/core/bench/test_io.py:75
Methodtest_integer_dtype_returns_none
(self)
tests/sol_execbench/core/bench/test_io.py:346
Methodtest_integer_dtypes
(self, dtype)
tests/sol_execbench/core/data/test_dtypes.py:101
Methodtest_invalid_python_reference_raises
(self)
tests/sol_execbench/core/data/test_definition.py:94
Methodtest_known_mask_names
(self, name)
tests/sol_execbench/core/bench/test_io.py:188
Methodtest_large_matmul_exceeds_small
4096x4096 matmul takes measurably longer than 128x128.
tests/sol_execbench/core/bench/test_timing.py:185
Methodtest_large_matmul_exceeds_small
4096x4096 matmul takes measurably longer than 128x128.
tests/sol_execbench/core/bench/test_timing.py:445
Methodtest_large_tensor_near_zero_outlier_with_relaxed_ratio
Same as above but with relaxed ratio — passes.
tests/sol_execbench/core/bench/test_correctness.py:285
Methodtest_large_tensor_single_near_zero_outlier
One near-zero element with error, rest are fine.
tests/sol_execbench/core/bench/test_correctness.py:274
Functiontest_lazy_output_detected
Kernel that returns a torch.Tensor subclass → REWARD_HACK.
tests/sol_execbench/driver/test_eval_driver.py:253
Methodtest_load_called_with_correct_name
(self, tmp_path)
tests/sol_execbench/driver/test_build_ext.py:267
Functiontest_load_inline_blocked_at_import
Kernel that calls load_inline at import time → subprocess crash.
tests/sol_execbench/driver/test_eval_driver.py:356
Functiontest_load_inline_blocked_in_run
Kernel that calls load_inline inside run() → RUNTIME_ERROR.
tests/sol_execbench/driver/test_eval_driver.py:335
Methodtest_lock_clocks_false_locked_proceeds
lock_clocks=False + SOL_EXECBENCH_CLOCKS_LOCKED=1 → should proceed.
tests/sol_execbench/core/bench/test_make_eval_clock_warn.py:95
Methodtest_lock_clocks_false_unlocked_proceeds
lock_clocks=False + SOL_EXECBENCH_CLOCKS_LOCKED=0 → should proceed.
tests/sol_execbench/core/bench/test_make_eval_clock_warn.py:86
Methodtest_lock_clocks_true_locked_proceeds
lock_clocks=True + SOL_EXECBENCH_CLOCKS_LOCKED=1 → should proceed.
tests/sol_execbench/core/bench/test_make_eval_clock_warn.py:77
Methodtest_lock_clocks_true_unlocked_rejects
lock_clocks=True + SOL_EXECBENCH_CLOCKS_LOCKED=0 → should reject.
tests/sol_execbench/core/bench/test_make_eval_clock_warn.py:68
Methodtest_locks_a100_at_correct_frequencies
(self)
tests/sol_execbench/core/bench/test_clock_lock.py:134
Methodtest_locks_gpu_and_dram_for_known_device
Known device → calls -lgc and -lmc with correct frequencies.
tests/sol_execbench/core/bench/test_clock_lock.py:99
Methodtest_locks_h100_at_correct_frequencies
(self)
tests/sol_execbench/core/bench/test_clock_lock.py:117
Methodtest_malformed_output
(self)
tests/sol_execbench/core/bench/test_clock_lock.py:320
Methodtest_matching_inf_fails
Matching infinities (both +inf) are still incorrect.
tests/sol_execbench/core/bench/test_correctness.py:343
Methodtest_matching_neg_inf_fails
Matching negative infinities are still incorrect.
tests/sol_execbench/core/bench/test_correctness.py:350
Methodtest_matching_neg_inf_passes_when_allowed
Both tensors have -inf at the same position — accepted.
tests/sol_execbench/core/bench/test_correctness.py:396
Methodtest_matching_neg_inf_still_fails_when_not_allowed
Default behavior: matching -inf fails.
tests/sol_execbench/core/bench/test_correctness.py:406
Methodtest_matmul_timing_variance
Trimmed min/max ratio stays bounded across matmul sizes. Small matmuls (64-512) are launch-overhead dominated and show wider variance
tests/sol_execbench/core/bench/test_timing.py:726
Methodtest_max_error_cap_boundary
Cap uses strict greater-than (not strictly greater).
tests/sol_execbench/core/bench/test_correctness.py:516
Methodtest_max_error_cap_fails
Error above cap fails even with good matched ratio.
tests/sol_execbench/core/bench/test_correctness.py:501
Methodtest_max_error_cap_no_cap
Without cap, large outlier errors pass if matched ratio is met.
tests/sol_execbench/core/bench/test_correctness.py:476
Methodtest_max_error_cap_passes
Error below cap passes normally.
tests/sol_execbench/core/bench/test_correctness.py:486
Methodtest_mean
(self)
tests/sol_execbench/core/bench/test_timing.py:76
Methodtest_median
(self)
tests/sol_execbench/core/bench/test_timing.py:79
Methodtest_mismatched_inf_sign_fails
+inf vs -inf at the same position fails.
tests/sol_execbench/core/bench/test_correctness.py:371
Methodtest_missing_custom_inputs_entrypoint_in_reference_raises
(self)
tests/sol_execbench/core/data/test_definition.py:117
Methodtest_missing_custom_tensors_raises
(self)
tests/sol_execbench/core/bench/test_io.py:777
Methodtest_missing_file_raises
(self, tmp_path)
tests/sol_execbench/core/bench/test_io.py:844
← previousnext →301–400 of 597, ranked by callers