MCPcopy Create free account

hub / github.com/NVIDIA/SOL-ExecBench / functions

Functions597 in github.com/NVIDIA/SOL-ExecBench

Methodtest_missing_run_function_raises
(self)
tests/sol_execbench/core/data/test_definition.py:90
Methodtest_missing_safetensors_raises
(self)
tests/sol_execbench/core/bench/test_io.py:753
Methodtest_mixed_args
Mix of tensors and non-tensors.
tests/sol_execbench/core/bench/test_timing.py:59
Methodtest_mixed_inputs_and_outputs
Correct ordering: inputs (tensors + scalars) then outputs.
tests/sol_execbench/core/bench/test_io.py:590
Methodtest_mixed_inputs_returns_only_scalars
(self)
tests/sol_execbench/core/data/test_workload.py:46
Methodtest_mixed_languages_rejected
(self, langs)
tests/sol_execbench/core/data/test_solution.py:90
Methodtest_mixed_nan_inf_prefers_has_nan
When both NaN and Inf are present, has_nan takes priority.
tests/sol_execbench/core/bench/test_correctness.py:565
Methodtest_mixed_near_zero_and_large
Mix of near-zero and large reference values.
tests/sol_execbench/core/bench/test_correctness.py:123
Functiontest_monkey_patch_detected
Kernel that patches torch.cuda.Event.elapsed_time at import → REWARD_HACK.
tests/sol_execbench/driver/test_eval_driver.py:183
Methodtest_multi_gpu_all_match
(self)
tests/sol_execbench/core/bench/test_clock_lock.py:296
Methodtest_multi_gpu_one_mismatch
(self)
tests/sol_execbench/core/bench/test_clock_lock.py:301
Methodtest_multiple_roots_first_match_wins
First blob root with a match is used.
tests/sol_execbench/core/bench/test_io.py:410
Methodtest_multiple_scalars
(self)
tests/sol_execbench/core/data/test_workload.py:39
Methodtest_nan_among_valid_elements
A single NaN in an otherwise correct tensor fails.
tests/sol_execbench/core/bench/test_correctness.py:313
Functiontest_nan_correctness_fields_are_finite_with_flags
NaN outputs must produce finite correctness values with has_nan=True.
tests/sol_execbench/driver/test_eval_driver.py:484
Methodtest_nan_fails_even_with_relaxed_ratio
NaN triggers early sanity check, bypassing matched-ratio tolerance.
tests/sol_execbench/core/bench/test_correctness.py:320
Methodtest_nan_in_output
NaN in output produces non-finite abs_error and fails.
tests/sol_execbench/core/bench/test_correctness.py:306
Methodtest_nan_in_reference_only
NaN in reference (but not output) is also incorrect.
tests/sol_execbench/core/bench/test_correctness.py:364
Methodtest_nan_in_reference_sets_has_nan_flag
NaN in reference also triggers has_nan.
tests/sol_execbench/core/bench/test_correctness.py:557
Functiontest_nan_kernel_produces_valid_json
Kernel that outputs NaN must produce strictly valid JSON traces. Regression test: Python's json.dumps(allow_nan=True) serializes NaN as the J
tests/sol_execbench/driver/test_eval_driver.py:435
Methodtest_nan_output_sets_has_nan_flag
NaN in output returns Correctness with has_nan=True and finite errors.
tests/sol_execbench/core/bench/test_correctness.py:535
Methodtest_nan_still_fails_when_neg_inf_allowed
NaN is not affected by allow_negative_inf.
tests/sol_execbench/core/bench/test_correctness.py:448
Methodtest_neg_inf_allowed_mixed_inf_sign_fails
-inf vs +inf at same position fails even when allow_negative_inf.
tests/sol_execbench/core/bench/test_correctness.py:464
Methodtest_neg_inf_allowed_with_finite_errors
Matching -inf excluded; error computed on remaining elements.
tests/sol_execbench/core/bench/test_correctness.py:456
Methodtest_neg_inf_only_in_output_fails_when_allowed
-inf in output but not reference still fails.
tests/sol_execbench/core/bench/test_correctness.py:424
Methodtest_neg_inf_only_in_reference_fails_when_allowed
-inf in reference but not output still fails.
tests/sol_execbench/core/bench/test_correctness.py:432
Methodtest_negative_inf_in_output
Negative inf in output fails when reference is finite.
tests/sol_execbench/core/bench/test_correctness.py:336
Methodtest_negative_near_zero_reference
Negative near-zero reference — clamp uses abs, so same behavior.
tests/sol_execbench/core/bench/test_correctness.py:135
Methodtest_no_compile_options_gives_empty_flags
(self, tmp_path)
tests/sol_execbench/driver/test_build_ext.py:187
Methodtest_no_heuristic_returns_none
(self)
tests/sol_execbench/core/bench/test_io.py:340
Methodtest_no_match_returns_none
No blob root contains the file.
tests/sol_execbench/core/bench/test_io.py:393
Methodtest_no_scalars_returns_empty
(self)
tests/sol_execbench/core/data/test_workload.py:27
Methodtest_no_so_raises
(self, tmp_path)
tests/sol_execbench/driver/test_build_ext.py:258
Methodtest_no_sources_raises
(self, tmp_path)
tests/sol_execbench/driver/test_build_ext.py:172
Methodtest_no_status_extra_msg_only
Empty status string: log == extra_msg.
tests/sol_execbench/core/bench/test_make_eval_clock_warn.py:61
Methodtest_non_default_stream_timing_matches_default
Kernel on a non-default stream reports the same time as default stream.
tests/sol_execbench/core/bench/test_timing.py:805
Methodtest_non_mask_name
(self)
tests/sol_execbench/core/bench/test_io.py:197
Methodtest_non_square_false
(self)
tests/sol_execbench/core/bench/test_io.py:177
Methodtest_norm_bias_zeros
(self)
tests/sol_execbench/core/bench/test_io.py:259
Methodtest_norm_weight_ones
(self)
tests/sol_execbench/core/bench/test_io.py:252
Methodtest_nvidia_smi_nonzero_exit
(self)
tests/sol_execbench/core/bench/test_clock_lock.py:310
Methodtest_nvidia_smi_not_found
(self)
tests/sol_execbench/core/bench/test_clock_lock.py:306
Methodtest_output_shape
(self)
tests/sol_execbench/core/bench/test_io.py:100
Methodtest_output_unique_data_ptr
DPS output tensors also get unique data_ptr per call.
tests/sol_execbench/core/bench/test_io.py:535
Methodtest_outputs_zero_filled
DPS output tensors are zero-filled on every call.
tests/sol_execbench/core/bench/test_io.py:522
Methodtest_overlapping_input_output_names_raises
(self)
tests/sol_execbench/core/data/test_definition.py:102
Methodtest_parses_multiple_traces
( self, tmp_path, definition, workloads, python_solution, config )
tests/sol_execbench/driver/test_problem_packager.py:316
Methodtest_parses_single_trace
( self, tmp_path, definition, workloads, python_solution, config )
tests/sol_execbench/driver/test_problem_packager.py:306
Methodtest_partial_match_ratio_fails
Fails when too many elements don't match.
tests/sol_execbench/core/bench/test_correctness.py:209
Methodtest_partial_match_ratio_passes
Passes when enough elements match, even if some don't.
tests/sol_execbench/core/bench/test_correctness.py:200
Methodtest_partial_overlap
Blob root already contains leading components of the relative path.
tests/sol_execbench/core/bench/test_io.py:375
Methodtest_passes_for_empty_list
(self)
tests/sol_execbench/core/bench/test_reward_hack.py:81
Methodtest_passes_for_real_tensors
(self)
tests/sol_execbench/core/bench/test_reward_hack.py:78
Methodtest_passes_through_non_tensors
Non-tensor arguments are returned as-is.
tests/sol_execbench/core/bench/test_timing.py:50
Methodtest_passes_when_count_decreases
(self)
tests/sol_execbench/core/bench/test_reward_hack.py:60
Methodtest_passes_when_count_unchanged
(self)
tests/sol_execbench/core/bench/test_reward_hack.py:57
Methodtest_passes_when_namespace_unchanged
(self)
tests/sol_execbench/core/bench/test_reward_hack.py:119
Methodtest_passes_when_not_patched
No exception when elapsed_time identity is unchanged.
tests/sol_execbench/core/bench/test_reward_hack.py:35
Functiontest_passing_solution
A correct vector-add kernel produces a PASSED trace.
tests/sol_execbench/driver/test_eval_driver.py:171
Functiontest_passing_trace_correctness_unchanged
PASSED traces must preserve finite correctness values (not clobber to null).
tests/sol_execbench/driver/test_eval_driver.py:510
Methodtest_pool_size_is_compact
Pool overhead is proportional to total_iterations * alignment, not numel * iters.
tests/sol_execbench/core/bench/test_io.py:554
Methodtest_pos_inf_still_fails_when_neg_inf_allowed
+inf is not affected by allow_negative_inf.
tests/sol_execbench/core/bench/test_correctness.py:440
Methodtest_positive_tensor
(self)
tests/sol_execbench/core/bench/test_io.py:301
Methodtest_prefers_full_path_over_stripped
Full path match is preferred even when a stripped match also exists.
tests/sol_execbench/core/bench/test_io.py:398
Methodtest_presets_cover_all_known_devices
Each preset key resolves to its own preset.
tests/sol_execbench/core/bench/test_clock_lock.py:404
Methodtest_pure_cpp_languages_accepted
(self, langs)
tests/sol_execbench/core/data/test_solution.py:72
Methodtest_pure_python_languages_accepted
(self, langs)
tests/sol_execbench/core/data/test_solution.py:55
Methodtest_python_language_accepts_py_entry
(self, lang)
tests/sol_execbench/core/data/test_solution.py:146
Methodtest_python_language_rejects_cpp_entry
(self, lang)
tests/sol_execbench/core/data/test_solution.py:121
Methodtest_python_language_rejects_cu_entry
(self, lang)
tests/sol_execbench/core/data/test_solution.py:114
Methodtest_python_sources_written
( self, tmp_path, definition, workloads, python_solution, config )
tests/sol_execbench/driver/test_problem_packager.py:166
Methodtest_raises_for_non_tensor
(self)
tests/sol_execbench/core/bench/test_reward_hack.py:84
Methodtest_raises_for_none
(self)
tests/sol_execbench/core/bench/test_reward_hack.py:88
Methodtest_raises_for_tensor_subclass
Tensor subclasses (e.g. FakeTensor views) are rejected by strict type() check.
tests/sol_execbench/core/bench/test_reward_hack.py:92
Methodtest_raises_on_exhaustion
Raises RuntimeError when called more than total_iterations times.
tests/sol_execbench/core/bench/test_io.py:543
Methodtest_raises_when_count_increases
(self)
tests/sol_execbench/core/bench/test_reward_hack.py:63
Methodtest_raises_when_elapsed_time_replaced
RewardHackDetected when elapsed_time identity differs from the captured address.
tests/sol_execbench/core/bench/test_reward_hack.py:39
Methodtest_raises_when_function_deleted
(self)
tests/sol_execbench/core/bench/test_reward_hack.py:134
Methodtest_raises_when_function_replaced
(self)
tests/sol_execbench/core/bench/test_reward_hack.py:126
Methodtest_raises_without_so_for_cpp
( self, tmp_path, definition, workloads, cuda_solution, config )
tests/sol_execbench/driver/test_problem_packager.py:258
Methodtest_random_input_has_correct_dtype
(self)
tests/sol_execbench/core/bench/test_io.py:729
Methodtest_random_input_has_correct_shape
(self)
tests/sol_execbench/core/bench/test_io.py:722
Methodtest_raw_template_parses
(self)
tests/sol_execbench/driver/test_build_ext.py:122
Methodtest_reference_exactly_zero
When reference is 0, rel_error denominator is clamped to atol.
tests/sol_execbench/core/bench/test_correctness.py:80
Methodtest_reference_near_zero_small_perturbation
Reference near zero with a perturbation smaller than atol.
tests/sol_execbench/core/bench/test_correctness.py:101
Methodtest_reference_zero_output_exceeds_atol
Error at zero reference that exceeds atol.
tests/sol_execbench/core/bench/test_correctness.py:91
Methodtest_renames_suffixed_so
(self, tmp_path)
tests/sol_execbench/driver/test_build_ext.py:244
Methodtest_reports_first_violated_name
(self)
tests/sol_execbench/core/bench/test_reward_hack.py:141
Methodtest_required_matched_ratio_default_is_one
When required_matched_ratio is 1.0, all must match.
tests/sol_execbench/core/bench/test_correctness.py:192
Methodtest_resolves_relative_path_from_blob_root
(self, tmp_path)
tests/sol_execbench/core/bench/test_io.py:802
Methodtest_returns_command
( self, tmp_path, definition, workloads, python_solution, config )
tests/sol_execbench/driver/test_problem_packager.py:242
Methodtest_returns_command_and_artifact_path
( self, tmp_path, definition, workloads, cuda_solution, config )
tests/sol_execbench/driver/test_problem_packager.py:187
Methodtest_returns_empty_for_no_traces
( self, tmp_path, definition, workloads, python_solution, config )
tests/sol_execbench/driver/test_problem_packager.py:334
Methodtest_returns_false_and_unlocks_gpu_when_lmc_fails
DRAM lock failure → unlocks GPU clocks and returns False.
tests/sol_execbench/core/bench/test_clock_lock.py:215
Methodtest_returns_false_for_unknown_device
Unknown device with no env var overrides → False (no subprocess calls).
tests/sol_execbench/core/bench/test_clock_lock.py:151
Methodtest_returns_false_when_env_unset
(self, monkeypatch)
tests/sol_execbench/core/bench/test_clock_lock.py:369
Methodtest_returns_false_when_env_zero
(self, monkeypatch)
tests/sol_execbench/core/bench/test_clock_lock.py:365
Methodtest_returns_false_when_lgc_fails
GPU clock lock failure → returns False, no DRAM lock attempt.
tests/sol_execbench/core/bench/test_clock_lock.py:202
Methodtest_returns_false_when_sudo_fails
(self)
tests/sol_execbench/core/bench/test_clock_lock.py:57
Methodtest_returns_false_when_sudo_not_found
(self)
tests/sol_execbench/core/bench/test_clock_lock.py:65
← previousnext →401–500 of 597, ranked by callers