MCPcopy Create free account

hub / github.com/NVIDIA/SkillEvaluator / functions

Functions24,741 in github.com/NVIDIA/SkillEvaluator

Functiontest_runtime_read_paths_include_symlinked_npm_package_without_sibling_bin
( tmp_path: Path, monkeypatch: pytest.MonkeyPatch, )
tests/test_harbor_local_mode.py:4547
Functiontest_runtime_read_paths_keep_direct_binary_exact
( tmp_path: Path, monkeypatch: pytest.MonkeyPatch, )
tests/test_harbor_local_mode.py:4593
Functiontest_runtime_read_paths_keep_direct_node_modules_bin_shim_exact
( tmp_path: Path, monkeypatch: pytest.MonkeyPatch, )
tests/test_harbor_local_mode.py:4571
Functiontest_runtime_read_paths_keep_single_file_symlink_exact
( tmp_path: Path, monkeypatch: pytest.MonkeyPatch, )
tests/test_harbor_local_mode.py:4613
Functiontest_runtime_read_paths_preserve_claude_standalone_layout
( tmp_path: Path, monkeypatch: pytest.MonkeyPatch, )
tests/test_harbor_local_mode.py:4638
Functiontest_runtime_read_paths_resolve_env_shebang_helper_without_sibling_directory
( tmp_path: Path, monkeypatch: pytest.MonkeyPatch, )
tests/test_harbor_local_mode.py:4660
Functiontest_runtime_refuses_a_backend_codex_wrapper_that_drops_gateway_routing
( backend_module: types.ModuleType, monkeypatch: pytest.MonkeyPatch )
tests/test_custom_execution_backends.py:548
Functiontest_runtime_rendering_does_not_collect_source_or_network_evidence
(monkeypatch)
tests/reporting/test_private_runtime_render.py:201
Functiontest_runtime_replay_and_render_need_no_optional_runtime_dependencies
(tmp_path)
tests/reporting/test_private_runtime_render.py:219
Functiontest_runtime_retains_public_json_and_regenerates_each_native_tier
(tmp_path, tier)
tests/ci/test_native_reports.py:385
Functiontest_runtime_ro_binds_do_not_expose_whole_managed_agent_root
( tmp_path: Path, monkeypatch: pytest.MonkeyPatch, )
tests/test_harbor_local_mode.py:5228
Functiontest_runtime_ro_binds_include_only_selected_agent
( tmp_path: Path, monkeypatch: pytest.MonkeyPatch, )
tests/test_harbor_local_mode.py:5023
Functiontest_runtime_ro_binds_preserve_exact_selected_agent_symlink
( tmp_path: Path, monkeypatch: pytest.MonkeyPatch, )
tests/test_harbor_local_mode.py:5053
Functiontest_runtime_row_is_kept_without_package_entrypoints
(tmp_path: Path)
tests/test_openclaw_plugin_discovery.py:328
Functiontest_runtime_skill_projection_excludes_shared_in_skill_output_root
(tmp_path: Path)
tests/test_harbor_runtime_skill_isolation.py:1369
Functiontest_runtime_skill_projection_rejects_linked_host_file
(tmp_path: Path, link_kind: str)
tests/test_harbor_runtime_skill_isolation.py:1171
Functiontest_runtime_stage_ships_only_what_scans_run
()
tests/ci/test_image_build.py:49
Functiontest_runtime_uses_the_provider_wrapper_when_the_backend_names_none
(acme: types.ModuleType)
tests/test_custom_execution_backends.py:562
Methodtest_runtime_visible_read_only_without_unrelated_host_home_contents
(self, run_root: Path)
tests/test_harbor_local_sandbox.py:1651
Functiontest_safe_child_accepts_root_owned_platform_temp_alias
()
tests/test_harbor_case_id_safety.py:325
Functiontest_safe_child_rejects_symlinked_output_ancestor_without_touching_target
(tmp_path: Path)
tests/test_harbor_case_id_safety.py:309
Functiontest_safe_reporter_becomes_inactive_after_post_start_failure
()
tests/test_tier3_progress.py:1101
Functiontest_safe_reporter_disables_after_heartbeat_redraw_failure
()
tests/test_tier3_progress.py:1136
Functiontest_safe_reporter_disables_broken_presentation_without_raising
()
tests/test_tier3_progress.py:1057
Functiontest_safe_reporter_tracks_lifecycle_when_delegate_has_no_active_state
()
tests/test_tier3_progress.py:2587
Functiontest_safe_reporter_wraps_a_reporter_whose_callback_registration_fails
()
tests/test_tier3_progress.py:2529
Functiontest_safe_sensitive_custom_metric_details_survive_with_nested_secrets_redacted
( tmp_path: Path, )
tests/test_issue55_collector_truth.py:3455
Functiontest_safe_url_is_bounded
()
tests/validators/test_url_policy.py:211
Functiontest_safe_url_never_keeps_userinfo
(url: str, expected: str)
tests/validators/test_plugin_component_risk.py:745
Functiontest_safe_url_never_keeps_userinfo_written_with_fewer_than_two_slashes
Regression: a malformed URL with one '/' or '\\' after the scheme was shown whole, password included.
tests/validators/test_url_policy.py:206
Functiontest_safe_url_never_shows_userinfo_that_a_backslash_turns_into_the_host
Regression: WHATWG reads '\\' as '/', so the userinfo before '\\@' was shown as the host.
tests/validators/test_url_policy.py:189
Functiontest_safe_url_shows_where_a_client_connects_without_credentials
(url: str, shown: str)
tests/validators/test_url_policy.py:173
Functiontest_safety_advisory_ids_name_the_finding
(tmp_path, pip_audit, safety, advisory, check_name)
tests/validators/test_dependency_advisory_findings.py:558
Functiontest_safety_advisory_without_a_matching_pin_is_unbound
Safety reads the raw file, so it can report a pin the audit skipped for its marker.
tests/validators/test_dependency_advisory_findings.py:625
Functiontest_safety_findings_use_the_common_applicability_metadata
(tmp_path, pip_audit, safety)
tests/validators/test_dependency_advisory_findings.py:391
Functiontest_safety_severity_reads_level_words_and_cvss_objects
With an API key, Safety prints severity as a CVSS object; a critical one fails the run.
tests/validators/test_dependency_advisory_findings.py:525
Functiontest_safety_skips_an_advisory_pip_audit_already_reported
One vulnerability is one finding: Safety's copy of a pip-audit advisory is dropped by ID or CVE.
tests/validators/test_dependency_advisory_findings.py:597
Functiontest_salvage_after_a_failed_retry_keeps_each_attempt_status
(tmp_path: Path)
tests/tier3/test_judge_contracts.py:1805
Functiontest_salvage_recovers_complete_entries_from_truncated_results
()
tests/tier3/test_judge_parse_robustness.py:283
Functiontest_salvage_rejects_complete_entries_with_overflowed_numeric_metadata
()
tests/tier3/test_judge_parse_robustness.py:290
Functiontest_salvage_returns_empty_for_empty_or_alien_text
()
tests/tier3/test_judge_parse_robustness.py:297
Functiontest_salvaged_behavior_score_is_saved_as_a_salvage_attempt
(tmp_path: Path)
tests/tier3/test_judge_contracts.py:1779
Functiontest_same_address_in_body_and_metadata_stays_independently_blocking
(tmp_path)
tests/validators/test_pii_ownership.py:40
Functiontest_same_attempt_status_and_cause_share_one_explanation_with_all_requirement_references
()
tests/reporting/test_diagnostic_view.py:77
Methodtest_same_body_under_different_heading_lines_is_shared
(self, make_chunk)
tests/deduplication/intra_skill/test_intra_llm_analyzer.py:294
Functiontest_same_command_recovers_after_distant_edit
(checker, command)
tests/tier3/test_error_recovery.py:719
Functiontest_same_content_elsewhere_or_changed_content_at_self_path_is_compared
(tmp_path: Path)
tests/deduplication/plugin/test_openclaw_profile.py:181
Functiontest_same_emitted_task_is_not_read_twice_in_one_parity_check
(tmp_path, monkeypatch)
tests/tier3/test_private_comparison_staging.py:200
Functiontest_same_explanation_preserves_each_evidence_and_rubric_association_without_mutating_canonical_data
()
tests/reporting/test_diagnostic_view.py:124
Functiontest_same_failure_at_different_cases_agents_or_evidence_is_not_deduplicated
()
tests/reporting/test_insights_view.py:89
Functiontest_same_finding_in_several_skills_counts_once_with_one_occurrence_per_skill
()
tests/reporting/test_reporters.py:1435
Methodtest_same_inode_mcp_rewrite_with_restored_mtime_is_rejected
( self, monkeypatch: pytest.MonkeyPatch, tmp_path: Path, )
tests/test_harbor_input_staging.py:571
Functiontest_same_inode_mutation_during_read_fails_closed
(tmp_path: Path, monkeypatch: pytest.MonkeyPatch)
tests/utils/test_secure_fs.py:194
Methodtest_same_key_in_different_mappings_is_not_duplicate
(self, tmp_path: Path)
tests/validators/test_schema.py:1601
Functiontest_same_kind_conflicts_with_one_owner_are_still_rejected
()
tests/tier3/test_suggestion_grounding.py:329
Functiontest_same_name_different_manifest_remains_collision_after_unique_verdict
(modules, tmp_path, monkeypatch)
tests/deduplication/plugin/test_private_dedup.py:246
Functiontest_same_named_members_get_findings_at_their_own_locations
(tmp_path)
tests/test_plugin_inventory.py:222
Functiontest_same_origin_redirect_never_reaches_functional_target
SDK2 follows these itself unless the constrained transport refuses them.
tests/tier3/test_mcp_proof_sdk_compat.py:116
Functiontest_same_project_mr_routes_by_recomputed_skill_change
The real pinned-tools check, not an artifact, decides whether the paid scan was skipped.
tests/ci/test_gitlab_enriched_admission.py:159
Functiontest_same_project_request_uses_token_body_and_only_two_selector_variables
(request_env, monkeypatch, capsys)
tests/ci/test_gitlab_feedback_request.py:60
Functiontest_same_repository_missing_dependency_fails_without_fetching
(tmp_path, monkeypatch)
tests/test_plugin_dependency_records.py:38
Functiontest_same_repository_reference_forms_share_suffix_normalization
(tmp_path: Path, suffix: str)
tests/validators/test_plugin_dependencies.py:68
Functiontest_same_sidecar_callback_reentry_fails_fast_without_deadlock
( tmp_path: Path, monkeypatch: pytest.MonkeyPatch, )
tests/test_harbor_secure_docker_environment.py:2344
Functiontest_same_sidecar_execs_are_serialized_before_target_containment
( tmp_path: Path, monkeypatch: pytest.MonkeyPatch, )
tests/test_harbor_secure_docker_environment.py:2113
Functiontest_sampled_errors_are_never_retried
()
tests/tier3/test_plugin_execution.py:306
Functiontest_sampled_evidence_carries_lower_bound_metadata_and_honest_wording
()
tests/reporting/test_unified_tier3_report.py:2599
Methodtest_sampled_trial_keeps_matching_case_metadata_beyond_first_five
(self)
tests/evaluation/test_judges.py:217
Functiontest_sandbox_census_alone_never_reports_loaded
(tmp_path: Path)
tests/tier3/test_plugin_execution.py:248
Functiontest_sarif_component_attribution_is_lexical_and_unambiguous
()
tests/reporting/test_private_static_reports.py:328
Methodtest_save_catalog_is_versioned_relative_and_preserves_duplicate_names
(self, tmp_path: Path)
tests/embedding/test_catalog.py:178
Methodtest_save_catalog_keeps_direct_pairwise_scan
(self, _mock_client_cls, mock_registry_cls, tmp_path: Path)
tests/validators/test_similarity.py:507
Methodtest_save_catalog_rejects_empty_collection
(self, _mock_client_cls, mock_registry_cls, tmp_path: Path)
tests/validators/test_similarity.py:524
Methodtest_save_does_not_follow_predictable_temporary_symlink
(self, tmp_path: Path)
tests/embedding/test_catalog.py:354
Functiontest_save_is_idempotent_even_before_files_are_committed
(repository, release_file)
tests/test_ci_onboarding.py:234
Functiontest_save_keeps_existing_report_when_atomic_write_is_interrupted
( monkeypatch: pytest.MonkeyPatch, tmp_path: Path, )
tests/reporting/test_secure_report_output.py:79
Functiontest_save_rejects_existing_output_symlink_without_touching_target
(tmp_path: Path)
tests/reporting/test_secure_report_output.py:36
Functiontest_save_rejects_intermediate_symlink_without_writing_outside
(tmp_path: Path)
tests/reporting/test_secure_report_output.py:49
Methodtest_save_rejects_nonfinite_vectors
(self, tmp_path: Path)
tests/embedding/test_catalog.py:334
Methodtest_save_rejects_symlinked_intermediate_directory
(self, tmp_path: Path)
tests/embedding/test_catalog.py:498
Functiontest_saved_complete_run_feedback_cannot_restore_skill_helps
(tmp_path)
tests/reporting/test_budget_partial_reporting.py:118
Functiontest_saved_deep_trajectory_surfaces_bounded_omission_to_report_loader
(tmp_path: Path)
tests/test_harbor_collector_multistep_trajectory.py:1220
Functiontest_saved_diagnostic_metadata_is_revalidated_at_json_boundary
()
tests/validators/test_skillspector_diagnostics.py:133
Functiontest_saved_fallback_steps_keep_logical_trial_weight_in_findings_and_html
( tmp_path: Path, monkeypatch: pytest.MonkeyPatch, )
tests/test_issue55_collector_truth.py:1825
Functiontest_saved_feedback_keeps_what_the_case_pass_adds
Report content the case-findings pass computes but the run does not save survives a rebuild.
tests/tier3/test_view_results_feedback.py:284
Functiontest_saved_fixes_do_not_follow_a_symlink
(tmp_path: Path)
tests/test_tier3_case_summary.py:2046
Functiontest_saved_html_defaults_only_add_unavailable_reasons_to_eligible_agent_cards
()
tests/reporting/test_tier3_failure_reasons.py:704
Functiontest_saved_judge_evidence_masks_credentials
(tmp_path: Path, monkeypatch: pytest.MonkeyPatch)
tests/tier3/test_judge_contracts.py:875
Functiontest_saved_reward_drops_credential_shaped_custom_metric_key
(tmp_path: Path)
tests/test_issue55_collector_truth.py:3045
Functiontest_saved_reward_omits_nonnumeric_unpublishable_top_level_and_detail_keys
( tmp_path: Path, rejected_value: object, )
tests/test_issue55_collector_truth.py:3170
Functiontest_saved_reward_omits_rejected_metric_names_from_ordinary_details
( tmp_path: Path, surface: str, )
tests/test_issue55_collector_truth.py:3123
Functiontest_saved_reward_preserves_allowlisted_sensitive_custom_metrics_and_safe_details
( tmp_path: Path, surface: str, )
tests/test_issue55_collector_truth.py:3073
Functiontest_saved_run_does_not_renormalize_a_missing_metric_without_validated_na
(tmp_path)
tests/reporting/test_applicability_saved_runs.py:303
Functiontest_saved_run_html_and_benchmark_keep_no_baseline_wording
(skipped_agent, tmp_path)
tests/reporting/test_tier3_skipped_baseline.py:81
Functiontest_saved_run_links_each_observation_to_retained_artifacts
(tmp_path: Path)
tests/reporting/test_activation_validation.py:297
Functiontest_saved_run_retains_validated_na_and_recomputes_tampered_basis
(tmp_path)
tests/reporting/test_applicability_saved_runs.py:89
Functiontest_saved_run_without_the_mixed_case_rewards_shows_only_the_recorded_count
(tmp_path: Path)
tests/test_judge_lift_integrity.py:495
Functiontest_saved_snapshot_is_the_live_report_for_multiline_diagnostics
(tmp_path, error, kept, dropped)
tests/reporting/test_private_runtime_replay.py:108
Functiontest_saved_summary_preserves_census_when_trial_loading_is_incomplete
(tmp_path)
tests/reporting/test_skill_activation_reporting.py:307
Functiontest_saved_top_level_budget_overrides_stale_config
(monkeypatch, tmp_path, live)
tests/reporting/test_budget_partial_reporting.py:100
Methodtest_sbpl_paths_are_escaped
(self, tmp_path: Path)
tests/test_harbor_local_sandbox.py:783
← previousnext →21,801–21,900 of 24,741, ranked by callers