MCPcopy Create free account

hub / github.com/NVIDIA/SkillEvaluator / functions

Functions24,741 in github.com/NVIDIA/SkillEvaluator

Functiontest_creates_only_after_rechecking_head_and_verifies_body
(tmp_path)
tests/ci/test_comment_report.py:95
Functiontest_creation_completing_during_stop_redacts_cleanup_failure
( tmp_path: Path, monkeypatch: pytest.MonkeyPatch, )
tests/test_harbor_local_mode.py:3991
Functiontest_credential_checks_cannot_be_waived
Credentials are removed or rotated, never waived, even with a digest computed from the source.
tests/validators/test_pii_waivers.py:501
Functiontest_credential_custom_metric_names_never_reach_aggregates_or_paired_artifacts
( tmp_path: Path, surface: str, )
tests/test_issue55_collector_truth.py:3214
Functiontest_credential_cut_at_the_scan_window_is_dropped_not_sliced
(monkeypatch: pytest.MonkeyPatch)
tests/reporting/test_tier3_failure_reasons.py:317
Functiontest_credential_cut_by_the_scan_window_is_dropped
()
tests/tier3/test_security_finding_evidence.py:1776
Functiontest_credential_detected_in_one_skill_is_redacted_from_another_skill
(tmp_path, capsys)
tests/ci/test_secret_redaction.py:439
Functiontest_credential_glued_to_a_word_is_redacted
()
tests/reporting/test_tier3_failure_reasons.py:243
Functiontest_credential_preflight_scans_dot_env_and_credential_inside_comments
(tmp_path)
tests/ci/test_secret_redaction.py:551
Functiontest_credential_probe_disposition_is_endpoint_aware
(provider, probe: dict[str, object], expected: str)
tests/test_harbor_runtime_preflight.py:1301
Functiontest_credential_safe_cut_never_leaves_part_of_a_credential
(credential: str, secret: str)
tests/test_redaction_assignments.py:219
Functiontest_credential_safe_cut_points
(source: str, end: int, expected: int)
tests/test_redaction_assignments.py:201
Functiontest_credential_shaped_reward_identity_is_never_an_aggregate_key
( tmp_path: Path, credential_id: str, )
tests/test_harbor_collector_runtime_failures.py:2628
Functiontest_credential_shaped_trial_name_uses_collision_safe_output_alias
(tmp_path: Path)
tests/test_harbor_collector_runtime_failures.py:2659
Functiontest_credential_validation_401_stops_before_image_and_task_preparation
( monkeypatch: pytest.MonkeyPatch, tmp_path: Path, agent_runtime_preflight: bool, )
tests/test_tier3_progress.py:3321
Functiontest_credential_validation_includes_distinct_standard_grading_route
( monkeypatch: pytest.MonkeyPatch, tmp_path: Path, )
tests/test_tier3_progress.py:3541
Functiontest_credential_validation_probes_an_identical_agent_route_once
( monkeypatch: pytest.MonkeyPatch, tmp_path: Path, )
tests/test_tier3_progress.py:3478
Functiontest_credential_validation_probes_each_distinct_agent_route
( monkeypatch: pytest.MonkeyPatch, tmp_path: Path, )
tests/test_tier3_progress.py:3509
Functiontest_credentials_are_redacted_from_reasons_and_excerpts
()
tests/reporting/test_tier3_failure_reasons.py:226
Functiontest_credentials_in_the_same_skill_still_block
(tmp_path)
tests/validators/test_pii_ownership.py:150
Methodtest_credit_card_browser_command_not_flagged
Credit card numbers in browser automation commands should not be flagged.
tests/validators/test_security.py:7863
Methodtest_credit_card_floating_point_score_not_flagged
Eval-output floats like 0.8603333333333333 should not be flagged. Regression test for the user-reported false positive: the 16-digit
tests/validators/test_security.py:7893
Methodtest_credit_card_long_digit_run_not_flagged
16-digit windows inside a longer digit run should not be flagged. ``\\d{20}`` should not match a 16-digit substring of itself.
tests/validators/test_security.py:7909
Methodtest_credit_card_luhn_valid_still_flagged
Luhn-valid numbers without exception context should still be flagged.
tests/validators/test_security.py:7883
Methodtest_credit_card_next_to_technical_or_test_value_still_flagged
A timestamp label, test card, emphasis, or non-ASCII letter excludes no card number next to it.
tests/validators/test_security.py:7812
Methodtest_credit_card_non_luhn_number_not_flagged
16-digit numbers that fail Luhn should not be flagged as credit cards.
tests/validators/test_security.py:7853
Methodtest_credit_card_shape_in_timestamp_or_hash_context_not_flagged
A Luhn-valid timestamp, digest, or identifier is not a blocking card number.
tests/validators/test_security.py:7769
Methodtest_credit_card_shape_inside_guid_not_flagged
GUID digit groups (COM interface IDs, nil UUIDs) can pass Luhn without being a card.
tests/validators/test_security.py:7948
Methodtest_credit_card_test_card_prefix_not_flagged
Well-known test card numbers should not be flagged.
tests/validators/test_security.py:7873
Methodtest_criterion_pass_is_derived_from_seven_point_threshold
(self, tmp_path)
tests/validators/test_rubric_eval.py:830
Methodtest_critical_duplicate_fails
(self, _mock_client_cls, mock_registry_cls, tmp_path: Path)
tests/validators/test_similarity.py:141
Methodtest_critical_severity
CVSS >= 9.0 maps to CRITICAL.
tests/utils/test_tool_runner.py:36
Functiontest_crlf_frontmatter_name_is_read
(tmp_path)
tests/tier3/test_error_recovery.py:350
Functiontest_crlf_lenient_retry_keeps_flow_list_grants
(tmp_path)
tests/test_plugin_markdown.py:101
Functiontest_cross_client_only_grants_are_advisory_with_loading_client
(tmp_path)
tests/test_plugin_inventory.py:286
Functiontest_cross_client_reinterpretation_does_not_add_errors_for_selected_manifest
(tmp_path)
tests/test_plugin_inventory.py:207
Functiontest_cross_device_source_entry_is_rejected
( tmp_path: Path, monkeypatch: pytest.MonkeyPatch, )
tests/test_harbor_secure_copy.py:337
Functiontest_cross_environment_sidecar_lock_cycle_fails_fast_without_deadlock
( tmp_path: Path, )
tests/test_harbor_secure_docker_environment.py:2187
Methodtest_cross_file_false_when_same_source
(self, make_chunk)
tests/deduplication/intra_skill/test_semantic_clustering.py:89
Methodtest_cross_file_true_when_different_sources
(self, make_chunk)
tests/deduplication/intra_skill/test_semantic_clustering.py:83
Functiontest_cross_marketplace_dependencies_are_external
(tmp_path: Path)
tests/test_plugin_manifest.py:156
Methodtest_cross_process_metadata_is_denied
(self, run_root: Path)
tests/test_harbor_local_sandbox.py:1383
Functiontest_cross_sidecar_callback_lock_cycle_fails_fast_without_deadlock
( tmp_path: Path, )
tests/test_harbor_secure_docker_environment.py:2149
Functiontest_cross_trial_compact_refs_are_rejected_in_both_orders
(same_excerpt)
tests/tier3/test_suggestion_grounding.py:41
Functiontest_crowded_reports_retain_risk_evidence_across_all_six_formats
(long_cells)
tests/reporting/test_private_static_reports.py:373
Functiontest_csp_does_not_trust_code_found_in_final_render
(tmp_path, injection)
tests/ci/test_native_reports.py:227
Functiontest_csv_escapes_formula_prefixes_after_whitespace_and_width_folding
(value: str)
tests/reporting/test_dashboard_app.py:577
Functiontest_csv_export_disables_newline_translation
(monkeypatch, tmp_path)
tests/test_tier3_history.py:301
Functiontest_csv_preserves_numeric_deltas_and_escapes_formula_strings
()
tests/reporting/test_dashboard_app.py:557
Functiontest_ctrl_c_ends_running_scans_and_their_tools
(tmp_path)
tests/ci/test_run_tier1.py:1696
Functiontest_ctrl_c_handled_on_a_scan_thread_still_ends_the_run
(tmp_path, monkeypatch)
tests/ci/test_run_tier1.py:1733
Functiontest_ctrl_c_returns_zero
(monkeypatch)
tests/reporting/test_dashboard_cli.py:188
Functiontest_ctrl_c_terminates_streamlit_that_does_not_stop
(monkeypatch)
tests/reporting/test_dashboard_cli.py:203
Functiontest_current_default_branch_writer_is_eligible
(tmp_path, monkeypatch, stage, event_name)
tests/ci/test_github_admission_workflow.py:121
Functiontest_current_deterministic_components_conform_to_frozen_challenge
Supplemental conformance only; the worksheet supplies independent labels.
tests/tier3/test_grader_pilot.py:98
Functiontest_current_git_baseline_loads_its_own_shared_modules
(monkeypatch)
tests/test_script_invocation_differential.py:14
Functiontest_current_openai_and_anthropic_keys_have_a_secret_shape
Regression: 'sk-' needed 16 letters or digits right after it, so 'sk-proj-...' and 'sk-ant-...' did not count.
tests/validators/test_url_policy.py:319
Functiontest_current_policy_overall_uses_raw_evaluators_not_cached_dimensions
()
tests/reporting/test_unified_tier3_report.py:1232
Functiontest_current_protected_default_head_is_admitted
(gate, monkeypatch, source, read_token)
tests/ci/test_gitlab_default_head_admission.py:74
Functiontest_current_rm_xargs_and_symlink_hardening_is_retained
(security, command, destructive)
tests/tier3/test_private_plugin_security.py:240
Functiontest_current_run_discovery_accepts_windows_crt_descriptor_identity
Windows path and CRT descriptor stat identities are not comparable.
tests/test_results_location_legacy_compatibility.py:188
Functiontest_current_tier1_legacy_error_and_warning_count_as_issues
(tmp_path)
tests/ci/test_compact_completeness.py:84
Functiontest_cursor_approval_hooks_are_flagged
( tmp_path: Path, event: str, script: str, check: str, severity: Severity )
tests/validators/test_plugin_static_risk_review_fixes.py:156
Functiontest_cursor_cli_heuristic_extracts_cat_and_read_path
()
tests/tier3/test_log_converters.py:42
Functiontest_cursor_read_file_approval_is_recorded_not_flagged
(tmp_path: Path)
tests/validators/test_plugin_static_risk_review_fixes.py:167
Functiontest_cursor_selected_native_cost_and_unsupported_inventory_facts
(tmp_path)
tests/test_plugin_context_cost.py:140
Functiontest_cursor_session_start_injects_context_and_unknown_events_are_still_flagged
(tmp_path: Path)
tests/validators/test_plugin_static_risk_review_fixes.py:174
Functiontest_cursor_undotted_roots_become_valid_claude_paths
( tmp_path: Path, manifest_rel: str, skills: Any, expected: Any )
tests/tier3/test_openclaw_prepare.py:240
Functiontest_custom_agent_import_path_is_rejected_for_native_cloud
()
tests/test_tier3_public_runtime.py:699
Functiontest_custom_agent_import_path_preserves_native_cloud_environment
(env_mode: str)
tests/test_tier3_public_runtime.py:679
Functiontest_custom_comparison_uses_recorded_card_and_preserves_paired_lift
()
tests/reporting/test_native_overview_comparison.py:310
Functiontest_custom_compose_allows_even_dollar_literal
(tmp_path: Path)
tests/test_harbor_custom_compose_safety.py:349
Functiontest_custom_compose_preserves_declared_bare_environment_and_build_args
(tmp_path: Path)
tests/test_harbor_custom_compose_safety.py:417
Functiontest_custom_compose_preserves_literal_and_declared_runtime_environment
(tmp_path: Path)
tests/test_harbor_custom_compose_safety.py:396
Functiontest_custom_compose_preserves_safe_sidecar_features_and_strips_host_ports
(tmp_path: Path)
tests/test_harbor_custom_compose_safety.py:435
Functiontest_custom_compose_rejects_hidden_undeclared_interpolation
( tmp_path: Path, interpolation: str, )
tests/test_harbor_custom_compose_safety.py:332
Functiontest_custom_compose_rejects_host_escape_settings_on_every_service
( tmp_path: Path, service_name: str, field: str, value: object, )
tests/test_harbor_custom_compose_safety.py:99
Functiontest_custom_compose_rejects_indirect_host_file_and_container_access
( tmp_path: Path, field: str, value: object, )
tests/test_harbor_custom_compose_safety.py:229
Functiontest_custom_compose_rejects_interpolated_short_volume_spec
(tmp_path: Path)
tests/test_harbor_custom_compose_safety.py:134
Functiontest_custom_compose_rejects_interpolation_not_declared_as_runtime_env
(tmp_path: Path)
tests/test_harbor_custom_compose_safety.py:311
Functiontest_custom_compose_rejects_main_service_runtime_overrides
(tmp_path: Path, field: str)
tests/test_harbor_custom_compose_safety.py:152
Functiontest_custom_compose_rejects_non_project_scoped_named_volumes
( tmp_path: Path, field: str, value: object, )
tests/test_harbor_custom_compose_safety.py:177
Functiontest_custom_compose_rejects_non_project_scoped_networks
( tmp_path: Path, field: str, value: object, )
tests/test_harbor_custom_compose_safety.py:202
Functiontest_custom_compose_rejects_short_and_long_host_bind_mounts
( tmp_path: Path, service_name: str, volume: object, )
tests/test_harbor_custom_compose_safety.py:123
Functiontest_custom_compose_rejects_sidecar_build_files_and_contexts_outside_staging
( tmp_path: Path, build: object, )
tests/test_harbor_custom_compose_safety.py:280
Functiontest_custom_compose_rejects_sidecar_build_host_access
(tmp_path: Path, build: object)
tests/test_harbor_custom_compose_safety.py:261
Functiontest_custom_compose_rejects_top_level_host_resource_sources
( tmp_path: Path, field: str, value: object, )
tests/test_harbor_custom_compose_safety.py:300
Functiontest_custom_compose_rejects_undeclared_bare_build_arg_passthrough
(tmp_path: Path, args: object)
tests/test_harbor_custom_compose_safety.py:382
Functiontest_custom_compose_rejects_undeclared_bare_environment_passthrough
( tmp_path: Path, environment: object, )
tests/test_harbor_custom_compose_safety.py:371
Functiontest_custom_compose_service_healthchecks_keep_their_readiness_policy
(tmp_path: Path)
tests/test_harbor_compose_readiness.py:66
Methodtest_custom_criteria_are_checked_against_the_given_list
(self, replies, expected_requests)
tests/validators/test_rubric_eval.py:1642
Functiontest_custom_digest_covers_only_the_rules_the_file_sets
(tmp_path: Path)
tests/test_quality_config.py:381
Functiontest_custom_digest_declares_only_the_correctness_keys_the_file_sets
(tmp_path: Path)
tests/test_quality_config.py:787
Functiontest_custom_digest_declares_only_the_discoverability_keys_the_file_sets
(tmp_path: Path)
tests/test_quality_config.py:690
Functiontest_custom_digest_declares_only_the_efficiency_keys_the_file_sets
(tmp_path: Path)
tests/test_quality_config.py:565
Functiontest_custom_digest_ignores_packaged_defaults_the_file_omits
(tmp_path: Path, monkeypatch: pytest.MonkeyPatch)
tests/test_quality_config.py:398
Functiontest_custom_dockerfile_rejects_noncanonical_input_case
( tmp_path: Path, files_value: list[str], source: str, )
tests/test_harbor_runtime_skill_isolation.py:2323
Functiontest_custom_dockerfiles_reach_procps_only_through_the_shared_base_image_rebase
A custom Dockerfile keeps its own base, and so needs procps, unless it is rebased.
tests/tier3/test_installed_agent_bootstrap.py:470
Functiontest_custom_error_handling_overlays_packaged_rules_key_by_key
(tmp_path: Path)
tests/test_quality_config.py:311
Functiontest_custom_evaluator_cards_reject_scores_outside_the_unit_interval
(source: str)
tests/reporting/test_unified_tier3_report.py:2054
← previousnext →14,601–14,700 of 24,741, ranked by callers