Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/NVIDIA/SkillEvaluator
/ functions
Functions
24,741 in github.com/NVIDIA/SkillEvaluator
⨍
Functions
24,741
◇
Types & classes
1,292
↳
Endpoints
703
Function
test_reference_caveat_is_not_counted_as_an_active_baseline_finding
(tmp_path)
tests/validators/test_security_reference_caveats.py:252
Function
test_reference_caveat_is_visible_in_actual_ci_render_all_outputs
(tmp_path)
tests/validators/test_security_reference_caveats.py:223
Method
test_reference_caveats_meet_the_same_conditions
The reference-caveat rule reads only the report; a scan with a known reference root also checks the skill.
tests/validators/test_security.py:10241
Function
test_reference_decided_endpoint_with_a_safe_or_unknown_scheme_is_only_advisory
(url: str)
tests/validators/test_mcp_static.py:1002
Function
test_reference_evidence_advisory_is_not_sent_for_llm_finding_verification
(tmp_path, with_issue)
tests/validators/test_security_reference_caveats.py:270
Method
test_reference_evidence_without_a_row_is_unmatched
(self)
tests/validators/test_security.py:10037
Method
test_reference_into_a_directory_left_out_of_the_scan_stays_incomplete
SkillEvaluator scans a copy without artifact directories, so SkillSpector never sees a file there.
tests/validators/test_security.py:10215
Method
test_reference_into_a_directory_left_out_of_the_scan_stays_incomplete
SkillEvaluator scans a copy without ``versions/``; 2.13.4 still reports the script as a caveat.
tests/validators/test_security.py:11280
Function
test_reference_inventory_must_agree_with_the_missing_only_ledger
(mutation)
tests/validators/test_security_reference_caveats.py:184
Method
test_reference_line_check_is_bounded
A line that would take too long to search for every left-out name is not accepted.
tests/validators/test_security.py:11067
Method
test_reference_line_is_numbered_like_skillspector
(self)
tests/validators/test_security.py:11051
Method
test_reference_line_names_an_unscanned_entry
(self, line: str, name: str, named: bool)
tests/validators/test_security.py:10998
Function
test_reference_links_resolve
()
tests/test_skillevaluator_skill.py:76
Function
test_reference_lookup_failure_does_not_abort_other_links
(tmp_path: Path)
tests/validators/test_hygiene_link_boundaries.py:92
Method
test_reference_missing_is_advisory_on_any_version
(self, mock_tools, tmp_path: Path)
tests/validators/test_security.py:9772
Function
test_reference_only_userinfo_is_a_credential_for_a_hook_url_only
An HTTP hook's client sends any userinfo as Basic auth; an MCP server URL may hold references there.
tests/validators/test_url_policy.py:467
Method
test_reference_root_beyond_the_scanned_directory_stays_incomplete
A skill scanned inside a larger artifact may name its files, which that scan never inspects.
tests/validators/test_security.py:10496
Method
test_reference_root_that_does_not_contain_the_scan_is_ignored
(self, tmp_path: Path)
tests/validators/test_skillspector_scope.py:1607
Function
test_reference_starter_and_calculator
()
tests/tier3/test_dataset_coverage.py:146
Method
test_reference_style_local_markdown_link_is_nested
(self, tmp_path: Path)
tests/validators/test_quality_score.py:1472
Method
test_reference_style_readme_link_is_flagged
(self, quality_skill: Path)
tests/validators/test_quality_score.py:584
Method
test_reference_through_a_symlink_stays_incomplete
SkillSpector leaves a symlink out of the scan with only a nonfatal scope exclusion.
tests/validators/test_security.py:10300
Method
test_reference_to_a_directory_holding_a_left_out_entry_stays_incomplete
SkillSpector inspected only part of ``scripts``, so a line that names it points the agent at the rest.
tests/validators/test_security.py:10269
Method
test_reference_to_a_file_planted_in_git_metadata_stays_incomplete
Only Git's own layout inside ``.git`` is ignored; an agent that searches the tree finds any other file.
tests/validators/test_security.py:10433
Method
test_reference_to_an_active_git_hook_stays_incomplete
(self, mock_tools, tmp_path: Path)
tests/validators/test_security.py:10414
Method
test_reference_to_an_unlisted_file_on_disk_stays_incomplete
(self, mock_tools, tmp_path: Path)
tests/validators/test_security.py:10333
Method
test_reference_unresolved_from_2_12_0_stays_incomplete
From 2.12.0 the code only means an ambiguous match, whatever the references list says.
tests/validators/test_security.py:9783
Method
test_reference_variant_prefilter
(self, variant: str, tokens: list[str], expected: bool)
tests/validators/test_skillspector_scope.py:1218
Function
test_reference_warning_and_original_status_survive_report_serialization
()
tests/validators/test_security_reference_caveats.py:209
Method
test_reference_warning_survives_deduplicated_static_and_llm_findings
( self, mock_tools, tmp_path: Path, version: str )
tests/validators/test_security.py:9609
Method
test_reference_without_a_ledger_row_stays_incomplete
Nothing reads the line of a reference that has no row, so it could name a file the scan left out.
tests/validators/test_security.py:9978
Method
test_referenced_disguised_image_is_an_agent_reference
(self, tmp_path: Path)
tests/validators/test_skillspector_scope.py:558
Method
test_referenced_image_does_not_fail_the_walk_closed
(self, tmp_path: Path)
tests/validators/test_skillspector_scope.py:997
Method
test_referenced_in_root_symlink_alias_retains_finding
(self, tmp_path: Path)
tests/validators/test_skillspector_scope.py:1247
Method
test_references_that_name_a_revision_are_accepted
A registry port, a tag and an implementation revision all name the build that ran.
tests/test_benchmark_source_provenance.py:214
Method
test_references_that_name_no_build_are_dropped
A bare name is a repository, not a revision, and the rest are unpinnable or not inert in a code span.
tests/test_benchmark_source_provenance.py:231
Method
test_references_that_name_no_build_do_not_satisfy_a_pass
(self, tmp_path: Path, revision: str)
tests/test_benchmark_source_provenance.py:1048
Function
test_refine_resolves_result_case_ids_without_the_tier3_extra
(tmp_path: Path)
tests/tier3/test_generate_dataset_results.py:708
Function
test_refreshing_finding_ids_does_not_load_the_validators
()
tests/ci/test_secret_redaction.py:412
Function
test_refreshing_ids_keeps_the_shape_of_reports_written_before_ids
()
tests/ci/test_secret_redaction.py:332
Function
test_refs_to_one_folder_share_one_classified_row
(tmp_path: Path)
tests/test_plugin_refs.py:53
Method
test_refusal_advisory_keeps_the_configured_model_beside_a_fallback_verdict
( self, mock_embed, mock_llm, mock_analyze, tmp_path: Path )
tests/deduplication/intra_skill/test_intra_skill_validator.py:1509
Function
test_refusal_fallback_model_env_for_the_anthropic_judge
(verifier, monkeypatch, value, expected)
tests/tier3/test_judge_policies.py:200
Function
test_refusal_fallback_model_env_for_the_bedrock_judge
(verifier, monkeypatch)
tests/tier3/test_judge_policies.py:212
Method
test_refusal_fallback_model_is_configurable
( self, monkeypatch: pytest.MonkeyPatch, env_value: str | None, expected: list[dict[str, str]] | None
tests/inference/test_llm_client.py:1132
Function
test_refusal_fallback_switch_is_not_redacted_as_a_secret
()
tests/test_harbor_claude_refusal_fallback.py:451
Function
test_refusal_text_in_tool_output_or_model_text_is_not_a_safety_refusal
( monkeypatch: pytest.MonkeyPatch, tmp_path: Path, lane: str, terminal: str )
tests/test_harbor_claude_refusal_fallback.py:671
Function
test_refuse_observed_failure
(workspace, outcome)
tests/test_trace_import.py:242
Function
test_refused_and_safety_findings_are_not_duplicates_and_paths_are_distinct
()
tests/reporting/test_evidence_views.py:70
Function
test_refused_branch_read_names_the_read_token_remedy
(gate, monkeypatch, capsys)
tests/ci/test_gitlab_default_head_admission.py:177
Function
test_refused_first_frame_and_stop_leave_the_cursor_shown
( monkeypatch: pytest.MonkeyPatch, notice_refused: bool, )
tests/test_tier3_progress.py:1476
Function
test_refused_judge_is_answered_from_the_explicit_list_only_under_replace
( verifier, monkeypatch, policy, answered_by )
tests/tier3/test_judge_policies.py:122
Method
test_refused_missing_reference_explains_acceptance_requirements
( self, mock_tools, tmp_path: Path, version: str )
tests/validators/test_security.py:9569
Function
test_refused_workflow_does_not_claim_a_complete_zero_match_scan
()
tests/reporting/test_evidence_views.py:162
Function
test_refuses_incomparable_evidence
(tmp_path, change)
tests/tier3/test_interactions.py:208
Function
test_registered_native_env_modes_are_supported_subset_of_pinned_harbor_release
()
tests/test_harbor_local_mode.py:505
Function
test_registry_creds_flag_is_an_inline_credential
(creds: list[str])
tests/validators/test_mcp_static.py:1147
Function
test_registry_creds_flag_with_a_referenced_password_passes
(creds: str)
tests/validators/test_mcp_static.py:1155
Method
test_registry_profile_requires_contact_author
The registry profile blocks a missing author and a name without an email.
tests/validators/test_schema.py:1092
Function
test_registry_profile_requires_contact_author_and_metadata_id
()
tests/validators/test_policy.py:85
Function
test_registry_profile_requires_contact_author_and_metadata_id
(tmp_path: Path)
tests/golden/test_policy_behavior.py:118
Function
test_registry_rejects_invalid_thresholds
(threshold: float)
tests/embedding/test_catalog.py:596
Function
test_registry_rejects_partial_catalog_save
(tmp_path: Path)
tests/embedding/test_collection_coverage.py:105
Function
test_regressed_dimension_reasoning_names_the_weakest_signal
()
tests/evaluation/test_judges.py:845
Function
test_regular_copy_preserves_modes_and_merges_transactionally
(tmp_path: Path)
tests/test_harbor_secure_copy.py:900
Function
test_reject_invalid_policy
(tmp_path, mutation)
tests/tier3/test_grader_policy.py:107
Function
test_reject_redirects_handler
_RejectRedirects returns None to reject all redirects.
tests/test_harbor_runtime_preflight.py:3807
Method
test_rejected_caveats_keep_the_findings
Caveats rejected for a folder target leave the scan INCOMPLETE with its findings, like a partial report.
tests/validators/test_security.py:11728
Method
test_rejected_caveats_name_three_rows
(self)
tests/validators/test_security.py:11663
Function
test_rejected_child_evidence_is_not_loaded_or_published
(child)
tests/ci/test_publish_reports.py:513
Function
test_rejected_upload_does_not_publish_an_empty_tests_directory
(tmp_path: Path)
tests/test_harbor_local_upload.py:38
Method
test_rejection_diagnostics_are_printable_single_lines
(self, tmp_path, control, caplog, monkeypatch)
tests/validators/test_rubric_eval.py:1334
Method
test_rejects_alias_target_created_after_discovery_snapshot
(self, tmp_path: Path, monkeypatch)
tests/embedding/test_extractor.py:501
Method
test_rejects_alias_target_created_after_discovery_snapshot
(self, skill_root: Path, monkeypatch)
tests/deduplication/utils/test_skill_collector.py:301
Method
test_rejects_ambient_provider_aliases_normalized_to_native_openai
( self, monkeypatch: pytest.MonkeyPatch, provider: str, api_key_env: str,
tests/inference/test_llm_client.py:232
Function
test_rejects_ambiguous_flat_and_nested_summaries
(tmp_path: Path)
tests/test_results_location_legacy_compatibility.py:418
Function
test_rejects_authenticated_current_partial_with_legacy_summary
(tmp_path: Path)
tests/test_results_location_legacy_compatibility.py:755
Method
test_rejects_broken_symlinked_manifest
(self, tmp_path: Path)
tests/embedding/test_extractor.py:664
Function
test_rejects_candidate_tree_swap_between_artifact_reads
( monkeypatch: pytest.MonkeyPatch, tmp_path: Path, *, newest_first: bool, )
tests/test_results_location_legacy_compatibility.py:997
Method
test_rejects_combined_content_above_total_byte_limit
(self, skill_root: Path, monkeypatch)
tests/deduplication/utils/test_skill_collector.py:751
Function
test_rejects_contradictory_gate_instead_of_rendering_it
()
tests/ci/test_comment_summary.py:306
Function
test_rejects_contradictory_or_unsafe_manifest
(mutate)
tests/ci/test_tier_manifest.py:137
Function
test_rejects_current_result_replaced_during_read
( monkeypatch: pytest.MonkeyPatch, tmp_path: Path, )
tests/test_results_location_legacy_compatibility.py:944
Function
test_rejects_current_run_with_list_valued_run_config
(tmp_path: Path)
tests/test_results_location_legacy_compatibility.py:222
Method
test_rejects_directory_alias_chain
(self, tmp_path: Path, write_skill)
tests/embedding/test_extractor.py:569
Method
test_rejects_directory_alias_chain
(self, skill_root: Path)
tests/deduplication/utils/test_skill_collector.py:383
Method
test_rejects_directory_alias_with_manifest_name
(self, tmp_path: Path, write_skill, alias_name: str)
tests/embedding/test_extractor.py:582
Method
test_rejects_directory_alias_with_scannable_name
(self, skill_root: Path, alias_name: str)
tests/deduplication/utils/test_skill_collector.py:401
Method
test_rejects_directory_alias_without_contained_regular_target
( self, tmp_path: Path, write_skill, target: str )
tests/embedding/test_extractor.py:594
Method
test_rejects_directory_alias_without_contained_regular_target
(self, skill_root: Path, target: str)
tests/deduplication/utils/test_skill_collector.py:416
Function
test_rejects_duplicate_json_keys
(selection: SimpleNamespace, tmp_path: Path)
tests/tier3/test_decoys.py:499
Function
test_rejects_duplicate_or_case_colliding_observations
(payload)
tests/tier3/test_external_metrics.py:151
Function
test_rejects_duplicate_selection
(selection: SimpleNamespace, tmp_path: Path)
tests/tier3/test_decoys.py:490
Function
test_rejects_escaping_or_noncanonical_manifest_paths
( selection: SimpleNamespace, tmp_path: Path, relative: str, )
tests/tier3/test_decoys.py:454
Method
test_rejects_exception_that_exposes_host_home
( self, tmp_path: Path, monkeypatch: pytest.MonkeyPatch, broad_root: str,
tests/test_harbor_local_sandbox.py:762
Method
test_rejects_file_larger_than_per_file_byte_limit
(self, skill_root: Path, monkeypatch)
tests/deduplication/utils/test_skill_collector.py:739
Method
test_rejects_hard_linked_selected_file
(self, skill_root: Path)
tests/deduplication/utils/test_skill_collector.py:274
Method
test_rejects_hard_linked_skill_manifest
(self, tmp_path: Path)
tests/embedding/test_extractor.py:471
Function
test_rejects_incoherent_legacy_pass_at_k_case
( tmp_path: Path, field: str, value: object, )
tests/test_results_location_legacy_compatibility.py:607
Function
test_rejects_incoherent_legacy_pass_at_k_totals
( tmp_path: Path, field: str, value: object, )
tests/test_results_location_legacy_compatibility.py:583
← previous
next →
20,901–21,000 of 24,741, ranked by callers