MCPcopy Create free account

hub / github.com/NVIDIA/SkillEvaluator / functions

Functions24,741 in github.com/NVIDIA/SkillEvaluator

Functiontest_command_arg_secret_value_shape_blocked_regardless_of_flag
()
tests/validators/test_mcp_static.py:559
Functiontest_command_args_past_the_old_cap_are_analyzed
(tmp_path: Path)
tests/validators/test_plugin_hook_risk_bounds.py:278
Methodtest_command_argv_preserved_after_separator
(self, tmp_path: Path)
tests/test_harbor_local_sandbox.py:644
Functiontest_command_consoles_print_emoji_codes_literally
( capsys: pytest.CaptureFixture[str], monkeypatch: pytest.MonkeyPatch )
tests/reporting/test_rich_markup_escaping.py:324
Functiontest_command_does_not_relabel_runtime_failure_as_configuration_failure
( monkeypatch: pytest.MonkeyPatch, tmp_path: Path, )
tests/test_tier3_progress.py:5867
Functiontest_command_evidence_keeps_the_command_around_masked_credentials
(copy: str)
tests/tier3/test_security_finding_evidence.py:345
Functiontest_command_findings_never_echo_a_credential_flag_value
Regression: a credential flag's value given as its own argument ('--password <value>') was withheld by mcp_command_inline_secret but printed by th
tests/validators/test_mcp_static.py:691
Functiontest_command_findings_never_echo_an_inline_credential
Regression: 'command argument contains an inline credential' printed the credential itself.
tests/validators/test_mcp_static.py:659
Functiontest_command_floating_marker_on_a_package_or_image_is_blocked
(config)
tests/validators/test_mcp_static.py:235
Functiontest_command_floating_version_blocked
()
tests/validators/test_mcp_static.py:217
Functiontest_command_frontmatter_hooks_are_analyzed
(tmp_path: Path)
tests/validators/test_plugin_static_risk_review_fixes.py:113
Functiontest_command_hook_credential_references_are_not_inline_secrets
(tmp_path: Path, command: str)
tests/validators/test_plugin_component_risk.py:1125
Functiontest_command_hook_inline_credential_outside_a_url_is_critical
Regression: command hooks reported only credentials in a URL's userinfo, query, or fragment.
tests/validators/test_plugin_component_risk.py:1095
Functiontest_command_hook_url_credentials_are_critical_and_redacted
(tmp_path: Path, command: str)
tests/validators/test_plugin_component_risk.py:779
Functiontest_command_hook_urls_without_literal_credentials_are_not_flagged
(tmp_path: Path, command: str)
tests/validators/test_plugin_component_risk.py:826
Functiontest_command_insecure_tls_flag_blocked
()
tests/validators/test_mcp_static.py:306
Functiontest_command_keeps_runner_finished_event_terminal_on_engine_exception
( monkeypatch: pytest.MonkeyPatch, tmp_path: Path, )
tests/test_tier3_progress.py:5990
Functiontest_command_line_credentials_are_redacted_from_excerpts
(command: str, secret: str)
tests/reporting/test_tier3_failure_reasons.py:266
Functiontest_command_line_redaction_keeps_harmless_flags
()
tests/reporting/test_tier3_failure_reasons.py:277
Functiontest_command_line_written_in_command_is_checked_for_inline_credentials
(command: str, message: str)
tests/validators/test_mcp_static.py:709
Functiontest_command_map_allowed_tools_are_checked
(tmp_path: Path)
tests/validators/test_plugin_component_risk.py:287
Functiontest_command_powershell_grant_suggests_a_scoped_powershell_rule
(tmp_path: Path)
tests/validators/test_plugin_component_risk.py:296
Functiontest_command_protects_reporter_startup_and_still_runs_engine
( monkeypatch: pytest.MonkeyPatch, tmp_path: Path, )
tests/test_tier3_progress.py:5921
Functiontest_command_runner_terminalizes_inherited_configuration_stage
( monkeypatch: pytest.MonkeyPatch, tmp_path: Path, )
tests/test_tier3_progress.py:6039
Functiontest_command_scoped_allowed_tools_are_not_flagged
(tmp_path: Path)
tests/validators/test_plugin_component_risk.py:272
Functiontest_command_shell_inline_program_forms_are_blocked
(config)
tests/validators/test_mcp_static.py:118
Functiontest_command_shell_interpreter_dash_c_is_blocked
()
tests/validators/test_mcp_static.py:74
Functiontest_command_shell_metacharacters_blocked
(config, expected)
tests/validators/test_mcp_static.py:70
Functiontest_command_succeeded_does_not_attribute_shell_tail_status
(command, observation)
tests/tier3/test_declarative_checks.py:92
Functiontest_command_succeeded_requires_invocation_and_recorded_success
()
tests/tier3/test_declarative_checks.py:50
Functiontest_command_succeeded_uses_anchored_shared_exit_status
()
tests/tier3/test_declarative_checks.py:61
Functiontest_command_uses_explicit_argv_without_mutating_process_state
(tmp_path, monkeypatch)
tests/tier3/test_generate_dataset_results.py:459
Functiontest_command_without_shell_inline_program_is_not_dangerous_form
(config)
tests/validators/test_mcp_static.py:193
Functiontest_commands_after_a_heredoc_terminator_are_still_commands
A heredoc body ends at its delimiter line, not at the end of the text.
tests/tier3/test_script_invocation_evidence.py:495
Functiontest_commands_forward_skip_with_skill_and_reject_both_arms
(skill: Path, monkeypatch: pytest.MonkeyPatch)
tests/tier3/test_skip_with_skill.py:185
Functiontest_commands_that_are_not_invocations_score_zero
Only a recognised way of running a script earns credit, so no list of non-executing commands has to be maintained.
tests/tier3/test_script_invocation_evidence.py:272
Functiontest_commands_without_credentials_keep_their_whole_evidence
(copy: str, command: str, finding_type: str)
tests/tier3/test_security_finding_evidence.py:785
Methodtest_comment_block_3_plus_lines
(self)
tests/deduplication/utils/test_chunker.py:356
Methodtest_comment_block_at_eof
(self, prefix: str, ending: str)
tests/deduplication/utils/test_chunker.py:277
Functiontest_comment_is_byte_identical_to_native_renderer_with_scores_fixes_and_noop
(tmp_path, status)
tests/ci/test_prepare_comments.py:66
Functiontest_comment_retains_run_error_with_all_optional_header_fields
(tmp_path)
tests/ci/test_report_views.py:677
Functiontest_comment_sparse_checkout_runs_with_only_the_standard_library
(tmp_path)
tests/ci/test_publisher_workflow.py:403
Functiontest_comment_syntax_does_not_hide_raw_text_end_tag
(tag: str)
tests/validators/test_markdown.py:193
Functiontest_comment_waits_for_this_runs_own_successful_deploy
(committed, deploy, comments)
tests/ci/test_publisher_workflow.py:263
Functiontest_comment_without_hosting_explains_where_to_open_the_html
(tmp_path)
tests/ci/test_report_views.py:151
Methodtest_commented_markdown_link_is_not_nested
(self, tmp_path: Path)
tests/validators/test_quality_score.py:1462
Functiontest_comments_workflow_privileges_and_trusted_code_boundary
()
tests/ci/test_prepare_comments.py:193
Methodtest_commit_wins_over_a_content_digest
(self)
tests/test_benchmark_source_provenance.py:276
Functiontest_commits_and_checkout_are_resolved_with_one_rev_parse
(repository, monkeypatch)
tests/ci/test_select_changed_skills.py:267
Functiontest_committed_submodule_ignore_cannot_hide_a_skill_change
A gitlink update under a skill root still needs the enriched scan.
tests/ci/test_run_tier1_image.py:364
Functiontest_common_basis_keeps_only_the_dimensions_every_arm_scored_for_that_case
()
tests/tier3/test_private_ladder_stats.py:81
Functiontest_common_metric_is_selected_before_dimension_weighting
()
tests/tier3/test_private_comparison_contracts.py:332
Methodtest_common_package_artifact_suffixes_are_not_pii
(self, tmp_path: Path, suffix: str)
tests/validators/test_security.py:8718
Functiontest_common_skill_use_spellings_warn
(text)
tests/tier3/test_dataset_baseline_fairness.py:1708
Methodtest_commonmark_dead_links_are_detected
Navigation and image targets discovered by CommonMark are checked.
tests/validators/test_hygiene.py:193
Functiontest_commonmark_links_are_extracted
(content: str, target: str)
tests/validators/test_markdown.py:81
Methodtest_commonmark_local_targets_are_normalized_before_lookup
Encoded spaces, queries, fragments, and directory links resolve locally.
tests/validators/test_hygiene.py:220
Methodtest_commonmark_non_navigation_contexts_are_ignored
Frontmatter, code, comments, and non-navigation HTML stay inert.
tests/validators/test_hygiene.py:203
Functiontest_compact_adversarial_failure_fields_render_as_text
(tmp_path)
tests/ci/test_report_views.py:790
Functiontest_compact_all_pass_is_concise_and_rich_evidence_stays_in_details
(tmp_path)
tests/ci/test_report_views.py:584
Functiontest_compact_behavior_conversation_preserves_final_response_section
(monkeypatch)
tests/tier3/test_behavior_evidence.py:1269
Functiontest_compact_behavior_conversation_section_layout_permutations
( monkeypatch, case_name: str, limit: int, final_limit_env: str, text_builder, expecte
tests/tier3/test_behavior_evidence.py:1391
Functiontest_compact_concrete_name_replacement_requires_exact_known_evidence
(tmp_path, field, folder, normalize)
tests/ci/test_report_views.py:808
Functiontest_compact_configuration_error_is_not_green_and_has_artifact_fallback
(tmp_path)
tests/ci/test_report_views.py:658
Functiontest_compact_coverage_keeps_exact_counts_and_prefers_failing_rows
()
tests/reporting/test_declarative_coverage.py:382
Functiontest_compact_dimension_table_keeps_agent_headers_free_of_condition_labels
()
tests/reporting/test_terminal_polish.py:724
Functiontest_compact_failed_validator_without_recorded_findings_still_has_action
(tmp_path)
tests/ci/test_report_views.py:650
Functiontest_compact_failure_has_one_action_with_recorded_fix_and_location
(tmp_path)
tests/ci/test_report_views.py:604
Functiontest_compact_feedback_panel_filters_messages_rendered_in_detailed_panel
(monkeypatch)
tests/test_commands.py:3673
Functiontest_compact_footer_is_last_and_omits_result_json
(tmp_path: Path)
tests/test_tier3_result_display.py:1510
Functiontest_compact_incomplete_has_reason_even_without_findings
(tmp_path, with_diagnostic)
tests/ci/test_report_views.py:627
Functiontest_compact_large_untrusted_fields_stay_bounded_and_useful
(tmp_path)
tests/ci/test_report_views.py:772
Functiontest_compact_lists_at_most_five_affected_skills_with_explicit_remainder
(tmp_path)
tests/ci/test_report_views.py:725
Functiontest_compact_near_matching_name_error_keeps_recorded_fix
(tmp_path)
tests/ci/test_report_views.py:822
Methodtest_compact_output
Test compact JSON output without indentation.
tests/reporting/test_reporters.py:743
Functiontest_compact_panel_shares_incomplete_status_and_publication
(tmp_path)
tests/reporting/test_final_render_context.py:152
Functiontest_compact_percent_encoded_huge_hosted_url_preserves_headline_and_bound
(tmp_path)
tests/ci/test_report_views.py:832
Functiontest_compact_quality_grade_has_semantic_color
(grade, style)
tests/reporting/test_terminal_polish.py:20
Functiontest_compact_run_context_includes_comparisons
()
tests/evaluation/test_tier3_feedback_chat.py:225
Functiontest_compact_run_context_keeps_agent_resources
()
tests/evaluation/test_tier3_feedback_chat.py:204
Functiontest_compact_skip_reason_keeps_setup_instructions
()
tests/test_commands.py:3604
Functiontest_compact_skip_reason_stays_bounded_and_inert
()
tests/test_commands.py:3620
Functiontest_compact_tier3_panel_counts_and_previews_source_errors
( tmp_path: Path, blocking: bool, error_count: int, report_formats: tuple[str, ...], )
tests/reporting/test_tier3_source_validation_reporting.py:269
Functiontest_compact_tier3_panel_projects_source_errors_to_one_safe_line
(tmp_path: Path)
tests/reporting/test_tier3_source_validation_reporting.py:314
Functiontest_compact_unproven_evidence_never_claims_pass
(tmp_path, kind)
tests/ci/test_report_views.py:754
Functiontest_compact_validate_summary_keeps_all_harbor_evidence_reachable
(tmp_path)
tests/reporting/test_evidence_views.py:197
Functiontest_compact_validate_view_leaves_coverage_notes_to_the_report_files_and_the_docs_say_so
Only the full terminal report prints the notes; a plain ``validate`` shows the compact view.
tests/reporting/test_tier3_incomplete_arms.py:504
Functiontest_compact_view_shows_worst_finding_per_harness_and_catalog
(tmp_path: Path)
tests/harness/test_overlay.py:898
Functiontest_compact_without_hosted_url_has_one_artifact_instruction
(tmp_path)
tests/ci/test_report_views.py:845
Methodtest_compacted_issue_is_kept_when_any_occurrence_is_on_a_control_path
(self, tmp_path: Path)
tests/validators/test_skillspector_scope.py:580
Methodtest_compacted_issue_outside_control_paths_is_suppressed
(self, tmp_path: Path)
tests/validators/test_skillspector_scope.py:604
Methodtest_compacted_issue_reaches_a_referenced_occurrence
(self, tmp_path: Path)
tests/validators/test_skillspector_scope.py:592
Methodtest_compacted_report_cannot_hide_a_control_path_match
( self, mock_tools, tmp_path: Path, occurrence_files: list[str], findings_after_filtering: int )
tests/validators/test_skillspector_scope.py:1728
Functiontest_compare_carries_persisted_historical_overall
( tmp_path: Path, capsys: pytest.CaptureFixture[str], )
tests/test_tier3_compare.py:215
Functiontest_compare_consumes_authenticated_timestamped_pre_status_run
( tmp_path: Path, capsys: pytest.CaptureFixture[str], )
tests/test_tier3_compare.py:710
Functiontest_compare_does_not_fabricate_missing_standard_scores
( tmp_path: Path, capsys: pytest.CaptureFixture[str], )
tests/test_tier3_compare.py:304
Functiontest_compare_does_not_pair_summaries_with_different_score_policies
( tmp_path: Path, capsys: pytest.CaptureFixture[str], )
tests/test_tier3_compare.py:339
Functiontest_compare_does_not_pair_unversioned_metric_and_scalar_policies
( tmp_path: Path, capsys: pytest.CaptureFixture[str], )
tests/test_tier3_compare.py:373
Functiontest_compare_falls_back_from_unusable_primary_root_to_valid_legacy_root
( tmp_path: Path, capsys: pytest.CaptureFixture[str], primary_kind: str, )
tests/test_tier3_compare.py:726
Functiontest_compare_ignores_failed_baseline_scores
( tmp_path: Path, capsys: pytest.CaptureFixture[str], )
tests/test_tier3_compare.py:500
← previousnext →14,201–14,300 of 24,741, ranked by callers