MCPcopy Create free account

hub / github.com/NVIDIA/SkillEvaluator / functions

Functions24,741 in github.com/NVIDIA/SkillEvaluator

Functiontest_lsp_server_with_non_list_args_is_reported_not_crashed
(tmp_path: Path)
tests/validators/test_plugin_static_risk_review_fixes.py:764
Functiontest_lsp_servers_get_stdio_command_form_checks
(tmp_path: Path)
tests/validators/test_plugin_static_risk_review_fixes.py:742
Functiontest_lstat_walk_inspects_each_component_in_order_and_never_below_a_link
( tmp_path: Path, monkeypatch: pytest.MonkeyPatch )
tests/utils/test_secure_fs_platform.py:593
Functiontest_lstat_walk_reports_an_unreadable_component_as_an_error
( tmp_path: Path, monkeypatch: pytest.MonkeyPatch )
tests/utils/test_secure_fs_platform.py:611
Functiontest_lstat_walk_stops_at_the_first_unusable_component
( tmp_path: Path, relative: str, outcome: str, failing_index: int | None, metadata_of: str
tests/utils/test_secure_fs_platform.py:570
Methodtest_ltr_rtl_marks_detected
(self, tmp_path: Path)
tests/validators/test_unicode_smuggle.py:99
Methodtest_luhn_invalid_numbers
Random digit strings should fail Luhn.
tests/validators/test_security.py:8151
Methodtest_luhn_valid_numbers
Known valid card numbers should pass Luhn.
tests/validators/test_security.py:8145
Functiontest_machine_reporters_preserve_only_valid_publication_evidence
()
tests/test_publication_evidence.py:271
Functiontest_macos_unresolved_tmp_alias_excludes_evaluation_material
(tmp_path: Path, layout: str)
tests/tier3/test_plugin_prepare_review.py:253
Methodtest_macos_uses_seatbelt_as_semi_trusted_backend
(self, monkeypatch: pytest.MonkeyPatch)
tests/test_harbor_local_sandbox.py:75
Methodtest_macos_without_sandbox_exec_fails_closed
(self, monkeypatch: pytest.MonkeyPatch)
tests/test_harbor_local_sandbox.py:86
Methodtest_magic_numbers_finding
(self, skill_with_scripts)
tests/validators/test_script_lint.py:170
Methodtest_main_accepts_a_recorded_card
(self, tmp_path: Path)
tests/test_benchmark_source_provenance.py:473
Methodtest_main_accepts_the_requested_card
(self, tmp_path: Path)
tests/test_benchmark_source_provenance.py:764
Functiontest_main_checks_both_sides_of_a_rename
( git_repo: tuple[Path, str], tmp_path: Path, monkeypatch: pytest.MonkeyPatch, )
tests/test_ci_change_classifier.py:272
Functiontest_main_checks_the_source_of_a_rename_into_docs
( git_repo: tuple[Path, str], tmp_path: Path, monkeypatch: pytest.MonkeyPatch, )
tests/test_ci_change_classifier.py:299
Functiontest_main_classifies_a_real_docs_only_diff
( git_repo: tuple[Path, str], tmp_path: Path, monkeypatch: pytest.MonkeyPatch, capsys: pytest.
tests/test_ci_change_classifier.py:197
Functiontest_main_classifies_a_real_mixed_diff_as_full_ci
( git_repo: tuple[Path, str], tmp_path: Path, monkeypatch: pytest.MonkeyPatch, capsys: pytest.
tests/test_ci_change_classifier.py:214
Functiontest_main_classifies_a_real_source_diff_for_the_tier3_platform_jobs
( git_repo: tuple[Path, str], tmp_path: Path, monkeypatch: pytest.MonkeyPatch, capsys: pytest.
tests/test_ci_change_classifier.py:239
Functiontest_main_containment_uses_rm_fallback_when_state_inspection_fails
( tmp_path: Path, monkeypatch: pytest.MonkeyPatch, )
tests/test_harbor_secure_docker_environment.py:3778
Functiontest_main_fails_closed_for_an_empty_diff
( git_repo: tuple[Path, str], tmp_path: Path, monkeypatch: pytest.MonkeyPatch, capsys: pytest.
tests/test_ci_change_classifier.py:363
Functiontest_main_fails_closed_for_invalid_revisions
( git_repo: tuple[Path, str], revision: str, tmp_path: Path, monkeypatch: pytest.MonkeyPatch,
tests/test_ci_change_classifier.py:345
Functiontest_main_fails_closed_outside_a_git_repository
( git_repo: tuple[Path, str], tmp_path: Path, monkeypatch: pytest.MonkeyPatch, capsys: pytest.
tests/test_ci_change_classifier.py:381
Functiontest_main_full_with_author_negative_writes_four_cases
(tmp_path)
tests/tier3/test_generate_dataset_results.py:380
Functiontest_main_invalid_skill_raises_domain_error_without_printing
(tmp_path, capsys)
tests/tier3/test_generate_dataset_results.py:354
Functiontest_main_llm_trace_uses_observed_answer_for_generated_cases
(tmp_path, monkeypatch)
tests/tier3/test_dataset_grounding.py:263
Functiontest_main_prints_one_selected_file_per_line
(tmp_path: Path, capsys: pytest.CaptureFixture[str])
tests/test_select_docs_tests.py:138
Functiontest_main_refuses_an_empty_selection
pytest with no paths runs the whole suite, so an empty answer must not look like success.
tests/test_select_docs_tests.py:148
Methodtest_main_rejects_a_card_for_another_commit
(self, tmp_path: Path, capsys: pytest.CaptureFixture[str])
tests/test_benchmark_source_provenance.py:768
Methodtest_main_rejects_a_card_without_provenance
(self, tmp_path: Path)
tests/test_benchmark_source_provenance.py:477
Methodtest_main_rejects_a_card_without_the_identity
(self, tmp_path: Path)
tests/test_benchmark_source_provenance.py:773
Functiontest_main_reports_created_dataset_with_written_payload
(tmp_path, extra_args, expected_cases)
tests/tier3/test_generate_dataset_results.py:364
Functiontest_main_reports_existing_dataset_as_unchanged
(tmp_path)
tests/tier3/test_generate_dataset_results.py:440
Functiontest_main_secure_handoff_restores_host_control_environment_for_every_compose_client
( tmp_path: Path, monkeypatch: pytest.MonkeyPatch, )
tests/test_harbor_secure_docker_environment.py:2551
Functiontest_main_service_downloads_restore_host_controls_and_harbor_infrastructure
( tmp_path: Path, monkeypatch: pytest.MonkeyPatch, )
tests/test_harbor_secure_docker_environment.py:3852
Methodtest_main_tolerates_the_same_card_by_default
(self, tmp_path: Path)
tests/test_benchmark_source_provenance.py:481
Functiontest_main_trace_refines_real_trajectory_without_losing_authored_content
( tmp_path, monkeypatch, existing_dataset, )
tests/tier3/test_dataset_grounding.py:133
Functiontest_main_treats_a_deleted_docs_file_as_docs_only
( git_repo: tuple[Path, str], tmp_path: Path, monkeypatch: pytest.MonkeyPatch, )
tests/test_ci_change_classifier.py:259
Functiontest_main_treats_a_rename_within_docs_as_docs_only
( git_repo: tuple[Path, str], tmp_path: Path, monkeypatch: pytest.MonkeyPatch, )
tests/test_ci_change_classifier.py:286
Functiontest_main_uses_collected_trajectory_sources_for_generation_inputs
(tmp_path, monkeypatch)
tests/tier3/test_dataset_grounding.py:242
Functiontest_main_uses_the_merge_base_when_the_base_branch_advances
( git_repo: tuple[Path, str], tmp_path: Path, monkeypatch: pytest.MonkeyPatch, )
tests/test_ci_change_classifier.py:326
Functiontest_malformed_80_kib_input_does_not_produce_links
Malformed link syntax must not manufacture navigation destinations.
tests/validators/test_markdown.py:294
Functiontest_malformed_agent_conditions_cannot_certify_publication
( tmp_path: Path, invalid_conditions: object, )
tests/reporting/test_advisory_skip_verdict.py:3031
Functiontest_malformed_and_oversized_datasets_are_refused
(tmp_path: Path)
tests/tier3/test_plugin_dataset.py:108
Functiontest_malformed_and_unsafe_references_are_bounded_advisories
(tmp_path)
tests/test_plugin_dependency_records.py:108
Functiontest_malformed_api_roots_have_fixed_secret_free_errors
(url)
tests/ci/test_model_config.py:98
Functiontest_malformed_authoritative_step_topology_invalidates_root_reward
( tmp_path: Path, step_results: list[dict[str, object]], )
tests/test_harbor_collector_runtime_failures.py:1244
Functiontest_malformed_baseline_trial_values_render_as_unavailable
(field: str, value: object, column: str)
tests/reporting/test_tier3_baseline_trial_views.py:500
Functiontest_malformed_behavior_result_cannot_abstain
(unchecked_behavior, result)
tests/tier3/test_grader_validation.py:417
Functiontest_malformed_bounded_metadata_never_claims_verified_usage_or_breaks_rich
(invalid, field)
tests/tier3/test_run_budget.py:763
Functiontest_malformed_canonical_pass_payload_is_incomplete_and_lints_cleanly
(tmp_path: Path)
tests/test_public_benchmark_gate.py:1096
Methodtest_malformed_catalog_is_an_actionable_failure
( self, _mock_client_cls, mock_registry_cls, tmp_path: Path )
tests/validators/test_similarity.py:536
Functiontest_malformed_codex_types_do_not_discard_valid_log_items
(tmp_path)
tests/tier3/test_plugin_evidence_review.py:141
Functiontest_malformed_comparison_objects_are_not_sent_to_the_template
(invalid)
tests/reporting/test_native_overview_comparison.py:159
Functiontest_malformed_comparison_text_and_sources_fail_closed
()
tests/reporting/test_native_overview_comparison.py:165
Functiontest_malformed_container_reports_are_incomplete
(audit, tmp_path, report)
tests/validators/test_private_dependency_audit.py:253
Functiontest_malformed_counts_are_neither_shown_nor_exported
(summary: object)
tests/reporting/test_skillspector_reference_summary.py:311
Functiontest_malformed_coverage_lists_cannot_invent_activation
(value)
tests/reporting/test_private_runtime_projection.py:287
Methodtest_malformed_criterion_evidence_fails_closed
(self, tmp_path, case)
tests/validators/test_rubric_eval.py:997
Functiontest_malformed_display_scores_are_unavailable
()
tests/test_version_comparison.py:311
Functiontest_malformed_evidence_rejected
(payload, mutate)
tests/reporting/test_retained_html.py:175
Functiontest_malformed_existing_workflow_has_actionable_error
(content)
tests/test_ci_onboarding.py:511
Functiontest_malformed_file_evidence_is_a_named_suite_error
(suite_dir, tool_calls)
tests/tier3/test_grader_validation.py:246
Methodtest_malformed_frontmatter
Test handling of malformed YAML frontmatter.
tests/validators/test_license.py:1264
Functiontest_malformed_generation_mode_is_rejected
(mode: object)
tests/reporting/test_dataset_generation_provenance.py:143
Functiontest_malformed_hex_ipv4_parts_are_not_addresses
(host: str)
tests/validators/test_mcp_static.py:949
Functiontest_malformed_http_hook_url_flags_and_hides_its_credentials
(tmp_path: Path)
tests/validators/test_plugin_component_risk.py:759
Methodtest_malformed_identity_does_not_reach_the_payload
(self)
tests/test_benchmark_source_provenance.py:254
Methodtest_malformed_identity_is_dropped
(self, value: object)
tests/test_benchmark_source_provenance.py:112
Functiontest_malformed_job_diagnostic_is_redacted_and_bounded_before_publication
(tmp_path: Path)
tests/test_harbor_collector_runtime_failures.py:444
Functiontest_malformed_json_is_a_safe_structured_client_error
(bridge_services: _BridgeServices)
tests/test_nvidia_build_bridge.py:1517
Functiontest_malformed_json_sections_become_incomplete_without_escaping
(tmp_path, errors)
tests/validators/test_private_format_boundaries.py:71
Functiontest_malformed_jsonl_rejects_the_entire_candidate
(tmp_path: Path)
tests/reporting/test_report_data_bounds.py:724
Functiontest_malformed_manifest_is_a_fact_not_a_crash
(tmp_path: Path)
tests/harness/test_plugin_compat.py:102
Functiontest_malformed_manifest_is_visible_without_activation
(tmp_path, malformed)
tests/test_plugin_discovery.py:247
Functiontest_malformed_mcp_servers_toml_is_handled_as_on_harbor
(tmp_path: Path, caplog: pytest.LogCaptureFixture)
tests/test_nemo_gym_backend.py:2042
Functiontest_malformed_message_is_not_an_activation_skip
()
tests/test_harbor_skill_activation.py:50
Functiontest_malformed_native_identity_is_an_incomplete_comparison_not_a_security_failure
( tmp_path: Path, monkeypatch, fields: dict )
tests/deduplication/plugin/test_openclaw_profile.py:197
Functiontest_malformed_native_schema_is_diagnostic_and_preserves_other_sources
(tmp_path: Path, malformation: str)
tests/reporting/test_dashboard_data.py:1061
Functiontest_malformed_optional_evidence_is_explicit_and_does_not_crash
(value)
tests/reporting/test_private_runtime_projection.py:278
Functiontest_malformed_or_foreign_request_is_rejected_before_network
(request_env, monkeypatch, key, value, capsys)
tests/ci/test_gitlab_feedback_request.py:105
Functiontest_malformed_or_mismatched_source_run_fails_closed
(tmp_path, changes)
tests/ci/test_comment_report.py:266
Functiontest_malformed_or_overlong_traces_are_incomplete_without_escaping
(security)
tests/tier3/test_private_plugin_security.py:316
Functiontest_malformed_or_unknown_mode_preserves_coverage_evidence_and_payload
(mode, recorded)
tests/reporting/test_final_render_context.py:578
Methodtest_malformed_or_unknown_occurrences_fail_closed
( self, tmp_path: Path, occurrences: object, file_role: str )
tests/validators/test_skillspector_scope.py:629
Methodtest_malformed_or_unsafe_author_blocks_in_every_profile
Malformed or unsafe values stay HIGH under both bundled profiles.
tests/validators/test_schema.py:1076
Functiontest_malformed_patch_input_degrades_without_raising_or_fabricating_a_path
(args: dict)
tests/tier3/test_behavior_evidence.py:1516
Functiontest_malformed_payload_has_a_structured_client_error
()
tests/test_nvidia_build_bridge.py:2824
Functiontest_malformed_payloads_are_rejected_without_guessing
(bad)
tests/reporting/test_plugin_evidence_report.py:81
Methodtest_malformed_pip_audit_reports_are_incomplete
Malformed reports cannot certify successful dependency scanning.
tests/validators/test_security_validators.py:321
Functiontest_malformed_policy_before_provider
(monkeypatch, qualification_policy, tmp_path)
tests/tier3/test_grader_validation.py:987
Functiontest_malformed_previous_version_is_rejected
(tmp_path: Path)
tests/validators/test_version.py:134
Functiontest_malformed_python_advisory_never_becomes_clean
(audit, tmp_path, vulnerability)
tests/validators/test_private_dependency_audit.py:551
Methodtest_malformed_reply_field_is_incomplete_whatever_the_verdict
( self, mock_embed, mock_llm, tmp_path: Path, reply: dict[str, object] )
tests/deduplication/intra_skill/test_intra_skill_validator.py:1159
Functiontest_malformed_report_sections_stay_incomplete_without_crashing
(field)
tests/validators/test_security_reference_caveats.py:176
Methodtest_malformed_reported_path_is_not_filtered_or_probed
( self, tmp_path: Path, reported_path: str, )
tests/validators/test_artifact_dir_exclusion.py:594
Functiontest_malformed_retained_evidence_is_not_silently_published
(tmp_path)
tests/ci/test_native_reports.py:102
Functiontest_malformed_root_tier3_payload_fails_closed_without_crashing_reporters
()
tests/reporting/test_advisory_skip_verdict.py:1488
Functiontest_malformed_safety_output_never_crashes
(tmp_path, pip_audit, safety, report)
tests/validators/test_dependency_advisory_findings.py:454
← previousnext →18,301–18,400 of 24,741, ranked by callers