MCPcopy Create free account

hub / github.com/NVIDIA/SkillEvaluator / functions

Functions24,741 in github.com/NVIDIA/SkillEvaluator

Functiontest_dynamic_map_inline_incomplete_record_stays_unsupported
(extractor, body)
tests/tier3/test_codex_tool_call_normalization.py:2221
Functiontest_dynamic_map_inline_single_command_owns_its_own_record
(extractor)
tests/tier3/test_codex_tool_call_normalization.py:1970
Functiontest_dynamic_map_merges_literal_siblings_with_the_mapped_element
(extractor, argument)
tests/tier3/test_codex_tool_call_normalization.py:2434
Functiontest_dynamic_map_of_object_literals_passes_each_element_whole
(extractor)
tests/tier3/test_codex_tool_call_normalization.py:1957
Functiontest_dynamic_map_record_carries_its_own_outcome
(extractor, record, is_error)
tests/tier3/test_codex_tool_call_normalization.py:2239
Functiontest_dynamic_map_untrusted_records_stay_unsupported
(extractor, records)
tests/tier3/test_codex_tool_call_normalization.py:2169
Functiontest_dynamic_map_with_incomplete_records_stops_grading
(extractor)
tests/tier3/test_codex_tool_call_normalization.py:2265
Functiontest_each_bundled_skill_license_is_checked_beside_root_license
(tmp_path)
tests/validators/test_private_plugin_composition.py:117
Methodtest_each_check_announces_start_and_duration
(self, tiny_skill, progress_capture)
tests/test_progress_output.py:51
Functiontest_each_claude_flag_key_alone_marks_failure
(extra: dict[str, Any])
tests/tier3/test_f90_mcp_execution.py:101
Methodtest_each_digest_algorithm_requires_its_own_width
(self, algorithm: str, width: int)
tests/test_benchmark_source_provenance.py:142
Functiontest_each_dimension_keeps_its_own_largest_measurement
()
tests/tier3/test_budget_reservation.py:229
Methodtest_each_distinct_path_and_text_is_normalized_once_per_report
Findings that repeat the same absolute reference lines and reasons redact each text once.
tests/validators/test_skillspector_reference_diagnostics.py:653
Functiontest_each_exceeded_rate_fails
(name)
tests/tier3/test_grader_policy.py:165
Functiontest_each_explicit_plant_has_a_fresh_verifier_only_token
(canary)
tests/tier3/test_private_plugin_canary.py:31
Functiontest_each_harbor_step_drops_its_own_copied_context_prefix
()
tests/tier3/test_trajectory_timing.py:438
Methodtest_each_hop_accepts_the_identity
(self, module_path: str, function_name: str)
tests/test_benchmark_source_provenance.py:1249
Functiontest_each_lift_condition_keeps_label_number_and_complete_bar
(width)
tests/reporting/test_terminal_polish.py:35
Methodtest_each_packaged_term_records_error_handling
(self, tmp_path: Path, term: str)
tests/validators/test_quality_score.py:1548
Functiontest_each_private_profile_parses_real_json
(kind)
tests/test_plugin_format_profiles.py:18
Functiontest_each_report_is_released_once_its_result_is_logged
(tmp_path, monkeypatch)
tests/ci/test_run_tier1.py:1763
Functiontest_each_result_status_is_computed_once_for_all_views
(tmp_path, monkeypatch)
tests/ci/test_report_views.py:552
Methodtest_each_skill_in_a_folder_records_its_own_attempts
(self, tmp_path)
tests/validators/test_rubric_eval.py:1677
Functiontest_each_skill_report_is_read_once_for_all_views
(tmp_path, monkeypatch)
tests/ci/test_native_reports.py:237
Functiontest_each_slot_has_one_compact_source_qualification_without_repeated_run_metadata
(owner, slot)
tests/reporting/test_plugin_evidence_report.py:361
Functiontest_each_worker_gets_its_own_home_and_temporary_directory
(tmp_path)
tests/ci/test_run_tier1.py:1371
Functiontest_early_pass_is_complete_only_with_contiguous_attempt_evidence
()
tests/tier3/test_private_comparison_engine.py:210
Functiontest_early_stop_allows_bounded_completed_attempt_count
()
tests/reporting/test_advisory_skip_verdict.py:3150
Functiontest_ec2_environment_kwargs_accept_existing_ssh_key_path
(tmp_path: Path)
tests/test_tier3_public_runtime.py:509
Functiontest_ec2_environment_kwargs_reject_nonexistent_ssh_key_path
(ssh_key_path: str)
tests/test_tier3_public_runtime.py:498
Functiontest_ec2_private_ephemeral_environment_accepts_nonempty_subnet
()
tests/test_tier3_public_runtime.py:539
Functiontest_ec2_private_ephemeral_environment_requires_subnet
(subnet_id: str | None)
tests/test_tier3_public_runtime.py:523
Functiontest_edit_heavy_run_keeps_full_tool_efficiency_in_skill_efficiency
(tmp_path, monkeypatch)
tests/tier3/test_tool_productivity.py:589
Methodtest_edited_skill_matches_its_entry_only_while_compared_content_is_unchanged
( self, tmp_path: Path, write_skill, full_body: bool, old_text: str,
tests/embedding/test_catalog.py:848
Functiontest_effect_column_names_what_the_skill_changed_per_case
()
tests/test_tier3_case_summary.py:1311
Functiontest_effective_tls_policy
(options: dict, enabled: bool)
tests/validators/test_openclaw_mcp.py:153
Functiontest_eligibility_reports_whether_a_pr_changes_a_skill
Setup-only and unrelated PRs skip the paid LLM Tier 1 pass; the keyless scan stays.
tests/ci/test_github_admission_workflow.py:203
Functiontest_eligibility_skill_predicate_matches_the_shared_helper
(tmp_path, monkeypatch)
tests/ci/test_github_admission_workflow.py:211
Functiontest_eligible_enriched_run_never_substitutes_keyless_evidence
(config, tmp_path)
tests/ci/test_gitlab_enriched_admission.py:139
Methodtest_email_odata_id_not_flagged
@odata.id property should not be flagged as email.
tests/validators/test_security.py:8122
Methodtest_email_odata_property_not_flagged
OData/Redfish JSON property names like Members@odata.count should not be flagged.
tests/validators/test_security.py:8100
Methodtest_email_odata_type_not_flagged
@odata.type property should not be flagged as email.
tests/validators/test_security.py:8110
Methodtest_email_real_external_still_flagged
Real external email addresses should still be flagged.
tests/validators/test_security.py:8134
Methodtest_email_subdomain_of_example_not_flagged
Subdomains of example.com should not be flagged.
tests/validators/test_security.py:8090
Methodtest_email_url_credentials_not_flagged
URL credential syntax (user:pass@host) should not be flagged as email.
tests/validators/test_security.py:8080
Methodtest_embed_chunked_averages_vectors
(self, monkeypatch: pytest.MonkeyPatch)
tests/embedding/test_client.py:322
Methodtest_embed_chunked_rejects_non_integer_windows_before_provider_call
( self, monkeypatch: pytest.MonkeyPatch, chunk_size: object, overlap: object,
tests/embedding/test_client.py:362
Methodtest_embed_chunked_rejects_non_progressing_windows_before_provider_call
( self, monkeypatch: pytest.MonkeyPatch, overlap: int, )
tests/embedding/test_client.py:335
Methodtest_embed_empty_list_returns_empty
(self)
tests/embedding/test_client.py:292
Methodtest_embed_rejects_invalid_provider_response_indices
( self, monkeypatch: pytest.MonkeyPatch, items: list[_FakeEmbeddingItem], )
tests/embedding/test_client.py:248
Methodtest_embed_rejects_unsafe_provider_vectors
( self, monkeypatch: pytest.MonkeyPatch, vector: list[float], )
tests/embedding/test_client.py:264
Methodtest_embed_reorders_out_of_order_provider_response_by_index
(self, monkeypatch: pytest.MonkeyPatch)
tests/embedding/test_client.py:219
Methodtest_embed_returns_vectors
(self, monkeypatch: pytest.MonkeyPatch)
tests/embedding/test_client.py:127
Methodtest_embed_single_delegates
(self, monkeypatch: pytest.MonkeyPatch)
tests/embedding/test_client.py:279
Functiontest_embedded_executed_child_contributes_calls_once_without_mutating_source
()
tests/tier3/test_plugin_evidence_review.py:80
Functiontest_embedded_report_json_is_compact_with_existing_ascii_and_html_escaping
()
tests/reporting/test_report_efficiency.py:50
Functiontest_embedded_secret_only_id_collisions_are_remapped_without_oracle
(tmp_path: Path)
tests/test_harbor_collector_multistep_trajectory.py:1790
Functiontest_embedded_sibling_continuations_receive_distinct_parent_local_ids
(tmp_path: Path)
tests/test_harbor_collector_multistep_trajectory.py:1884
Methodtest_embedding_error_is_incomplete_without_skill_finding
(self, mock_embed, tmp_path: Path)
tests/deduplication/intra_skill/test_intra_skill_validator.py:903
Functiontest_embedding_rejection_of_llm_only_providers_names_the_fix
()
tests/test_provider_config.py:585
Methodtest_embedding_text_format
(self, tmp_path: Path)
tests/embedding/test_extractor.py:131
Functiontest_emit_reports_does_not_create_directories_through_symlinked_parent
(tmp_path: Path)
tests/reporting/test_secure_report_output.py:61
Functiontest_emit_reports_preserves_unavailable_evaluator_lift
( tmp_path, capsys, baseline_scores, expected_baseline, expected_lift, markdown_cells )
tests/reporting/test_reporters.py:2370
Methodtest_emit_reports_uses_recorded_tier_for_custom_validator_names
( self, tmp_path: Path, tier: int, comprehensive: bool )
tests/reporting/test_reporters.py:2301
Functiontest_emit_reports_writes_junit_file
(tmp_path: Path)
tests/reporting/test_junit_reporter.py:588
Methodtest_emit_reports_writes_sarif_file
(self, failure_result: ValidationResult)
tests/reporting/test_reporters.py:1586
Functiontest_emitted_dependency_damage_makes_parity_fail
(dependency_tasks, arm: str, change: str)
tests/tier3/test_private_loose_dependency_review.py:71
Functiontest_emitted_tasks_keep_target_reference_and_workspace_runtime_helpers
(tmp_path: Path, with_skill: bool)
tests/tier3/test_runtime_eval_directories.py:53
Functiontest_emitting_human_reports_preserves_canonical_json_and_return_value
(tmp_path, monkeypatch)
tests/reporting/test_final_render_context.py:286
Functiontest_empty_agents_do_not_claim_a_skipped_baseline
()
tests/reporting/test_tier3_skipped_baseline.py:76
Functiontest_empty_budget_has_no_incomplete_reason
(metadata)
tests/reporting/test_budget_partial_reporting.py:134
Methodtest_empty_checks_use_local_incomplete_diagnostic
(self, tmp_path)
tests/validators/test_rubric_eval.py:876
Methodtest_empty_choices_is_a_typed_error
(self, monkeypatch: pytest.MonkeyPatch)
tests/inference/test_llm_client.py:1469
Methodtest_empty_collection_debug_logs_use_label_without_host_path
(self, tmp_path: Path, monkeypatch)
tests/embedding/test_registry.py:253
Functiontest_empty_command_blocked
()
tests/validators/test_mcp_static.py:322
Functiontest_empty_containers_rejected
(payload, container)
tests/tier3/test_external_metrics.py:243
Methodtest_empty_correlated_body_is_unknown
(self)
tests/tier3/test_plugin_signals.py:565
Functiontest_empty_dashboard_has_upload_direction
()
tests/reporting/test_dashboard_app.py:109
Methodtest_empty_description_is_not_reported_as_too_short
(self, tmp_path: Path)
tests/validators/test_quality_score.py:1968
Methodtest_empty_dir
(self, tmp_path)
tests/validators/test_rubric_eval.py:245
Methodtest_empty_direct_references_are_not_treated_as_pinned
A direct-reference separator must be followed by a target.
tests/validators/test_hygiene.py:411
Methodtest_empty_directory
(self, skill_root: Path)
tests/deduplication/utils/test_skill_collector.py:124
Methodtest_empty_directory_fails_actionably
(self, _mock_client_cls, mock_registry_cls, tmp_path: Path)
tests/validators/test_similarity.py:66
Methodtest_empty_directory_passes
(self, tmp_path: Path)
tests/deduplication/intra_skill/test_intra_skill_validator.py:200
Functiontest_empty_directory_replacement_does_not_retain_previous_entries
(tmp_path: Path)
tests/embedding/test_collection_coverage.py:275
Methodtest_empty_directory_returns_empty
(self, tmp_path: Path)
tests/embedding/test_extractor.py:629
Methodtest_empty_directory_returns_zero
(self, tmp_path: Path)
tests/embedding/test_registry.py:299
Functiontest_empty_directory_upload_preserves_existing_shared_files
(tmp_path: Path, preexisting: bool)
tests/test_harbor_local_upload.py:79
Methodtest_empty_document_graph_is_bounded_before_judging
(self, tmp_path, monkeypatch)
tests/validators/test_rubric_eval.py:465
Functiontest_empty_emitted_task_set_stays_unknown
(tmp_path)
tests/tier3/test_private_comparison_staging.py:96
Functiontest_empty_evaluator_loader_reset_is_removed_before_launcher
(name: str, tmp_path: Path)
tests/test_harbor_local_mode.py:4151
Functiontest_empty_events_remain_empty
(tmp_path)
tests/tier3/test_opencode_exit_status.py:82
Functiontest_empty_evidence_lookup_rejects_unrecorded_refs
()
tests/tier3/test_suggestion_grounding.py:84
Functiontest_empty_export_and_bad_review_contract
(workspace)
tests/test_trace_import.py:370
Functiontest_empty_failed_arm_does_not_invent_trials
(tmp_path: Path)
tests/reporting/test_failed_arm_trials.py:214
Functiontest_empty_feature_list_and_string_and_mapping_forms
()
tests/reporting/test_dashboard_data.py:1290
Methodtest_empty_field_still_skips_the_manifest
(self, tmp_path: Path, value: str)
tests/embedding/test_extractor.py:878
Functiontest_empty_file_is_completed_without_installing_anything
(tmp_path, monkeypatch)
tests/validators/test_static_requirements_audit.py:86
Methodtest_empty_file_passes
(self, tmp_path: Path)
tests/validators/test_unicode_smuggle.py:43
Methodtest_empty_folder
Test validation of empty folder.
tests/validators/test_folder_validation.py:195
← previousnext →15,401–15,500 of 24,741, ranked by callers