MCPcopy Create free account

hub / github.com/NVIDIA/SkillEvaluator / functions

Functions24,741 in github.com/NVIDIA/SkillEvaluator

↓ 2 callersFunction_minimum_attainable_mcnemar_probability
Return the smallest two-sided exact probability attainable for this pair count.
src/skillevaluator/tier3/harbor/collector.py:4963
↓ 2 callersMethod_minimum_skillspector_risk_score
Return a conservative score floor from the public report fields.
src/skillevaluator/validators/security.py:4714
↓ 2 callersFunction_missing_windows_target_parent_usage
Validate destination ancestors and charge parents that must be created.
src/skillevaluator/tier3/harbor/secure_docker_environment.py:1182
↓ 2 callersFunction_mixed_agents
()
tests/reporting/test_activation_benchmark_html_regressions.py:90
↓ 2 callersFunction_model
(value: str)
ci/model_config.py:52
↓ 2 callersFunction_my_skill_md_wording
()
tests/tier3/test_dataset_baseline_fairness.py:1051
↓ 2 callersFunction_na
Record *metrics* as N/A the way the Harbor verifier does: no score plus the sidecar marker.
tests/reporting/test_tier3_baseline_trial_views.py:310
↓ 2 callersFunction_name_candidates
(name: str)
src/skillevaluator/tier3/eval_core/plugin_signals.py:3450
↓ 2 callersFunction_name_key
(name: str)
src/skillevaluator/evaluation/tier3_feedback_chat.py:125
↓ 2 callersFunction_name_list_scope
(text: str, shell_tools: tuple[str, ...] = ("Bash",))
src/skillevaluator/plugin_component_risk.py:1574
↓ 2 callersMethod_named_after
"the case for positive-001", "case: positive-001", "test case positive-001".
src/skillevaluator/evaluation/dataset_case_removal.py:411
↓ 2 callersFunction_native_custom_only_tests_are_complete
Return whether Harbor can resolve an authored test script for every pass.
src/skillevaluator/tier3/harbor/adapter.py:5350
↓ 2 callersFunction_native_stack
()
tests/tier3/test_mcp_proof_sdk_compat.py:27
↓ 2 callersFunction_negative_step_row
(name: str, reason: str = NEGATIVE)
tests/tier3/test_skill_metric_applicability.py:373
↓ 2 callersFunction_nested_hook_groups
Return a hooks config in the nested shape the hook risk analyzer reads. Cursor, and Agent Plugins client extensions such as ``com.cursor/`` and
src/skillevaluator/plugin_config_risk.py:232
↓ 2 callersFunction_nested_object
(depth: int)
tests/inference/test_llm_client.py:796
↓ 2 callersFunction_network_policy_blocks_metadata
Return True if a V1NetworkPolicy enforces egress isolation against both GKE metadata CIDRs.
src/skillevaluator/tier3/harbor/gke_environment.py:591
↓ 2 callersFunction_network_redirection
Return the index after a redirection at ``idx`` and whether it redirects stdin. ``< .env``, ``0< .env``, ``<&3``, ``2> /dev/null``, ``2>&1`` and
src/skillevaluator/tier3/eval_core/checks.py:2489
↓ 2 callersFunction_network_shell_tokens
Tokenize a shell command string while preserving token quote delimiters.
src/skillevaluator/tier3/eval_core/checks.py:1951
↓ 2 callersFunction_no_changes_summary
()
tests/ci/test_native_reports.py:138
↓ 2 callersFunction_no_ground_truth_payload
Return a scored one-case run with no ground_truth. With ``pass_at_k`` the agent carries the collector's pass@k summaries, so the payload has
tests/test_public_benchmark_gate.py:1243
↓ 2 callersFunction_non_empty_string
(value: Any, config_path: Path, field: str)
src/skillevaluator/tier3/evals_config.py:475
↓ 2 callersFunction_non_negative_ms
(value: Any)
src/skillevaluator/tier3/harbor/trajectory_timing.py:116
↓ 2 callersFunction_nonnegative_int
(value: object)
src/skillevaluator/reporting/benchmark.py:1743
↓ 2 callersFunction_normalize_artifact_uri
Return a URI-encoded SARIF artifact location. Paths inside the workspace become repository-relative references; other absolute paths become `
src/skillevaluator/reporting/sarif_reporter.py:179
↓ 2 callersFunction_normalize_evidence_refs
(raw_refs: Any)
src/skillevaluator/tier3/harbor/report.py:280
↓ 2 callersFunction_normalize_expected_case_id_set
Normalize optional expected case IDs into a stripped string set.
src/skillevaluator/tier3/harbor/collector.py:4636
↓ 2 callersFunction_normalize_harbor_upload_jobs
Project recorded upload URLs without deriving links or changing source data.
src/skillevaluator/reporting/harbor_viewer.py:21
↓ 2 callersMethod_normalize_identity_text
Normalize human text without coupling identity to formatting.
src/skillevaluator/models/result.py:136
↓ 2 callersFunction_normalize_rubric_checks
Validate criterion evidence and return it in rubric-schema order. The judge is authoritative only for each criterion's bounded score, pass fl
src/skillevaluator/validators/rubric_eval.py:126
↓ 2 callersFunction_normalized_identity_value
Return one card identity value in ``source_identity``'s canonical spelling. Both the expectation and the card go through the library's normalizer
scripts/ci/check_public_benchmarks.py:315
↓ 2 callersFunction_normalized_quality_local_path
Normalize a local path using Quality Score's legacy classification order. This intentionally remains separate from Hygiene's stricter path policy
src/skillevaluator/validators/quality_score.py:207
↓ 2 callersFunction_not_applicable_cell
()
src/skillevaluator/tier3/result_display.py:87
↓ 2 callersMethod_note_root_text
(self, piece_id: str, text: str)
src/skillevaluator/tier3/loose_parts.py:803
↓ 2 callersMethod_notify
(t,e,i,s)
src/skillevaluator/reporting/assets/chart.umd.min.js:7
↓ 2 callersMethod_notify
(t,e,i,s)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 2 callersFunction_number
(value: object, *, signed: bool = False)
src/skillevaluator/tier3/result_display.py:48
↓ 2 callersFunction_numeric_reward_payload
(reward: dict[str, Any], *, overall: float | None = None)
src/skillevaluator/tier3/harbor/templates/custom_grader_runner.py:316
↓ 2 callersFunction_nvidia_build_agent_import_path
Return the environment-specific NVIDIA Build compatibility wrapper.
src/skillevaluator/tier3/harbor/runner.py:3708
↓ 2 callersFunction_nvidia_build_key_handoff
Replace the host Build key with a stdin-backed sentinel.
src/skillevaluator/tier3/harbor/runner.py:1588
↓ 2 callersFunction_object
(value: object, keys: set[str], label: str)
src/skillevaluator/tier3/decoys.py:267
↓ 2 callersFunction_offer_local_runtime_install
Before a local-mode run, offer to install each missing agent CLI (pinned, managed root).
src/skillevaluator/cli.py:1142
↓ 2 callersFunction_offline_engine
(monkeypatch, *, missing: str | None = None)
tests/tier3/test_private_runtime_report_acceptance.py:104
↓ 2 callersMethod_offset
(self)
tests/reporting/report_markup_assertions.py:15
↓ 2 callersMethod_open
(self, path: Path)
tests/utils/test_secure_fs_platform.py:328
↓ 2 callersFunction_open_absolute_directory_posix
(path: Path)
src/skillevaluator/utils/secure_fs.py:278
↓ 2 callersFunction_open_file_parent
(source: Path, allowed_root: Path, *, role: str)
src/skillevaluator/tier3/harbor/secure_copy.py:398
↓ 2 callersMethod_open_posix
( self, relative_path: Path, expected: os.stat_result | None, *, allow_hardlinks: bool = False )
src/skillevaluator/utils/secure_fs.py:416
↓ 2 callersFunction_open_posix_catalog_parent
(catalog_path: Path, *, create: bool)
src/skillevaluator/embedding/registry.py:966
↓ 2 callersFunction_opencode_error_text
(state: dict[str, Any])
src/skillevaluator/tier3/eval_core/log_converters.py:443
↓ 2 callersFunction_operator_directory
(tmp_path: Path)
tests/test_harbor_dotenv_isolation.py:49
↓ 2 callersFunction_optional
(api, path)
ci/benchmark_publish.py:39
↓ 2 callersFunction_other_caveat_error
(labels: str)
tests/validators/test_security.py:11189
↓ 2 callersFunction_outside_root_reference
Return why a command token references a file outside the plugin root, or ``None``.
src/skillevaluator/plugin_component_risk.py:1753
↓ 2 callersFunction_overall_matrix_html
(output: str)
tests/test_harbor_html_report_failures.py:67
↓ 2 callersFunction_override_notes_folder_error
The error that says why the override notes skill in a folder is ``INCOMPLETE``.
tests/validators/test_security.py:11213
↓ 2 callersFunction_override_notes_report
The captured 2.13.4 report of the override notes skill; other versions report it as ``partial``.
tests/validators/test_security.py:11204
↓ 2 callersFunction_owned
(comment: dict, bot: str)
ci/comment_report.py:113
↓ 2 callersFunction_owner
Return the agent a runner launch error names, or None when it names none.
src/skillevaluator/tier3/harbor/baseline_timeouts.py:196
↓ 2 callersFunction_package
(root: Path)
tests/tier3/test_private_comparison_engine_acceptance.py:28
↓ 2 callersFunction_package_argument
The value of a runner's package option (``--from``, ``--spec``), else its first positional argument.
src/skillevaluator/validators/mcp_static.py:2072
↓ 2 callersFunction_parametrized_strings
Return the strings in one argument value of a parametrized test.
tests/tier3/test_security_finding_evidence.py:4345
↓ 2 callersFunction_parse_checks
(value: str | None)
src/skillevaluator/tier1/commands.py:252
↓ 2 callersFunction_parse_environment_kwargs_cli
Parse and validate environment kwargs for CLI commands, raising Click BadParameter on errors.
src/skillevaluator/cli.py:3559
↓ 2 callersFunction_parse_host_address
Return ``(address, encoded)`` for an IP-literal host (``None`` for names).
src/skillevaluator/validators/mcp_static.py:2849
↓ 2 callersMethod_parse_issue_location
Extract (file_path, line_number) from a skillspector issue.
src/skillevaluator/validators/security.py:5731
↓ 2 callersFunction_parse_vertex_openapi_metadata
Extract project ID and location from a Vertex AI OpenAPI base URL.
src/skillevaluator/provider_config.py:384
↓ 2 callersFunction_parses_shell_operators
Whether the arguments of ``argv`` reach a command-line parser (``cmd /c``, ``powershell -Command``).
src/skillevaluator/validators/mcp_static.py:552
↓ 2 callersFunction_passwd_mount_issue
Return a benign-tagged SkillSpector PE3 row for scripts/build.sh line 1.
tests/validators/test_security.py:238
↓ 2 callersFunction_patch_input_body
Return the ``apply_patch`` body carried by an ``input`` argument, else ``""``. Only a value carrying patch markers is returned: a bare ``input``
src/skillevaluator/tier3/eval_core/atif_helpers.py:370
↓ 2 callersFunction_patch_written_paths
Files an apply_patch body writes: the ``Add File``, ``Update File`` and ``Move to`` headers. A file the patch only deletes is not written, and ne
src/skillevaluator/tier3/eval_core/plugin_signals.py:4361
↓ 2 callersFunction_patch_zip_flags
(path: Path, *, encrypted: bool = False, compression: int | None = None)
tests/test_oss_boundary.py:1351
↓ 2 callersFunction_path
(value: object)
src/skillevaluator/reporting/plugin_static.py:50
↓ 2 callersFunction_path_is_within
Check containment using both path text and existing filesystem aliases.
src/skillevaluator/cli.py:513
↓ 2 callersFunction_path_is_within
(path: Path, root: Path)
src/skillevaluator/tier3/harbor/collector.py:227
↓ 2 callersFunction_path_matches
``artifact`` is resolved; ``observed`` is raw and resolved against ``cwd``.
src/skillevaluator/tier3/eval_core/plugin_signals.py:4356
↓ 2 callersFunction_path_with_shell_cwd
(value: str, current_directory: str | None)
src/skillevaluator/tier3/eval_core/script_invocation.py:70
↓ 2 callersFunction_paths
(output: bytes)
ci/select_changed_skills.py:154
↓ 2 callersFunction_payload
(monkeypatch, run_dir, **kwargs)
tests/reporting/test_execution_backend_reporting.py:44
↓ 2 callersMethod_payload
(self)
src/skillevaluator/deduplication/plugin/catalog.py:287
↓ 2 callersFunction_persist_dataset_truth
Persist immutable dataset and evaluator identity before staging cleanup.
src/skillevaluator/tier3/harbor/runner.py:786
↓ 2 callersFunction_pick_best_agent
(agents: dict[str, dict[str, Any]], *, score_field: str = "with_skill")
src/skillevaluator/evaluation/tier3_report.py:4825
↓ 2 callersMethod_pieces
(self, hashes: Mapping[str, str])
src/skillevaluator/tier3/loose_parts.py:480
↓ 2 callersFunction_pii_finding
(value: str)
tests/ci/test_secret_redaction.py:362
↓ 2 callersFunction_pii_patterns
()
src/skillevaluator/tier3/trace_import.py:50
↓ 2 callersFunction_pii_waiver_run
Run a PII-scanning command on a copy of the fixture with one non-placeholder address in it.
tests/test_commands.py:1146
↓ 2 callersFunction_pill
(label: str, color: str, ink: str = INK)
src/skillevaluator/reporting/console_ui.py:253
↓ 2 callersFunction_pinned_category
Return a Unicode 15.1 category on every supported Python runtime.
src/skillevaluator/publication_text.py:314
↓ 2 callersMethod_plain_root
``value`` with a leading root default chain (``${CLAUDE_PLUGIN_ROOT:-${PLUGIN_ROOT}}/x``) written as its first placeholder (``${CLAUDE_PLUGIN_
src/skillevaluator/plugin_component_risk.py:3158
↓ 2 callersFunction_plain_text
(message: str)
ci/summary_metrics.py:23
↓ 2 callersMethod_plan_agents_text
(self, plan: Tier3RunPlan)
src/skillevaluator/tier3/harbor/progress.py:734
↓ 2 callersMethod_plan_values_text
(self, plan: Tier3RunPlan)
src/skillevaluator/tier3/harbor/progress.py:743
↓ 2 callersFunction_planted_trials
(summary: Mapping[str, Any])
src/skillevaluator/tier3/eval_core/runtime_evidence.py:388
↓ 2 callersFunction_plugin_names_from_wrappers
The plugin name behind a generated ``<plugin>-plugin-eval`` wrapper package name.
src/skillevaluator/tier3/eval_core/plugin_signals.py:1485
↓ 2 callersFunction_plugin_skills_root
Return ``<plugin_root>/<skills_dir>`` when it is a real directory; raise on a link. ``skills_dir`` is a plugin-root-relative POSIX path (``skills
src/skillevaluator/plugin_member_paths.py:67
↓ 2 callersFunction_plugin_tree_ignore
(source: NativePluginSource, excluded_roots: Sequence[Path] = ())
src/skillevaluator/tier3/harbor/native_staging.py:169
↓ 2 callersFunction_png_header
Return an IHDR chunk.
tests/validators/test_security.py:8860
↓ 2 callersFunction_policy_from_data
( data: dict[str, Any], *, fallback_profile: str, source: Path | None, )
src/skillevaluator/validators/policy.py:211
↓ 2 callersFunction_policy_metrics_from_agents
( agents: dict[str, dict[str, Any]], metrics: list[str], *, condition: str = "with_skill", )
src/skillevaluator/evaluation/tier3_report.py:1968
↓ 2 callersMethod_positionChanged
(t,e)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
← previousnext →4,201–4,300 of 24,741, ranked by callers