MCPcopy Create free account

hub / github.com/NVIDIA/SkillEvaluator / functions

Functions24,741 in github.com/NVIDIA/SkillEvaluator

↓ 2 callersFunction_copy_request_options
(source: dict[str, Any], destination: dict[str, Any], names: set[str])
src/skillevaluator/tier3/harbor/nvidia_build_bridge.py:1468
↓ 2 callersFunction_copy_skill_dirs
Stage target/workspace skills into a task environment.
src/skillevaluator/tier3/harbor/adapter.py:4452
↓ 2 callersFunction_copy_tool_strict
(source: dict[str, Any], destination: dict[str, Any])
src/skillevaluator/tier3/harbor/nvidia_build_bridge.py:1866
↓ 2 callersFunction_correctly_unused_negative
( run_dir: Path, agent_name: str, agent: Mapping[str, Any], case_id: str, entry: Mapping[s
src/skillevaluator/tier3/case_summary.py:1376
↓ 2 callersFunction_count
(value: object)
src/skillevaluator/skillspector_diagnostics.py:26
↓ 2 callersFunction_count
(value: Any)
src/skillevaluator/reporting/dashboard_data.py:80
↓ 2 callersMethod_count
(self, markers: tuple[str, ...])
tests/tier3/test_installed_agent_install_retry.py:70
↓ 2 callersFunction_counted_finding_total
(report: Mapping[str, object])
src/skillevaluator/validators/skillspector_scope.py:463
↓ 2 callersFunction_coverage_notice_messages
Return the Tier 3 coverage notice messages the Tier 3 block prints.
src/skillevaluator/reporting/cli.py:112
↓ 2 callersFunction_crash_attempt
Leave one attempt as an unrecovered agent crash instead of a scored trial.
tests/test_harbor_collector_runtime_failures.py:2339
↓ 2 callersMethod_createAnimations
(t,e)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 2 callersMethod_createDescriptors
(t,e)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 2 callersFunction_create_bridge_server
Validate configuration and bind a dynamic loopback listener.
src/skillevaluator/tier3/harbor/nvidia_build_bridge.py:834
↓ 2 callersMethod_create_environment
Return one shared environment, so each template compiles once per process. Compiling report.html.j2 costs far more than rendering it. The loa
src/skillevaluator/reporting/html.py:2253
↓ 2 callersFunction_create_staged_node
(parent_descriptor: int, *, prefix: str, kind: str)
src/skillevaluator/tier3/harbor/secure_copy.py:744
↓ 2 callersFunction_credential
()
tests/test_plugin_discovery.py:561
↓ 2 callersFunction_criteria
(passed: int)
tests/test_accuracy_arithmetic.py:25
↓ 2 callersFunction_custom_backend_entry_points
Return installed custom backend entry points by mode name, without importing them.
src/skillevaluator/tier3_environments.py:345
↓ 2 callersFunction_custom_metric_name_contains_sensitive_data
(name: str)
src/skillevaluator/tier3/harbor/metrics.py:215
↓ 2 callersFunction_custom_metric_name_shape_is_valid
(name: str)
src/skillevaluator/tier3/harbor/metrics.py:198
↓ 2 callersFunction_custom_metric_score
(metric: str, configured: dict[str, Any], rewards: list[dict[str, Any]])
src/skillevaluator/evaluation/tier3_report.py:3166
↓ 2 callersFunction_custom_user_copies
( tmp_path: Path, monkeypatch: pytest.MonkeyPatch, grouping: str, config: dict | None = None )
tests/harness/test_overlay.py:549
↓ 2 callersFunction_dangling_symlink
(link: Path)
tests/test_artifact_applicability.py:210
↓ 2 callersMethod_dataCheck
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 2 callersFunction_dataset_generation_provenance
(skill_path: Path)
src/skillevaluator/tier3/harbor/runner.py:805
↓ 2 callersFunction_dataset_result
(entries: list[dict[str, Any]], diagnostics: list[dict[str, Any]])
src/skillevaluator/tier3/harbor/report_data.py:293
↓ 2 callersFunction_dataset_summary
(ae: dict[str, Any] | None)
src/skillevaluator/reporting/benchmark.py:1674
↓ 2 callersFunction_dataset_summary
Build a stable unique-task count and activation-intent summary.
src/skillevaluator/evaluation/tier3_report.py:5070
↓ 2 callersFunction_decision
(cases, thresholds, policy, report=None)
src/skillevaluator/tier3/grader_policy.py:110
↓ 2 callersFunction_declared_case_ids
(item: dict)
src/skillevaluator/evaluation/insights_judge.py:458
↓ 2 callersFunction_declared_keys
``(type, name) -> harness name`` for every declared component.
src/skillevaluator/tier3/plugin_native.py:2485
↓ 2 callersMethod_declared_pin
Return the declaration of a scanned package version, matching PEP 503 names.
src/skillevaluator/validators/dependencies.py:942
↓ 2 callersFunction_decode_bounded_json
( raw: bytes, diagnostics: list[dict[str, Any]], *, artifact: str, strict_syntax: bool = F
src/skillevaluator/tier3/harbor/report_data.py:432
↓ 2 callersFunction_decode_js_string_literal
Decode one plain single- or double-quoted string that uses JSON escapes only. Returns ``(value, end)``, or None when ``start`` does not open such
src/skillevaluator/tier3/eval_core/codex_tool_call_normalizer.py:187
↓ 2 callersFunction_decode_text
(data: bytes, *, path: str)
scripts/check_oss_boundary.py:807
↓ 2 callersFunction_decoded_escapes
``text`` with JSON ``\\uXXXX`` and shell ``\\xXX`` escapes decoded, so an escaped 'allow' still reads.
src/skillevaluator/plugin_component_risk.py:1865
↓ 2 callersFunction_decoded_texts
``text`` plus the string values of any JSON in it, recursively (MCP results are JSON in text).
src/skillevaluator/tier3/eval_core/plugin_signals.py:4480
↓ 2 callersFunction_dedupe_evidence_refs
(refs: list[dict[str, Any]])
src/skillevaluator/tier3/eval_core/atif_helpers.py:644
↓ 2 callersFunction_dedupe_report_reasons
(reasons: list[Any])
src/skillevaluator/tier3/harbor/report.py:451
↓ 2 callersMethod_deduplicate_findings
Aggregate duplicate findings that share the same message, file, and suggestion. Groups findings by (message, file_path, suggestion) and merge
src/skillevaluator/reporting/html.py:2600
↓ 2 callersMethod_deduplicate_skillspector_issues_for_scoring
Mirror scanner dedup using serialized source and match identities.
src/skillevaluator/validators/security.py:4920
↓ 2 callersFunction_default_branch_candidate
(env: Mapping[str, str])
ci/eligible_gitlab.py:43
↓ 2 callersFunction_default_with_skill_overall
(data: Mapping[str, Any])
src/skillevaluator/tier3/result_display.py:244
↓ 2 callersFunction_definition_table
(rows: list[tuple[str, str]], *, key_style: str)
src/skillevaluator/cli_help.py:171
↓ 2 callersMethod_delete_unisolated_pod_best_effort
Delete the evaluation pod on metadata isolation verification failure.
src/skillevaluator/tier3/harbor/gke_environment.py:957
↓ 2 callersFunction_delta
Return with skill minus baseline total tokens, or why there is none. ``blockers`` are ``(code, sentence)`` pairs found by the caller, such as a
src/skillevaluator/tier3/token_usage.py:420
↓ 2 callersFunction_describe
Type and size of an agent argument value: failure details never echo the value itself. Redaction cannot recognize every credential shape (URL use
src/skillevaluator/tier3/eval_core/plugin_signals.py:3866
↓ 2 callersFunction_description_words
Letters and digits in any script, lowercased, split on everything else, minus common English words.
src/skillevaluator/harness/overlay.py:572
↓ 2 callersFunction_detail_for_finding
Return one metric's detail without copying an untrusted details map.
src/skillevaluator/tier3/harbor/report.py:238
↓ 2 callersFunction_detail_list
(detail: dict[str, Any], key: str)
src/skillevaluator/evaluation/tier3_findings.py:151
↓ 2 callersMethod_determine_severity
Determine severity from rule ID and tags.
src/skillevaluator/validators/secrets.py:256
↓ 2 callersFunction_deterministic_reasoning
Build deterministic reasoning bullets for a dimension (SkillEvaluator parity). Reuses the ported dimension-judge helper so the Reasoning column r
src/skillevaluator/evaluation/tier3_report.py:2870
↓ 2 callersFunction_deterministic_verdict
Deterministic PASS/NEUTRAL/FAIL verdict for a dimension score.
src/skillevaluator/evaluation/tier3_report.py:2914
↓ 2 callersFunction_diagnose_agent_case
( run_dir: Path, agent_name: str, agent: Mapping[str, Any], case_id: str, *, entry: Ma
src/skillevaluator/tier3/case_summary.py:1051
↓ 2 callersFunction_dimension_signals
Return the evaluator signals that feed a dimension (Signals column). Prefers the engine's precomputed ``sources`` (the evaluators that actually
src/skillevaluator/evaluation/tier3_report.py:2853
↓ 2 callersFunction_direct_published_trial_label
Return a safe trial label verbatim, or ``None`` when it needs an alias.
src/skillevaluator/tier3/harbor/collector.py:359
↓ 2 callersFunction_directory_entries
Bound directory enumeration before sorting or allocating the full tree.
src/skillevaluator/reporting/dashboard_data.py:800
↓ 2 callersFunction_display
(value: object)
src/skillevaluator/reporting/plugin_static_render.py:19
↓ 2 callersFunction_display
(value: Any)
src/skillevaluator/tier3/history.py:364
↓ 2 callersFunction_display
(root: Path, parts: tuple[str, ...])
src/skillevaluator/tier3/harbor/secure_copy.py:279
↓ 2 callersFunction_display_label_for_harbor_evidence
(evidence: dict[str, Any])
src/skillevaluator/evaluation/tier3_report.py:4103
↓ 2 callersFunction_distinct_text
(length: int)
tests/tier3/test_evidence_compiler.py:523
↓ 2 callersFunction_doc_block
Return the one blank-line separated block of ``name`` that starts with ``lead``, whitespace-normalized.
tests/reporting/test_tier3_incomplete_arms.py:151
↓ 2 callersFunction_doc_block
Return the one blank-line separated block of ``name`` that starts with ``lead``, whitespace-normalized.
tests/tier3/test_baseline_timeouts.py:58
↓ 2 callersFunction_docker_setup_note
The eval-datasets note on Docker agent setup packages, with whitespace collapsed.
tests/tier3/test_installed_agent_bootstrap.py:465
↓ 2 callersFunction_docker_setup_note_paragraphs
The paragraphs of the eval-datasets note on Docker agent setup packages, whitespace collapsed.
tests/tier3/test_installed_agent_bootstrap.py:456
↓ 2 callersFunction_dockerfile_copy_or_add_mentions_skill
(line: str, target_skill_name: str)
src/skillevaluator/tier3/harbor/adapter.py:5719
↓ 2 callersFunction_dockerfile_instruction_sources
Return build-context sources for one COPY/ADD instruction.
src/skillevaluator/tier3/harbor/adapter.py:2676
↓ 2 callersFunction_dockerfile_mount_context_sources
Return BuildKit RUN-mount contexts and their source paths.
src/skillevaluator/tier3/harbor/adapter.py:3123
↓ 2 callersFunction_dockerfile_resolved_build_context_sources
Resolve COPY/ADD sources using ARG/ENV values visible at each instruction.
src/skillevaluator/tier3/harbor/adapter.py:2833
↓ 2 callersFunction_documented_amounts
(cell: str)
tests/test_metrics_reference_docs.py:480
↓ 2 callersMethod_download_local_directory
Keep Harbor's directory-transfer scratch files within the local run.
src/skillevaluator/tier3/harbor/local_environment.py:909
↓ 2 callersFunction_download_verified
(url: str, sha256: str, name: str)
src/skillevaluator/utils/scanner_install.py:61
↓ 2 callersMethod_drain
(self, *, final: bool)
src/skillevaluator/tier3/harbor/stream_redaction.py:183
↓ 2 callersFunction_dump
(path: Path, data)
ci/publish_reports.py:450
↓ 2 callersFunction_duplicate_frontmatter_keys
Return ``(dotted_key, line)`` for every repeated mapping key (PyYAML keeps the last silently).
src/skillevaluator/validators/schema.py:195
↓ 2 callersFunction_e
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 2 callersMethod_easier_follows
(self, index: int)
src/skillevaluator/evaluation/dataset_case_removal.py:468
↓ 2 callersFunction_edit_reward
(config, change)
tests/tier3/test_interactions.py:177
↓ 2 callersFunction_effective_report_formats
Resolve the report formats ``validate`` will actually emit.
src/skillevaluator/cli.py:709
↓ 2 callersFunction_effective_resamples
( n_cases: int, resamples: int = LIFT_BOOTSTRAP_RESAMPLES, confidence: float = LIFT_BOOTSTRAP_CONFIDENCE )
src/skillevaluator/tier3/harbor/stats.py:656
↓ 2 callersFunction_eligible
( run_dir: Path, identity: dict[str, Any], *, collected_result: dict[str, Any] | None = None,
src/skillevaluator/tier3/version_comparison.py:55
↓ 2 callersFunction_embedded_tier3
Return the full Tier 3 payload the HTML report embeds for download.
tests/reporting/test_tier3_completed_agent_docs.py:54
↓ 2 callersMethod_emit
(self, text: str, stream: OutputStream)
src/skillevaluator/tier3/harbor/local_environment.py:203
↓ 2 callersFunction_enclosing_skill_root
(file_path: str)
src/skillevaluator/validators/skillspector_scope.py:1066
↓ 2 callersFunction_engine_env_mode
(value: str)
src/skillevaluator/tier3/commands.py:101
↓ 2 callersFunction_ensure_default_exec_container_routing
Ensure untargeted connect_get_namespaced_pod_exec calls default to the main task container.
src/skillevaluator/tier3/harbor/gke_environment.py:314
↓ 2 callersFunction_ensure_empty_compose_input_compatibility
Apply explicit-empty input compatibility to every validated Compose build.
src/skillevaluator/tier3/harbor/adapter.py:3180
↓ 2 callersFunction_ensure_empty_docker_input_compatibility
Keep directory-level ``COPY input/`` valid for one Docker build context.
src/skillevaluator/tier3/harbor/adapter.py:3019
↓ 2 callersFunction_ensure_project_imports
Add src/ to sys.path so skillevaluator.tier3.* imports work when run as a standalone script.
src/skillevaluator/tier3/generate_dataset.py:987
↓ 2 callersFunction_ensure_starter_evals_json
(evals_dir: Path, skill_path: Path, case_id: str)
src/skillevaluator/tier3/commands.py:119
↓ 2 callersFunction_ensure_verifier_deps
Append verifier deps and runtime COPY lines to a custom Dockerfile.
src/skillevaluator/tier3/harbor/adapter.py:4008
↓ 2 callersFunction_entries
(wrapper)
tests/tier3/test_plugin_dataset.py:39
↓ 2 callersMethod_entry_fingerprint
Fingerprint *entry* the way this registry's mode records catalog entries.
src/skillevaluator/embedding/registry.py:513
↓ 2 callersFunction_entry_id
(trial: Mapping[str, Any])
src/skillevaluator/reporting/trial_charts.py:31
↓ 2 callersFunction_env_mode_host_env_vars
Return the backend host variables forwarded to Harbor for ``env_mode``.
src/skillevaluator/tier3/harbor/runner.py:1407
↓ 2 callersFunction_environment
(environ: Mapping[str, str] | None)
src/skillevaluator/provider_config.py:676
↓ 2 callersFunction_environment_note
(environment: str | None)
src/skillevaluator/reporting/benchmark.py:1651
↓ 2 callersFunction_environment_reference_names
Return portable shell-style environment references from a TOML value.
src/skillevaluator/tier3/harbor/adapter.py:5037
↓ 2 callersMethod_escaped_code
Code point of a character escape; backreferences and flag-dependent escapes fail closed.
src/skillevaluator/plugin_component_risk.py:1368
← previousnext →3,801–3,900 of 24,741, ranked by callers