MCPcopy Create free account

hub / github.com/NVIDIA/SkillEvaluator / functions

Functions24,741 in github.com/NVIDIA/SkillEvaluator

↓ 5 callersFunctionwrite_tree
(root: Path, files: dict)
tests/test_plugin_member_paths.py:23
↓ 5 callersFunctionx
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:7
↓ 5 callersFunctionyt
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 4 callersFunction$i
(t,e,i,s,n)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 4 callersFunctionAe
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 4 callersFunctionCa
(t,e)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 4 callersFunctionIa
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 4 callersFunctionIe
(t,e)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 4 callersFunctionJ
(t,e,i,s)
src/skillevaluator/reporting/assets/chart.umd.min.js:7
↓ 4 callersFunctionJs
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 4 callersFunctionMt
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 4 callersFunctionN
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:7
↓ 4 callersFunctionOa
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 4 callersFunctionXt
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 4 callersMethod__init__
(self, renderable, **kwargs)
tests/test_tier3_progress.py:43
↓ 4 callersFunction_absolute_host_path
Anchor a relative host path to the operator's working directory.
src/skillevaluator/tier3/harbor/runner.py:1530
↓ 4 callersFunction_add_finding
(result: ValidationResult, severity: Severity, message: str)
tests/reporting/test_quality_gate_reports.py:23
↓ 4 callersFunction_agent
(*, baseline: bool = True, judge_with: str = "primary")
tests/reporting/test_tier3_unavailable_lift_labels.py:25
↓ 4 callersFunction_agent
(*, activated: bool | None, score: float = 0.4, baseline: bool = True)
tests/reporting/test_activation_benchmark_html_regressions.py:21
↓ 4 callersFunction_agent_eval_attempt_coverage_complete
Return whether succeeded Tier 3 evidence proves positive attempt coverage.
src/skillevaluator/reporting/base.py:1008
↓ 4 callersFunction_agent_eval_carrier
A complete agent-eval payload naming one repository in both of its carriers.
tests/test_benchmark_source_provenance.py:1360
↓ 4 callersFunction_agent_eval_result
(payload: dict[str, object])
tests/test_benchmark_source_provenance.py:1370
↓ 4 callersFunction_aggregate_tier1_source
Run the aggregate's Tier 1 selection with a stubbed pinned-tools decision.
tests/ci/test_gateway_benchmark_workflows.py:216
↓ 4 callersFunction_anthropic_truncated_fallback_response
Return a reply cut off at the token limit, written by the server-side fallback model.
tests/inference/test_llm_client.py:1487
↓ 4 callersFunction_append_task_input_projection
Append the final evaluator-owned replacement of ``/workspace/input``.
src/skillevaluator/tier3/harbor/adapter.py:3884
↓ 4 callersFunction_append_unique
(paths: list[Path], candidate: Path)
src/skillevaluator/tier3/harbor/local_runtime.py:219
↓ 4 callersFunction_artifact_uri
Build a terminal-only URI without changing canonical URL normalization.
src/skillevaluator/reporting/terminal_styles.py:33
↓ 4 callersFunction_as_json_text
Return the tool call that runs *command* as JSON text, once (saved judge evidence) or as JSON repeated as JSON.
tests/tier3/test_security_finding_evidence.py:3593
↓ 4 callersFunction_assert_gate_accepts
(markdown: str, tmp_path: Path)
tests/reporting/test_dimension_explanations.py:99
↓ 4 callersFunction_assert_mode_preserved
(source: Path, destination: Path)
tests/test_harbor_secure_copy.py:41
↓ 4 callersFunction_assert_resolved
(argv_path: str, relative_path: Path)
tests/validators/test_scanner_path_resolution.py:55
↓ 4 callersFunction_assert_safe_generated_output_path
Reject cleanup targets that can escape the configured results directory.
src/skillevaluator/tier3/harbor/collector.py:235
↓ 4 callersFunction_audit
(package)
tests/tier3/test_openclaw_prepare.py:52
↓ 4 callersFunction_average_pool
Average-pool a list of vectors into a single vector.
src/skillevaluator/embedding/client.py:404
↓ 4 callersFunction_await_task_uninterruptibly
Await cleanup work to completion even if cancellation is repeated.
src/skillevaluator/tier3/harbor/local_agents.py:64
↓ 4 callersMethod_base_bundle
(self)
src/skillevaluator/tier3/plugin_native.py:1087
↓ 4 callersFunction_bedrock_client
(monkeypatch, outcomes)
tests/tier3/test_judge_policies.py:464
↓ 4 callersFunction_behavior_check_budget
Return the behavior check evidence budget. A usable ``SKILL_EVAL_BEHAVIOR_CHECK_BUDGET`` is honoured exactly as set. Operators pin it to cap
src/skillevaluator/tier3/eval_core/atif_helpers.py:260
↓ 4 callersFunction_benchmark_line
(results: list[ValidationResult], field: str = "Quality config")
tests/reporting/test_quality_config_reporting.py:23
↓ 4 callersFunction_bind
Bind ``name``, unless it is read-only, when the assignment fails.
src/skillevaluator/tier3/eval_core/script_invocation.py:912
↓ 4 callersFunction_blocking_section
(output: str)
tests/reporting/test_quality_gate_reports.py:35
↓ 4 callersFunction_bound_tier2_result
(skill: Path)
tests/test_publication_evidence.py:321
↓ 4 callersFunction_bounded_cleanup_timeout
( maximum: float, *, allow_expired_reap: bool = False, )
src/skillevaluator/tier3/harbor/secure_docker_environment.py:718
↓ 4 callersFunction_bounded_text
(value: Any)
src/skillevaluator/tier3/plugin_native.py:2377
↓ 4 callersFunction_broken_skill
A folder that is meant to be an artifact but whose manifest the checks cannot read.
tests/test_artifact_applicability.py:74
↓ 4 callersMethod_call
(self, method, path, payload=None, *, binary=False)
ci/feedback.py:592
↓ 4 callersMethod_callHooks
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 4 callersFunction_can_preserve_partial_rewards
Return whether every aggregate job error maps to a concrete failed trial.
src/skillevaluator/tier3/harbor/collector.py:1185
↓ 4 callersFunction_canary_short_flag
A short option cluster in ``args`` (``-rf``) holds one of ``letters``.
src/skillevaluator/tier3/eval_core/plugin_security.py:1296
↓ 4 callersFunction_canary_tokens
Shell words and operators of ``text`` (best effort, never raises). Quotes and escapes are removed; a quoted word made only of operator charac
src/skillevaluator/tier3/eval_core/plugin_security.py:794
↓ 4 callersFunction_canonical_trajectory_sha256
(trajectory: dict[str, Any])
src/skillevaluator/tier3/harbor/collector.py:2145
↓ 4 callersFunction_case_routing
Mirror the runtime grader's routing precedence for prompt metadata.
src/skillevaluator/evaluation/insights_judge.py:227
↓ 4 callersFunction_casefold_contained
Return whether *candidate* is lexically below *root*, ignoring path casing.
src/skillevaluator/tier3/harbor/adapter.py:524
↓ 4 callersFunction_cases
(info: dict[str, Any])
src/skillevaluator/evaluation/tier3_report.py:3434
↓ 4 callersFunction_catalog_child_argv_from_ctx
Rebuild ``validate`` argv from the active Click context (pytest-safe).
src/skillevaluator/cli.py:1399
↓ 4 callersFunction_census
(*types: str)
tests/tier3/test_native_review_fixes.py:97
↓ 4 callersFunction_census
(loaded: list[str], not_loaded: dict[str, str])
tests/tier3/test_f90_mcp_proof_status.py:28
↓ 4 callersFunction_chat_tool_alias
Fit a tool name into Build's 64 characters: a prefix plus a digest, stable across replayed turns.
src/skillevaluator/tier3/harbor/nvidia_build_bridge.py:1769
↓ 4 callersMethod_check_test_presence
Discover conventional Python test filenames without reading or executing them.
src/skillevaluator/validators/hygiene.py:203
↓ 4 callersFunction_check_unknown_fields
MEDIUM for each top-level field the format does not define (``ignored`` fields are skipped silently).
src/skillevaluator/plugin_format_schema.py:165
↓ 4 callersFunction_claude_plugin
(root: Path)
tests/test_plugin_manifest.py:27
↓ 4 callersMethod_clean_schema_result
A single-skill schema result with no finding, as a clean skill gives.
tests/reporting/test_reporters.py:539
↓ 4 callersFunction_client
(monkeypatch, endpoint, provider="bedrock")
tests/test_retry_provider_transport.py:150
↓ 4 callersFunction_client_endpoint_fingerprint
Return a credential-free identity for the configured embedding endpoint.
src/skillevaluator/embedding/registry.py:760
↓ 4 callersFunction_collect_fail_reasons
Extract human-readable failure reasons from trial details.
src/skillevaluator/tier3/harbor/report.py:475
↓ 4 callersFunction_collected_setup_failure
(tmp_path, *, baseline_exception="AgentSetupNetworkError")
tests/test_private_runtime_review.py:119
↓ 4 callersFunction_command_start
Index of the word that is the command, past reserved words and assignments. ``then FOO=1 ./run.py`` runs ``./run.py``: the reserved word introduc
src/skillevaluator/tier3/eval_core/script_invocation.py:2051
↓ 4 callersMethod_command_text
( self, component: PluginMember, rel: PurePosixPath, _description: str, entry: dict[str, Any] )
src/skillevaluator/plugin_discovery.py:1341
↓ 4 callersFunction_compact_evidence_ref
Return the stable compact key for one evidence reference.
src/skillevaluator/tier3/harbor/report.py:639
↓ 4 callersFunction_compacted_issue
Return an issue whose identical matches in several files share one record.
tests/validators/test_skillspector_scope.py:123
↓ 4 callersMethod_compose_model_metadata
Inspect Compose interpolation and service keys with one hardened walk. Compose's own ``config --no-interpolate`` rejects valid unresolved
src/skillevaluator/tier3/harbor/secure_docker_environment.py:2050
↓ 4 callersFunction_compose_network_failure
Shape a secure Compose failure: the long command line comes before Docker's own error.
tests/test_harbor_collector_runtime_failures.py:2778
↓ 4 callersMethod_computeTitleHeight
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 4 callersFunction_configure_native_task_source
( monkeypatch: pytest.MonkeyPatch, runner, skill: Path, *, grading_mode: str = "default",
tests/test_tier3_progress.py:3207
↓ 4 callersFunction_contained_path
Return ``(normalized relative path, escapes)`` for a path below some base directory.
src/skillevaluator/plugin_component_risk.py:1737
↓ 4 callersFunction_count
(value: object)
src/skillevaluator/reporting/tier3_token_usage.py:85
↓ 4 callersFunction_count
Return ``value`` when it is a real integer (never bool) at or above ``minimum``.
src/skillevaluator/tier3/harbor/baseline_timeouts.py:82
↓ 4 callersFunction_count_comparison
(info: dict[str, Any], key: str, *, numerator: str)
src/skillevaluator/evaluation/tier3_report.py:3480
↓ 4 callersFunction_count_messages
Result messages with the count line, which reporters would list as passed checks.
tests/validators/test_skillspector_reference_diagnostics.py:79
↓ 4 callersFunction_coverage_section
(benchmark: str)
tests/reporting/test_tier3_incomplete_arms.py:126
↓ 4 callersFunction_create_windows_junction
(link: Path, target: Path)
tests/test_issue55_collector_truth.py:4141
↓ 4 callersMethod_credited
(command: str)
tests/tier3/test_plugin_signals.py:391
↓ 4 callersFunction_critical_types
(result: dict[str, Any])
tests/tier3/test_security_home_paths.py:569
↓ 4 callersFunction_custom_compose_path
(environment_dir: Path)
src/skillevaluator/tier3/harbor/adapter.py:3554
↓ 4 callersFunction_default_key_path
()
src/skillevaluator/tier3/output_provenance.py:332
↓ 4 callersMethod_destroyDatasetMeta
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 4 callersFunction_dimension_table
(html: str)
tests/reporting/test_dimension_explanations.py:75
↓ 4 callersFunction_dimensions
(baseline: float, with_skill: float, overrides: dict[str, float] | None = None)
tests/reporting/test_verdict_evidence.py:31
↓ 4 callersFunction_directory_alias
(root: Path, relative: str, target: str)
tests/utils/test_tier2_paths.py:16
↓ 4 callersFunction_directory_prefix_path_variants
(file_path: str)
src/skillevaluator/validators/skillspector_scope.py:768
↓ 4 callersMethod_disable
(self)
src/skillevaluator/tier3/harbor/progress.py:1003
↓ 4 callersFunction_docker_expression_has_literal_dollar
Return whether Docker keeps a dollar literal that shlex would erase.
src/skillevaluator/tier3/harbor/adapter.py:2806
↓ 4 callersFunction_dockerfile_logical_lines
(path: Path)
src/skillevaluator/tier3/harbor/adapter.py:2605
↓ 4 callersMethod_elapsed
(self)
src/skillevaluator/tier3/harbor/progress.py:357
↓ 4 callersFunction_enable_private
(monkeypatch, tmp_path, info, pages, *, history=False, readback=None, deployments=None)
tests/test_ci_onboarding_pages.py:276
↓ 4 callersFunction_ensure_autopilot_dataset
Ensure an evaluation source exists, generating one when missing. Mirrors the standalone ``evaluate --autopilot`` behavior: reuse an existing
src/skillevaluator/cli.py:1178
↓ 4 callersFunction_entry
(parts: tuple[str, ...], kind: str, metadata: os.stat_result, digest: str | None = None)
src/skillevaluator/publication_identity.py:282
↓ 4 callersFunction_env_positive_int
Parse a positive integer from environment variable *name* or return *default*.
src/skillevaluator/tier3/eval_core/atif_helpers.py:230
↓ 4 callersFunction_environment_extra_install_hint
(env_mode: str)
src/skillevaluator/tier3/harbor/runner.py:2412
↓ 4 callersFunction_evidence
( root: Path, values: dict[str, list[float]], *, n_attempts: int = 1, condition: str = "wi
tests/tier3/test_interactions.py:51
← previousnext →2,001–2,100 of 24,741, ranked by callers