MCPcopy Create free account

hub / github.com/NVIDIA/SkillEvaluator / functions

Functions24,741 in github.com/NVIDIA/SkillEvaluator

↓ 2 callersFunction_relative
(root, value)
src/skillevaluator/tier3/grader_validation.py:78
↓ 2 callersFunction_remap_parent_subagent_scope
Give one parent's embedded IDs a deterministic combined-parent scope.
src/skillevaluator/tier3/harbor/collector.py:2247
↓ 2 callersMethod_remember_artifacts
( self, *, output_dir: str | None, result_path: str | None, report_pat
src/skillevaluator/tier3/harbor/runner.py:5426
↓ 2 callersMethod_remote_approval
(site: _HookSite, decider: str)
src/skillevaluator/plugin_component_risk.py:3766
↓ 2 callersFunction_remove_empty_output_tree_fallback
Conservatively remove an empty exact reservation without recursive deletion.
src/skillevaluator/tier3/output_provenance.py:699
↓ 2 callersFunction_remove_generated_output_path
Remove one known generated path without following a target symlink.
src/skillevaluator/tier3/harbor/collector.py:259
↓ 2 callersMethod_remove_handoff
(self, remote_path: str)
src/skillevaluator/tier3/harbor/secure_docker_environment.py:3449
↓ 2 callersFunction_remove_output_tree_at_identity
Remove only one no-follow tree matching a previously observed identity.
src/skillevaluator/tier3/output_provenance.py:681
↓ 2 callersFunction_rename_no_replace
( source_name: str, destination_name: str, *, source_parent: int, destination_parent: int,
src/skillevaluator/tier3/harbor/secure_copy.py:1333
↓ 2 callersFunction_renames_skill_md
(description: str)
tests/tier3/test_dataset_baseline_fairness.py:1065
↓ 2 callersFunction_render_agent_scores
( *, console: Console, result: Mapping[str, Any], agent: str, data: Mapping[str, Any],
src/skillevaluator/tier3/result_display.py:692
↓ 2 callersMethod_render_all_results
Render all results with summary table and failure details.
src/skillevaluator/reporting/cli.py:196
↓ 2 callersMethod_render_failure
Render failure details with findings table and expandable details.
src/skillevaluator/reporting/markdown.py:617
↓ 2 callersMethod_render_findings
Render a shared findings table for blocking and non-blocking results.
src/skillevaluator/reporting/markdown.py:638
↓ 2 callersMethod_render_result
Render a single validation result.
src/skillevaluator/reporting/markdown.py:551
↓ 2 callersMethod_render_results_at_a_glance
( lines: list[str], ae: dict[str, Any] | None, private_labels: tuple[str, ...], )
src/skillevaluator/reporting/benchmark.py:573
↓ 2 callersFunction_render_validate_line
(payload: dict)
tests/reporting/test_dataset_generation_provenance.py:68
↓ 2 callersFunction_rendered_inline_fragment
Return visible inline text while keeping code-span contents literal.
scripts/ci/check_public_benchmarks.py:1471
↓ 2 callersFunction_rendered_inline_surfaces
Return visible text and decoded link/HTML attribute surfaces.
scripts/ci/check_public_benchmarks.py:1447
↓ 2 callersFunction_replace_semantic_tokens
Replace match-only normalized tokens with one linear source reconstruction.
src/skillevaluator/reporting/benchmark.py:2315
↓ 2 callersFunction_replace_with_minimal_payload
Last-resort bounded shape for pathological single-field payloads.
src/skillevaluator/evaluation/tier3_report.py:1859
↓ 2 callersFunction_replaces
Whether ``declaration`` replaces an earlier same-name ``previous`` in Claude Code's merge. Claude Code checks each server of a config file (``.mc
src/skillevaluator/plugin_mcp.py:158
↓ 2 callersFunction_repo_context_ignore_file
( path: Path, root: Path, authenticated_output_roots: set[Path] | None = None, )
src/skillevaluator/tier3/harbor/adapter.py:1169
↓ 2 callersFunction_report_path
Accept only canonical relative paths through regular retained directories.
ci/benchmark_reports.py:33
↓ 2 callersMethod_report_skillspector_baseline
Record whether the requested baseline applied, so an inert one is not silent. The diagnostic is added after SkillSpector returns, outside its
src/skillevaluator/validators/security.py:5563
↓ 2 callersFunction_request_deadline
(request: Request)
src/skillevaluator/model_catalog.py:295
↓ 2 callersFunction_request_json
( url: str, *, headers: Mapping[str, str], timeout_seconds: float, max_response_bytes: int
src/skillevaluator/model_catalog.py:622
↓ 2 callersFunction_request_settings
(config: ProviderConfig)
src/skillevaluator/model_catalog.py:523
↓ 2 callersFunction_request_timeouts
(requests: list[httpx.Request])
tests/test_doctor.py:330
↓ 2 callersFunction_require
(condition: bool, detail: str)
src/skillevaluator/reporting/plugin_evidence.py:46
↓ 2 callersFunction_require_cli_version
Fail before the agent starts when the installed ``cli`` is too old for ``model``.
src/skillevaluator/tier3/harbor/local_agents.py:134
↓ 2 callersFunction_require_model
(request: dict[str, Any])
src/skillevaluator/tier3/harbor/nvidia_build_bridge.py:1455
↓ 2 callersFunction_require_output_token_limit
(value: Any, field_name: str, maximum: int)
src/skillevaluator/tier3/harbor/nvidia_build_bridge.py:1462
↓ 2 callersFunction_require_regular_file
Reject linked or special authored files before a parser can open them.
src/skillevaluator/tier3/workflow.py:19
↓ 2 callersFunction_require_string_mapping_keys
(value: dict[object, object], *, field: str)
src/skillevaluator/tier3/harbor/adapter.py:3355
↓ 2 callersMethod_require_success
(result: object, operation: str)
src/skillevaluator/tier3/harbor/local_agents.py:720
↓ 2 callersFunction_required
(environ: Mapping[str, str], variable: str)
src/skillevaluator/provider_config.py:680
↓ 2 callersFunction_requirement_text
(value: Any)
src/skillevaluator/evaluation/tier3_expectations.py:33
↓ 2 callersFunction_reserve
(footer: str)
ci/report_views.py:251
↓ 2 callersMethod_reset_attempt
(self)
src/skillevaluator/tier3/plugin_evidence.py:298
↓ 2 callersMethod_reset_candidate
(self)
src/skillevaluator/tier3/harbor/stream_redaction.py:374
↓ 2 callersMethod_resolveAnimations
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 2 callersMethod_resolveElementOptions
(t,e="default",i)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 2 callersFunction_resolve_artifact_path
Resolve a validator file path against the scanned skill directory.
src/skillevaluator/reporting/sarif_reporter.py:93
↓ 2 callersMethod_resolve_declared
Normalize + classify one declared path and record its findings: ``(path, kind or problem)``. The second value is the path's kind when it is o
src/skillevaluator/plugin_discovery.py:322
↓ 2 callersFunction_resolve_eval_retry_config
Resolve retry and backoff limits from environment variables with safe defaults.
src/skillevaluator/tier3/harbor/templates/eval.py:1760
↓ 2 callersFunction_resolve_evidence_ref
Resolve a single evidence ref to a dict. If ``ref`` is already a dict, return it unchanged. If ``ref`` is a string of the form ``"source#jso
src/skillevaluator/tier3/harbor/report.py:786
↓ 2 callersFunction_resolve_harbor_price_file
( price_file: Path | None, harbor_config: Mapping[str, Any], source_skill_dir: Path )
src/skillevaluator/tier3/harbor/runner.py:4805
↓ 2 callersFunction_resolve_judge_wall_time_budget
Resolve the per-judge wall-time budget in seconds from the environment.
src/skillevaluator/tier3/harbor/templates/eval.py:1708
↓ 2 callersFunction_resolve_lookups
Resolve substitutions with the ``choice``-th name each lists; also return the most any listed.
src/skillevaluator/tier3/eval_core/checks.py:2093
↓ 2 callersMethod_resolve_managed
(self)
src/skillevaluator/utils/tool_runner.py:241
↓ 2 callersFunction_resolve_report_output_location
Keep report writes outside the source tree whose identity they describe.
src/skillevaluator/cli.py:559
↓ 2 callersFunction_resolve_subagent_trajectory_refs
( trajectory: dict[str, Any], *, agent_dir: Path, state: _TrajectoryReferenceState, depth:
src/skillevaluator/tier3/harbor/collector.py:2560
↓ 2 callersMethod_resolve_task_path
Resolve the task directory path from trial config.json.
src/skillevaluator/tier3/harbor/local_agents.py:278
↓ 2 callersFunction_resolve_verifier_retry_tuple
Resolve Harbor task.toml [verifier.env] placeholders against run_env and evaluate eval.py retry config.
tests/test_harbor_task_toml_retry_env.py:129
↓ 2 callersFunction_resolve_workflow_environment_kwargs
Parse CLI environment kwargs and resolve effective backend kwargs.
src/skillevaluator/tier3/workflow.py:93
↓ 2 callersMethod_resolved_config
(self)
tests/deduplication/plugin/test_private_dedup.py:405
↓ 2 callersMethod_resolved_inside_skill
Return *path* resolved only if it is a file inside *skill_root*.
src/skillevaluator/inference/finding_verifier.py:145
↓ 2 callersMethod_respond
(self)
tests/test_harbor_runtime_preflight.py:1862
↓ 2 callersFunction_responses_to_chat_request
( payload: Any, *, max_output_tokens: int = MAX_OUTPUT_TOKENS_PER_REQUEST, )
src/skillevaluator/tier3/harbor/nvidia_build_bridge.py:1096
↓ 2 callersFunction_responses_tool_to_chat
(tool: Any)
src/skillevaluator/tier3/harbor/nvidia_build_bridge.py:1661
↓ 2 callersFunction_responsive_conditions
Stack complete labeled score/bar groups when paired columns do not fit.
src/skillevaluator/tier3/result_display.py:557
↓ 2 callersFunction_restore_authored_behaviors
( case: dict[str, Any], authored_behaviors: list[Any], refined_behaviors: list[Any], )
src/skillevaluator/tier3/generate_dataset.py:1504
↓ 2 callersFunction_restore_constituent_not_applicable
Restore absent N/A metrics only when every declared step has bounded sidecar evidence. The returned validation view preserves Harbor's authoritat
src/skillevaluator/tier3/harbor/collector.py:3472
↓ 2 callersFunction_restore_custom_metric_details
Preserve safe metric-keyed evidence while redacting nested secrets.
src/skillevaluator/tier3/harbor/collector.py:6480
↓ 2 callersFunction_restore_custom_metric_scores
Restore only finite numeric values recognized by the custom-metric schema.
src/skillevaluator/tier3/harbor/collector.py:6440
↓ 2 callersFunction_result
(monkeypatch, run_dir, **kwargs)
tests/reporting/test_execution_backend_reporting.py:35
↓ 2 callersFunction_result_display_status
Describe execution separately from the preserved gate boolean.
src/skillevaluator/reporting/html.py:2164
↓ 2 callersMethod_result_to_dict
Convert ValidationResult to serializable dictionary.
src/skillevaluator/reporting/json_reporter.py:364
↓ 2 callersFunction_results_without_execution_evidence
Return non-skipped results that do not prove a validator ran.
src/skillevaluator/reporting/benchmark.py:2076
↓ 2 callersFunction_retain
( raw: Path, destination: Path, tier: int, tokens: set[str], skill: Path, code: int, target_path: str | No
ci/run_tiers.py:321
↓ 2 callersFunction_reward
(score: float, **identity: str)
tests/tier3/test_skip_with_skill.py:42
↓ 2 callersFunction_reward_claims_metric
(rewards: dict[str, Any], metric: str)
src/skillevaluator/tier3/harbor/collector.py:3249
↓ 2 callersMethod_rewrite_env_values
Map runtime paths while preserving Claude's instruction payload verbatim.
src/skillevaluator/tier3/harbor/local_environment.py:1904
↓ 2 callersFunction_rich_line
Return one bounded, single-line message inert to Rich markup.
src/skillevaluator/reporting/cli.py:99
↓ 2 callersFunction_risk
(score: int)
tests/validators/test_skillspector_scope.py:31
↓ 2 callersFunction_risky_profile
()
tests/validators/test_plugin_config_risk.py:70
↓ 2 callersFunction_rm_force_operand_is_protected
Flag force-only deletion of system or home paths, resolved lexically. Home shorthands map under /home and a relative target resolves against each
src/skillevaluator/tier3/eval_core/checks.py:6209
↓ 2 callersFunction_rm_inline_code
Read only an interpreter's inline source, excluding its script argv.
src/skillevaluator/tier3/eval_core/checks.py:5688
↓ 2 callersFunction_rm_spend
Charge one work unit plus one per 256 characters of *text*; True once *budget* is spent.
src/skillevaluator/tier3/eval_core/checks.py:6127
↓ 2 callersFunction_rm_symlink_creation_seen
Recognize link-creation evidence without inferring filesystem state.
src/skillevaluator/tier3/eval_core/checks.py:5959
↓ 2 callersFunction_rm_targets_outside_tmp
Withhold nested /tmp cleanup exemptions after observed link creation. The destructive-command regex deliberately also visits script and patch
src/skillevaluator/tier3/eval_core/checks.py:6509
↓ 2 callersFunction_rm_xargs_fallback
Retain detection on parser/budget failures with bounded linear work.
src/skillevaluator/tier3/eval_core/checks.py:6414
↓ 2 callersFunction_role
(file_path: str)
src/skillevaluator/validators/skillspector_scope.py:528
↓ 2 callersFunction_root_forms
Lexical and resolved spellings of the plugin root (Claude Code prints resolved paths).
src/skillevaluator/validators/claude_plugin_validate.py:199
↓ 2 callersFunction_root_variable_finding
MEDIUM for a component path that starts with a root variable the client documents only elsewhere (Cursor).
src/skillevaluator/plugin_paths.py:491
↓ 2 callersFunction_rooted_launch_paths
Plugin files a launch value names from the plugin root: after a root variable, or with a leading ``./``. A backslash is a path separator, as on W
src/skillevaluator/plugin_mcp.py:484
↓ 2 callersFunction_round
(value: float | None, digits: int = 4)
src/skillevaluator/tier3/harbor/stats.py:323
↓ 2 callersFunction_row_detail
Return a row's Detail cell, joining the lines it wraps onto.
tests/test_tier3_progress.py:631
↓ 2 callersFunction_rows
(value: object)
src/skillevaluator/tier3/token_usage.py:150
↓ 2 callersFunction_rows
Map each table row label to its cells, dropping borders and score bars.
tests/tier3/test_metric_applicability_display.py:40
↓ 2 callersFunction_rule_activation
Classify one plugin rule as always on, scoped to file patterns, or applied on request. A rule with no frontmatter, or with ``alwaysApply: true``,
src/skillevaluator/tier3/plugin_native.py:1163
↓ 2 callersMethod_rule_dir
Every rule file in a rules folder, at any depth; one in a folder the scans skip is also HIGH.
src/skillevaluator/plugin_discovery.py:932
↓ 2 callersMethod_rule_file
( self, rel: PurePosixPath, origin: Origin, *, name: str | None = None, support: Support = "evaluated"
src/skillevaluator/plugin_discovery.py:1314
↓ 2 callersFunction_rule_fires
(rule: dict[str, Any], names: dict[str, Any])
src/skillevaluator/harness/overlay.py:898
↓ 2 callersFunction_rule_id
(validator_name: str, check_name: str)
src/skillevaluator/reporting/sarif_reporter.py:39
↓ 2 callersFunction_rules_markdown
(rules: Sequence[tuple[str, str]], *, heading: str)
src/skillevaluator/tier3/plugin_native.py:1241
↓ 2 callersMethod_run
(self, command: list[str], run_root: Path, *, allow_net: bool = False)
tests/test_harbor_local_sandbox.py:1625
↓ 2 callersFunction_run_bounded_harbor_process
Run Harbor with bounded merged output and optional cleanup deadline. A requested ``cancellation`` prevents the launch, or stops a running pro
src/skillevaluator/tier3/harbor/runner.py:3907
↓ 2 callersFunction_run_budgeted_variants
( *, skill_name: str, agent: str, jobs: list[tuple[str, Path, str | None]], task_names: li
src/skillevaluator/tier3/harbor/runner.py:4817
← previousnext →4,401–4,500 of 24,741, ranked by callers