MCPcopy Create free account

hub / github.com/NVIDIA/SkillEvaluator / functions

Functions24,741 in github.com/NVIDIA/SkillEvaluator

↓ 4 callersFunction_pct
(passed: int, total: int)
src/skillevaluator/tier3/case_summary.py:394
↓ 4 callersFunction_plain
Strip ANSI styling and table box-drawing, collapse wrapping whitespace.
tests/reporting/test_incomplete_scans.py:21
↓ 4 callersFunction_plain_cli
Strip ANSI styling that CI may force into Rich output.
tests/reporting/test_advisory_skip_verdict.py:28
↓ 4 callersFunction_plan
(backend: str, strength: str = "kernel", reason: str = "test")
tests/test_harbor_local_sandbox.py:32
↓ 4 callersFunction_plugin
(root: Path, files: dict[str, Any] | None = None, **fields: Any)
tests/test_openclaw_plugin_smoke.py:38
↓ 4 callersFunction_plugin_namespaces
Casefolded names of the plugin under evaluation (its Claude Code namespace).
src/skillevaluator/tier3/eval_core/plugin_signals.py:2726
↓ 4 callersFunction_prepared
(root: Path, *, mcp: dict | None = None)
tests/tier3/test_native_review_fixes.py:23
↓ 4 callersFunction_probability_float
Return a nonzero float approximation, or None when conversion underflows.
src/skillevaluator/tier3/harbor/collector.py:4879
↓ 4 callersFunction_projection_path_exists
Check lexical presence without silently dropping a broken link.
src/skillevaluator/tier3/harbor/adapter.py:6382
↓ 4 callersFunction_public_provider
()
src/skillevaluator/tier3/harbor/templates/eval.py:1466
↓ 4 callersFunction_public_source_files
(repo_root: Path)
tests/test_oss_packaging.py:95
↓ 4 callersFunction_quality_result
()
tests/reporting/test_quality_gate_reports.py:17
↓ 4 callersFunction_read_catalog_text
(catalog_path: Path)
src/skillevaluator/embedding/registry.py:1318
↓ 4 callersFunction_read_result_json
(run_dir: Path)
src/skillevaluator/evaluation/tier3_feedback_chat.py:92
↓ 4 callersFunction_read_secure_manifest_bytes
(secure_file: SecureFile, declared_path: Path, *, max_bytes: int)
src/skillevaluator/plugin_manifest.py:109
↓ 4 callersFunction_record_judge_attempt
Save one judge attempt to judge_attempts.json while main() runs the judges. The file is rewritten after every attempt, so it also explains a judg
src/skillevaluator/tier3/harbor/templates/eval.py:3086
↓ 4 callersFunction_record_scope
(results: list[ValidationResult], tier: int, stages: dict)
src/skillevaluator/tier_workflows.py:55
↓ 4 callersMethod_record_work
(self)
src/skillevaluator/tier3/harbor/secure_docker_environment.py:426
↓ 4 callersFunction_redacted
(value: Any)
src/skillevaluator/tier3/plugin_native.py:1294
↓ 4 callersFunction_reject_chmod_without_follow
(monkeypatch: pytest.MonkeyPatch, module: object)
tests/test_harbor_secure_copy.py:541
↓ 4 callersFunction_relative_to_allowed
(source: Path, allowed_root: Path)
src/skillevaluator/tier3/harbor/secure_copy.py:195
↓ 4 callersMethod_release_active_process
(self, process: asyncio.subprocess.Process)
src/skillevaluator/tier3/harbor/local_environment.py:778
↓ 4 callersFunction_remaining_judge_timeout
Bound one provider request by the remaining time for its judge.
src/skillevaluator/tier3/harbor/templates/eval.py:1721
↓ 4 callersFunction_remote_preflight
(monkeypatch, tmp_path, info, pages, *, history=False, deployments=None, full=True)
tests/test_ci_onboarding_pages.py:200
↓ 4 callersFunction_rendered_identity
(value: str)
scripts/ci/check_public_benchmarks.py:1477
↓ 4 callersMethod_reorganize_single_skill
Reorganize results for a single-skill run into one entry.
src/skillevaluator/reporting/html.py:2348
↓ 4 callersFunction_repeated_finding_results
Same semantic finding across validators and concrete locations.
tests/reporting/test_reporters.py:778
↓ 4 callersMethod_report
(self, *results: ValidationResult)
tests/test_benchmark_source_provenance.py:1417
↓ 4 callersFunction_report_omissions
(payload: dict[str, Any])
src/skillevaluator/evaluation/tier3_report.py:1804
↓ 4 callersFunction_reports_page
()
tests/reporting/test_tier3_completed_agent_docs.py:38
↓ 4 callersMethod_resolveAnimations
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 4 callersFunction_resolve_docker_source_variables
Resolve known static Docker variables and report any unresolved reference.
src/skillevaluator/tier3/harbor/adapter.py:2811
↓ 4 callersFunction_resolve_url
(provider)
src/skillevaluator/tier3/harbor/templates/eval.py:1130
↓ 4 callersFunction_resolve_vertex_project_id
Resolve the Google Cloud project ID for Vertex AI from environment variables.
src/skillevaluator/tier3/harbor/runtime_preflight.py:1473
↓ 4 callersMethod_result
(*, incomplete: bool)
tests/models/test_result.py:209
↓ 4 callersFunction_reward
(trial_id: str, entry_id: str, *, score: float, steps: int, prompt: int)
tests/reporting/test_tier3_baseline_trial_views.py:132
↓ 4 callersFunction_reward
(trial_id: str, entry_id: str, score: float, steps: int)
tests/reporting/browser_navigation_fixtures.py:71
↓ 4 callersFunction_reward_publication_projection_is_safe
Check the same redacted envelope used by persisted reward artifacts.
src/skillevaluator/tier3/harbor/collector.py:4423
↓ 4 callersFunction_rewrite_launcher_segment
Apply launcher rewrites before the CLI ``--`` prompt separator only.
src/skillevaluator/tier3/harbor/local_agents.py:145
↓ 4 callersMethod_rewrite_raw_paths
(self, value: str)
src/skillevaluator/tier3/harbor/local_environment.py:1958
↓ 4 callersMethod_role_from_name
Classify a requirements file stem or optional group name as runtime, dev, test, docs or build.
src/skillevaluator/validators/dependencies.py:964
↓ 4 callersFunction_row
(markdown: str, label: str)
tests/reporting/test_dimension_explanations.py:64
↓ 4 callersMethod_run
(self, tmp_path: Path, monkeypatch: pytest.MonkeyPatch, *args: str)
tests/test_benchmark_source_provenance.py:1153
↓ 4 callersFunction_run_agent_collect_trajectories
Run claude-code agent via Harbor and return trajectories and optional source paths. Writes initial cases to evals/evals.json, runs Harbor, then d
src/skillevaluator/tier3/generate_dataset.py:1193
↓ 4 callersFunction_run_details
Return the text of the collapsed Run details & provenance panel.
tests/reporting/test_tier3_completed_agent_docs.py:48
↓ 4 callersFunction_run_engine
Run ``run_harbor_eval`` with Harbor faked and the real collector.
tests/tier3/test_baseline_timeouts.py:1630
↓ 4 callersFunction_run_timestamp_parts
Parse a supported run timestamp and return its remaining suffix.
src/skillevaluator/tier3/results_location.py:125
↓ 4 callersFunction_run_trial
Run the lane's real ``run()`` in a staged task; return its error, launch command and env.
tests/test_harbor_claude_refusal_fallback.py:602
↓ 4 callersMethod_run_trusted_docker_command
Run a bounded raw-Docker command under the scrubbed host baseline.
src/skillevaluator/tier3/harbor/secure_docker_environment.py:1443
↓ 4 callersFunction_runtime
(tmp_path, *, case_count=1, n_attempts=1, n_pieces=0)
tests/tier3/test_private_comparison_artifacts.py:60
↓ 4 callersFunction_runtime_rows
(inventory)
tests/test_openclaw_plugin_discovery.py:314
↓ 4 callersFunction_safe_diagnostic
(stderr, category)
tests/ci/test_feedback.py:1537
↓ 4 callersMethod_safe_line_content
Truncate line content for display, stripping invisible chars.
src/skillevaluator/validators/unicode_smuggle.py:501
↓ 4 callersFunction_safe_text
(value: Any, limit: int = 256)
src/skillevaluator/tier3/eval_core/runtime_evidence.py:35
↓ 4 callersFunction_sbpl_quote
Escape a path for a double-quoted SBPL string literal. Backslash first, then double-quote, so a run/working dir containing either can't produ
src/skillevaluator/tier3/harbor/local_sandbox.py:642
↓ 4 callersFunction_scored
(signals: Sequence[Mapping[str, Any]], key: str)
src/skillevaluator/tier3/eval_core/plugin_signals.py:4835
↓ 4 callersFunction_script_file_names
File names of the parsed skill's scripts, the list `tier3 validate` checks graded text against. "scripts" holds only the Python scripts the gener
src/skillevaluator/tier3/generate_dataset.py:441
↓ 4 callersFunction_script_skill
(tmp_path, script_name, instructions)
tests/validators/test_quality_score.py:2135
↓ 4 callersFunction_section_occurrences
Return structurally parsed level-two sections and their token bodies.
scripts/ci/check_public_benchmarks.py:1237
↓ 4 callersFunction_security_result
(source: str, extractor)
tests/tier3/test_codex_tool_call_normalization.py:1102
↓ 4 callersMethod_security_result
(provenance: dict | None, provider_id: str | None = "nv_build")
tests/reporting/test_reporters.py:2934
↓ 4 callersFunction_selected_judge_model
(model=None)
src/skillevaluator/tier3/harbor/templates/eval.py:2213
↓ 4 callersMethod_setStyle
(t,e,i,s)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 4 callersMethod_set_socket_timeout
(self)
src/skillevaluator/model_catalog.py:189
↓ 4 callersFunction_settings_variant_report
(version: str, case: str)
tests/validators/test_skillspector_hook_surface.py:79
↓ 4 callersFunction_sha256
(data: bytes)
src/skillevaluator/tier3/loose_parts.py:1312
↓ 4 callersFunction_shell_texts
(fn_base: str, args: Mapping[str, Any])
src/skillevaluator/tier3/eval_core/plugin_signals.py:2275
↓ 4 callersMethod_shell_tokens
(args: str)
src/skillevaluator/tier3/harbor/local_environment.py:1735
↓ 4 callersFunction_shown
Plugin text (a command token or line, a package spec, a pin detail) for messages: no credential, bounded. :func:`~skillevaluator.validators.url_p
src/skillevaluator/validators/mcp_static.py:276
↓ 4 callersFunction_simulate_windows_tree_cleanup
( monkeypatch: pytest.MonkeyPatch, *, taskkill_exits_after: float, on_taskkill_wait: Callable[
tests/test_harbor_runner_status.py:864
↓ 4 callersFunction_skill_named_text_analyzer
(tmp_path, apt: str | None = None, frontmatter: str | None = None)
tests/tier3/test_error_recovery.py:194
↓ 4 callersMethod_skillspector
()
tests/utils/test_tool_runner.py:714
↓ 4 callersFunction_skillspector_bundled_file_bytes
The bytes of the scanned file a SkillSpector report *path* names, else ``None``. The path must pass :func:`_skillspector_report_path_key`, and ex
src/skillevaluator/validators/security.py:1748
↓ 4 callersFunction_skillspector_ledger_exception_label
Describe one ledger exception as ``path[:line] [phase; reason; analyzers=...]``.
src/skillevaluator/validators/security.py:1164
↓ 4 callersFunction_skillspector_report_path_is_bundled_file
Whether a SkillSpector report *path* names one scanned component that is a regular file. The rules are those of :func:`_skillspector_bundled_file
src/skillevaluator/validators/security.py:1782
↓ 4 callersFunction_skillspector_report_text
Return untrusted report text as one bounded line, or ``None`` when it is not text.
src/skillevaluator/validators/security.py:1150
↓ 4 callersFunction_skipped_tier2_result
()
tests/golden/test_benchmark_card.py:96
↓ 4 callersFunction_source_device
Return source device identity (a narrow test hook for mount crossings).
src/skillevaluator/tier3/harbor/secure_copy.py:210
↓ 4 callersFunction_split_command_line
A command line given as one string (``cmd /c "npx -y pkg"``) as words; other argv as is.
src/skillevaluator/validators/mcp_static.py:1694
↓ 4 callersFunction_split_heredoc_body
Split a heredoc body from the commands written after its terminator line.
src/skillevaluator/tier3/eval_core/script_invocation.py:2154
↓ 4 callersFunction_split_heredocs
Split a command into the text to walk and the text that is operand data. Returns the commands to walk, the heredoc or here-string data fed to
src/skillevaluator/tier3/eval_core/script_invocation.py:2337
↓ 4 callersFunction_split_heredocs
``(text without here-document bodies, [(delimiter, body), ...] in order)``. Bodies are data, not commands, and may hold stray quotes, so the shel
src/skillevaluator/tier3/eval_core/plugin_signals.py:2290
↓ 4 callersFunction_split_into_chunks
Split markdown text into chunks for embedding. Strategy: 1. Split on markdown headings (## ) as natural boundaries. 2. If any section sti
src/skillevaluator/embedding/client.py:330
↓ 4 callersFunction_split_punctuation_runs
Separate a grouped run of punctuation into the operators it is made of. With ``arithmetic``, a ``((`` at command position that closes as an a
src/skillevaluator/tier3/eval_core/script_invocation.py:2198
↓ 4 callersFunction_spy_headers
(monkeypatch: pytest.MonkeyPatch)
tests/tier3/test_mcp_proof.py:248
↓ 4 callersFunction_staged_environment_env
(task: Path)
tests/test_harbor_claude_refusal_fallback.py:127
↓ 4 callersFunction_strict_judge_replies
Return whether a completed judge reply must be one whole JSON object and is final. True under LLM_JUDGE_RETRY_POLICY=strict. An invalid policy va
src/skillevaluator/tier3/harbor/templates/eval.py:965
↓ 4 callersFunction_strict_nonnegative_count
(value: object)
src/skillevaluator/reporting/html.py:212
↓ 4 callersFunction_string_argument
(value: Any)
src/skillevaluator/tier3/eval_core/checks.py:1270
↓ 4 callersFunction_stub_engine
( monkeypatch: pytest.MonkeyPatch, skill: Path, *, harbor_config: dict[str, Any] | None = None
tests/tier3/test_skip_with_skill.py:236
↓ 4 callersFunction_succeeded_agent
(*, passed: int)
tests/test_tier3_result_display.py:257
↓ 4 callersFunction_successful_tier1_results
(skill: Path, checks: tuple[str, ...], *, skill_like: bool = True)
tests/test_publication_evidence.py:300
↓ 4 callersFunction_table_rows
Split Markdown table rows on unescaped pipes; ``\\|`` is a literal pipe in a cell.
tests/reporting/test_tier3_token_usage_reports.py:192
↓ 4 callersFunction_temperature_kwargs
(model: str, temperature: float | None)
src/skillevaluator/inference/client.py:153
↓ 4 callersFunction_terminate_process_tree
( process: asyncio.subprocess.Process, communication: asyncio.Task[Any], *, preserve_cancellat
src/skillevaluator/tier3/harbor/secure_docker_environment.py:738
↓ 4 callersFunction_tier3_agent_entries
Normalize agent keys and fail closed on malformed or colliding peers.
src/skillevaluator/reporting/html.py:463
↓ 4 callersFunction_tier_card_verdicts
(html: str)
tests/reporting/test_report_redesign.py:272
↓ 4 callersFunction_tiers
(payload: dict)
ci/tier_manifest.py:285
↓ 4 callersFunction_to_agentskills_dataset
Convert SkillEvaluator's runtime case shape to the preferred agentskills.io file shape.
src/skillevaluator/tier3/generate_dataset.py:83
↓ 4 callersFunction_token_budget_issues
(result)
tests/validators/test_quality_score.py:1710
← previousnext →2,201–2,300 of 24,741, ranked by callers