Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/NVIDIA/SkillEvaluator
/ functions
Functions
24,741 in github.com/NVIDIA/SkillEvaluator
⨍
Functions
24,741
◇
Types & classes
1,292
↳
Endpoints
703
↓ 1 callers
Function
metadata
(_handle: int)
tests/utils/test_secure_fs_platform.py:122
↓ 1 callers
Function
missing_local_runtimes
Return missing runtime commands keyed by agent.
src/skillevaluator/tier3/harbor/local_runtime.py:501
↓ 1 callers
Method
mix
(t,e)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
model_config
Resolve the user's setup for one profile: ``context_tokens`` (0 = unknown), ``custom_provider`` and ``explicit_invocation`` (skills are activated
src/skillevaluator/harness/overlay.py:839
↓ 1 callers
Method
monitors
(self)
src/skillevaluator/plugin_discovery.py:1444
↓ 1 callers
Method
monotonic
(self)
tests/tier3/test_judge_failure_artifacts.py:321
↓ 1 callers
Function
mt
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:7
↓ 1 callers
Function
na
(t,e)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
name
(self)
tests/validators/test_base.py:92
↓ 1 callers
Function
name_key
(value: str)
src/skillevaluator/tier3/harbor/runner.py:3475
↓ 1 callers
Function
names
(order: list[tuple[str, str, int | None]])
tests/reporting/test_junit_reporter.py:778
↓ 1 callers
Function
native_rule_staging
``always_on``, ``on_demand`` (a ``paths`` rule), or ``not_staged`` under one harness's native loading.
src/skillevaluator/plugin_context_cost.py:251
↓ 1 callers
Function
native_shell_cases
()
scripts/script_invocation_differential.py:891
↓ 1 callers
Function
native_steps
(llm_ms, tool_ms)
tests/reporting/test_resource_comparison.py:98
↓ 1 callers
Function
native_tier3
Run both native Harbor arms and emit their canonical typed JSON.
ci/run_tiers.py:257
↓ 1 callers
Function
nested
(outer: str, inner: str)
tests/test_harbor_secure_docker_environment.py:2159
↓ 1 callers
Function
ni
(t,e)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
no
(t,e,i,s)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
no_symlinks
(repo: Path, relative: str)
src/skillevaluator/_ci_onboarding_git.py:142
↓ 1 callers
Function
normalize_once
(path: object)
src/skillevaluator/skillspector_references.py:257
↓ 1 callers
Function
normalize_write
(write)
tests/ci/test_feedback.py:704
↓ 1 callers
Function
normalized
(path: Path)
src/skillevaluator/utils/tier2_paths.py:111
↓ 1 callers
Function
normalized
(name: str)
src/skillevaluator/tier3/eval_core/checks.py:7336
↓ 1 callers
Function
normalized_component_manifest
Keep only declarations defined by this manifest's component dialect. Claude and bundle manifests retain their existing fields. Other clients
src/skillevaluator/plugin_formats.py:346
↓ 1 callers
Function
normalized_permission_mode
A ``permissionMode`` spelled any way Tier 3 accepts it (case, ``-``, ``_``), as Claude Code names it.
src/skillevaluator/plugin_component_risk.py:658
↓ 1 callers
Function
normalized_tool_call_is_error
Reject attributable failed tool results, including unsuccessful skill lookups.
src/skillevaluator/tier3/eval_core/codex_tool_call_normalizer.py:136
↓ 1 callers
Function
not_applicable_counts
Return how many rewards record each metric as N/A (metrics with none are omitted).
src/skillevaluator/tier3/harbor/metrics.py:373
↓ 1 callers
Method
notify
(t,e,i,s)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
ns
(t,e)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
nt
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:7
↓ 1 callers
Method
observe_collected_trials
Reuse the engine's reward reads; behavior evidence never participates in scoring.
src/skillevaluator/tier3/plugin_execution.py:102
↓ 1 callers
Function
observed
(ordinal)
tests/tier3/test_private_comparison_engine.py:214
↓ 1 callers
Method
of
(self, result: ValidationResult)
src/skillevaluator/reporting/run_status.py:79
↓ 1 callers
Function
oi
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
on_output
(text: str, stream: str)
tests/test_harbor_secure_docker_environment.py:295
↓ 1 callers
Function
on_server_ready
(server: ThreadingHTTPServer)
tests/test_nvidia_build_bridge.py:440
↓ 1 callers
Function
one
(value: float | None)
src/skillevaluator/tier3/case_summary.py:575
↓ 1 callers
Function
op
()
tests/test_retry.py:211
↓ 1 callers
Method
openai_extension
Hooks and apps in ``extensions["com.openai"]`` of an Agent Plugins manifest. OpenAI documents this object as the place for Codex hooks (a pat
src/skillevaluator/plugin_discovery.py:1158
↓ 1 callers
Method
openclaw_runtime
Inventory native OpenClaw entrypoints without importing them or translating them to MCP. A manifest alone cannot enumerate dynamic registrati
src/skillevaluator/plugin_discovery.py:1181
↓ 1 callers
Function
opencode_agent_name
The name OpenCode knows a plugin agent by once it is staged natively. OpenCode has no plugin namespace, so an agent named like a built-in (``
src/skillevaluator/tier3/plugin_native.py:1846
↓ 1 callers
Function
option_value
(flag)
tests/tier3/test_gateway_codex.py:91
↓ 1 callers
Function
origin_remote_url
The raw ``origin`` URL of the git repository at ``clone_root``, or ``None`` when there is none. git prints the URL as UTF-8 whatever the locale,
src/skillevaluator/plugin_dependencies.py:171
↓ 1 callers
Function
os
(t,e,i,s)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
output_only_ancestor
(path: Path)
src/skillevaluator/tier3/plugin_prepare.py:339
↓ 1 callers
Function
outside_sourced_file
(mention: re.Match[str])
src/skillevaluator/tier3/eval_core/checks.py:1193
↓ 1 callers
Method
over_limit
Sections that list more refs than Tier 3 stages (``MAX_PLUGIN_MANIFEST_ITEMS``).
src/skillevaluator/plugin_dependencies.py:579
↓ 1 callers
Function
owned
(comment)
ci/feedback.py:478
↓ 1 callers
Function
ownership_email_spans
Return source spans for single-line metadata.pic/email contact values. Only literal, unambiguous YAML scalars qualify. Invalid or oversized YAML,
src/skillevaluator/validators/pii_ownership.py:24
↓ 1 callers
Function
pa
(t,e)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
pair
(**kwargs: Any)
tests/test_tier3_max_cases.py:67
↓ 1 callers
Function
paired_lift
Paired lift of *treatment* over *control*, with its interval, on one basis. Both arms are scored per case on the dimensions both scored for that
src/skillevaluator/tier3/harbor/stats.py:669
↓ 1 callers
Function
panel
(rows: list[dict[str, Any]] = rows, skill: Path = skill)
src/skillevaluator/harness/report.py:277
↓ 1 callers
Function
parent_handle
(target: Path)
src/skillevaluator/ci_onboarding.py:311
↓ 1 callers
Method
parse
(self)
src/skillevaluator/plugin_component_risk.py:1258
↓ 1 callers
Method
parse
(t,e)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
parseArrayData
(t,e,i,s)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
parseObjectData
(t,e,i,s)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
parsePrimitiveData
(t,e,i,s)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
parse_bounded_llm_verdict
Turn a parsed Tier 2 LLM reply into a verdict with checked, bounded fields. The reply must be a JSON object whose ``verdict`` is one of ``val
src/skillevaluator/inference/types.py:84
↓ 1 callers
Function
parse_hook_census
Aggregate census JSON lines into ``{"hooks": [...], "total_runs": n, ...}``. ``hooks`` rows are ``{"hook_id", "event", "runs", "failures", "block
src/skillevaluator/tier3/eval_core/runtime_evidence.py:104
↓ 1 callers
Function
parse_hook_path
Interpret a pre-commit path in the host platform's own spelling. pre-commit passes tracked paths as the host spells them. On POSIX a backslas
src/skillevaluator/precommit.py:27
↓ 1 callers
Function
parse_json_report
Normalize ``claude plugin validate --json`` output into verdict, errors, and warnings. File paths in the messages are made relative to *root*. ``
src/skillevaluator/validators/claude_plugin_validate.py:263
↓ 1 callers
Function
parse_parameters
Parse parameter definitions.
src/skillevaluator/tier3/reference_skills/api-caller/scripts/parse_openapi.py:30
↓ 1 callers
Function
parse_request_body
Parse request body schema.
src/skillevaluator/tier3/reference_skills/api-caller/scripts/parse_openapi.py:45
↓ 1 callers
Method
parse_response
Parse newline-delimited JSON verdicts from the LLM response.
src/skillevaluator/inference/finding_verifier.py:71
↓ 1 callers
Function
parse_spec
Parse OpenAPI spec and extract operations.
src/skillevaluator/tier3/reference_skills/api-caller/scripts/parse_openapi.py:74
↓ 1 callers
Function
parse_text_report
Parse the human-readable report (Claude Code builds without ``--json``). The report names each file on a ``Validating <kind>: <path>`` line, open
src/skillevaluator/validators/claude_plugin_validate.py:300
↓ 1 callers
Function
parse_workflow
(content: str)
src/skillevaluator/_ci_onboarding_workflows.py:47
↓ 1 callers
Function
parse_workflows_manifest
Parse workflow directory into WorkflowsManifest (utility function).
src/skillevaluator/validators/workflows_schema.py:368
↓ 1 callers
Method
patch
(self, path, payload)
tests/ci/test_feedback.py:147
↓ 1 callers
Function
path
()
tests/ci/test_select_changed_skills.py:256
↓ 1 callers
Method
path
:func:`report_path` of *value* under this report's scan root, computed once per distinct path.
src/skillevaluator/skillspector_references.py:129
↓ 1 callers
Method
path
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
paths
()
tests/reporting/test_report_data_bounds.py:711
↓ 1 callers
Function
payload
(members, size)
tests/ci/test_feedback.py:1274
↓ 1 callers
Function
payload_matches_target
(payload: dict[str, Any])
src/skillevaluator/reporting/base.py:1890
↓ 1 callers
Function
payload_value
(payload: dict[str, Any], key: str)
src/skillevaluator/reporting/base.py:1937
↓ 1 callers
Function
pe
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
peer_value
(candidates: list[object], key: str)
src/skillevaluator/reporting/base.py:1927
↓ 1 callers
Function
per_token
LLM milliseconds per prompt + completion token, from the arm's complete totals only.
src/skillevaluator/tier3/harbor/resource_usage.py:120
↓ 1 callers
Method
persist
(self)
src/skillevaluator/tier3/plugin_evidence.py:599
↓ 1 callers
Method
persisted
(self)
src/skillevaluator/tier3/plugin_evidence.py:98
↓ 1 callers
Function
plan_loose_parts
Decide per agent whether its loose-parts arm runs, and build its staging and Harbor wrapper. ``decisions`` are the run's private loading decision
src/skillevaluator/tier3/harbor/loose_parts_arm.py:142
↓ 1 callers
Method
platform
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
pluginScopeKeys
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
plugin_inventory_for_root
(path: Path)
src/skillevaluator/deduplication/plugin/profile.py:27
↓ 1 callers
Function
plugin_root
()
tests/fixtures/plugins/bundled-script-hooks/scripts/plugin_paths.py:13
↓ 1 callers
Function
plugin_root_var_names
The variable names that name the plugin root: a format's own placeholders plus Claude Code's. *root_prefixes* are the format's placeholders as wr
src/skillevaluator/tier3/plugin_native.py:470
↓ 1 callers
Function
po
(t,e,i,s)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
policy_source
Never use the candidate or merge base as MR policy authority.
ci/prepare_security_baselines.py:20
↓ 1 callers
Method
poll
(self)
tests/test_harbor_runner_status.py:841
↓ 1 callers
Function
populate
(root: Path, size: int, layout: str, supporting: int, malformed: int)
scripts/benchmark_tier2_scale.py:95
↓ 1 callers
Function
prepare_comments
Reuse the publisher's evidence checks and the native Markdown/comment path.
ci/prepare_comments.py:24
↓ 1 callers
Function
prepare_local_runtime
()
src/skillevaluator/cli.py:3979
↓ 1 callers
Method
present_types
(self)
src/skillevaluator/tier3/plugin_native.py:186
↓ 1 callers
Function
primary
(depth)
src/skillevaluator/tier3/eval_core/plugin_security.py:2712
↓ 1 callers
Function
private_runtime
Activate ``hooks`` for the evaluation run inside the block.
src/skillevaluator/tier3/plugin_execution.py:63
↓ 1 callers
Function
probe
(selected_provider)
tests/test_tier3_progress.py:3656
↓ 1 callers
Function
probe_model
Check the selected model against the provider catalog within one deadline.
src/skillevaluator/tier3/harbor/runtime_preflight.py:1892
← previous
next →
8,901–9,000 of 24,741, ranked by callers