Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/NVIDIA/SkillEvaluator
/ functions
Functions
24,741 in github.com/NVIDIA/SkillEvaluator
⨍
Functions
24,741
◇
Types & classes
1,292
↳
Endpoints
703
↓ 1 callers
Function
common_case_scores
Score every arm per case on the *dimensions* that every arm scored for that case. Listwise: a case is kept only when every arm scored it, no arm
src/skillevaluator/tier3/harbor/stats.py:901
↓ 1 callers
Function
communication
()
tests/test_harbor_local_mode.py:3625
↓ 1 callers
Function
compact_load_evidence
Retain every piece result and attempt without repeating their JSON trees. ``arms[arm][case]`` lists attempt-table indices in the original attempt
src/skillevaluator/tier3/harbor/loose_parts_arm.py:234
↓ 1 callers
Function
compare_retained_runs
Resolve read-only command selectors and use the live comparison path.
src/skillevaluator/tier3/version_comparison.py:226
↓ 1 callers
Method
complete_task
Mark a task as completed.
src/skillevaluator/tier3/reference_skills/task-list/scripts/tasks.py:211
↓ 1 callers
Function
completion
(**kwargs)
tests/test_doctor.py:380
↓ 1 callers
Function
component_preflight
Use the operator's login to check the shared component once, before writes.
src/skillevaluator/ci_onboarding.py:680
↓ 1 callers
Method
computeTickLimit
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
condition
(passed)
tests/reporting/test_case_findings_report.py:27
↓ 1 callers
Function
config
(sha)
ci/feedback.py:939
↓ 1 callers
Function
config_content
()
tests/ci/test_feedback.py:513
↓ 1 callers
Function
configure
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
configure
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
configure
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
configure
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
configure_agent_routes
Bind the coordinator-resolved routes once for this engine attempt.
src/skillevaluator/tier3/plugin_comparisons.py:193
↓ 1 callers
Function
conjunction
(depth)
src/skillevaluator/tier3/eval_core/plugin_security.py:2754
↓ 1 callers
Method
connect
(self, _socket_address)
tests/test_model_catalog.py:364
↓ 1 callers
Method
construct_mapping
(self, node: yaml.MappingNode, deep: bool = False)
src/skillevaluator/quality_config.py:280
↓ 1 callers
Function
container_generation
(service: str)
tests/test_harbor_secure_docker_environment.py:8084
↓ 1 callers
Function
context_cost
A bounded static lower-bound estimate with every supported harness/load-mode view.
src/skillevaluator/plugin_context_cost.py:502
↓ 1 callers
Function
context_cost_measured
Paired mean first-turn prompt-token delta (with minus without), by case. The first LLM turn carries the always-on context (system prompt, skill a
src/skillevaluator/tier3/harbor/stats.py:1342
↓ 1 callers
Function
count
(key: str)
src/skillevaluator/reporting/declarative_coverage.py:40
↓ 1 callers
Method
countVisibleElements
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
count_phrase
Return ``count`` followed by the singular or plural noun.
src/skillevaluator/reporting/finding_summary.py:320
↓ 1 callers
Method
create_autopilot_dataset
Create one missing eval case for the CLI autopilot workflow.
src/skillevaluator/evaluation/service.py:81
↓ 1 callers
Function
create_setup
( repo: Path, name: str, branch: str, files: dict[str, str], full: bool, plan: dict, *, expected=None )
src/skillevaluator/ci_onboarding.py:718
↓ 1 callers
Method
create_user_prompt
Build the user-role prompt. Override in subclasses.
src/skillevaluator/inference/client.py:891
↓ 1 callers
Function
credential_uri_secret_values
Return raw and decoded credential components from one URI authority.
src/skillevaluator/utils/redaction.py:213
↓ 1 callers
Function
credited
Whether an invocation found here counts: not once an assignment the shell stops at has failed before it (see ``_ASSIGNMENT_REFUSED``), nor
src/skillevaluator/tier3/eval_core/script_invocation.py:2885
↓ 1 callers
Function
curated
Command shapes chosen deliberately, each paired with its expected script.
scripts/script_invocation_differential.py:296
↓ 1 callers
Function
da
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
darken
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
datasetAnimationScopeKeys
(t,e)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
datasetElementScopeKeys
(t,e)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
datasetScopeKeys
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
declared_metadata_id
Return the valid ``metadata.id`` declared in *skill_dir*'s manifest, if any. Used by catalog runs that validate each skill separately, so they ca
src/skillevaluator/validators/schema.py:150
↓ 1 callers
Function
declared_tier1_required_checks
Parse a recorded Tier 1 lineup, failing closed to the full skill lineup. A declaration can omit only the skill-only checks, so a malformed or
src/skillevaluator/publication_evidence.py:142
↓ 1 callers
Function
deltas
(values)
src/skillevaluator/tier3/version_comparison.py:195
↓ 1 callers
Function
demo
(output: Path)
scripts/demo_starter.py:92
↓ 1 callers
Function
denies_every_bash_command
Whether a ``disallowedTools`` list removes the shell tool ``tool`` (``Bash`` or ``PowerShell``), the way Claude Code matches it. Tool names a
src/skillevaluator/plugin_component_risk.py:640
↓ 1 callers
Function
dependency_folder_skill_findings
HIGH for each skill a client loads from a dependency folder; LOW when the search stopped early. ``display`` maps a plugin-root-relative path to t
src/skillevaluator/plugin_member_paths.py:308
↓ 1 callers
Method
describe
Return the arm, its state, its counts and the first recorded failure, then what is not reported. When the agent's recorded status is ``failed
src/skillevaluator/reporting/tier3_coverage.py:82
↓ 1 callers
Function
destination_identity
()
tests/test_harbor_local_environment.py:803
↓ 1 callers
Function
detect_dataset_format
Return the authoring format used by a parsed dataset payload.
src/skillevaluator/tier3/dataset_utils.py:108
↓ 1 callers
Method
determineDataLimits
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
di
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
diagnostic_text
*value* stripped and redacted when it is short text without control characters, else ``None``. Nothing else is coerced to text, so a list or an o
src/skillevaluator/skillspector_references.py:76
↓ 1 callers
Function
dimensions
( baseline: float, with_skill: float, )
tests/golden/test_benchmark_card.py:136
↓ 1 callers
Function
discover
(repo: Path)
src/skillevaluator/_ci_onboarding_git.py:157
↓ 1 callers
Function
discover_plugin_view
Read one client's view through the shared bounded collector and operation budget.
src/skillevaluator/plugin_discovery.py:1620
↓ 1 callers
Function
dn
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
do_HEAD
(self)
tests/test_nemo_gym_backend.py:1734
↓ 1 callers
Function
doc_reference_pattern
Match the ways a test names a path the classifier calls documentation. The patterns come from the classifier's own lists, so a path added there i
scripts/select_docs_tests.py:34
↓ 1 callers
Method
download
(self)
tests/reporting/test_recorded_harbor_uploads.py:296
↓ 1 callers
Method
download_artifact
(self, identifier)
tests/ci/test_feedback.py:132
↓ 1 callers
Function
drain_test_tasks
()
tests/tier3/test_judge_failure_artifacts.py:717
↓ 1 callers
Method
draw
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
draw
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
drawBackground
(t,e,i,s)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
drawBody
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
drawCaret
(t,e,i,s)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
drawFooter
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
drawTitle
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
drawTitle
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
dropped_case_rows_pointer
For a terminal summary: say that no report has the case rows the payload dropped, if it dropped any. The payload that every report reads drops th
src/skillevaluator/reporting/tier3_token_usage.py:199
↓ 1 callers
Function
dt
(t,e)
src/skillevaluator/reporting/assets/chart.umd.min.js:7
↓ 1 callers
Method
duplicates
(self, skill: Path, name: str)
src/skillevaluator/harness/overlay.py:626
↓ 1 callers
Function
ea
(t,e,i,s)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
echo
(message: str)
src/skillevaluator/cli.py:1202
↓ 1 callers
Function
ei
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
eligible
(env: Mapping[str, str], current: dict | None)
ci/eligible_gitlab.py:21
↓ 1 callers
Function
embed
(texts: list[str])
tests/embedding/test_similarity_limits.py:35
↓ 1 callers
Method
embed
(self, texts: list[str])
scripts/benchmark_tier2_scale.py:58
↓ 1 callers
Method
embed
(self, texts)
tests/deduplication/plugin/test_openclaw_profile.py:48
↓ 1 callers
Method
embed
(self, texts)
tests/deduplication/plugin/test_private_dedup.py:41
↓ 1 callers
Function
embed_one
(text: str)
tests/validators/test_similarity.py:569
↓ 1 callers
Function
embed_one
(text: str)
tests/embedding/test_catalog.py:631
↓ 1 callers
Method
embed_single
(self, text: str)
scripts/benchmark_tier2_scale.py:71
↓ 1 callers
Method
emit
(self, event)
src/skillevaluator/reporting/console_ui.py:214
↓ 1 callers
Method
emit
(self, record: logging.LogRecord)
src/skillevaluator/tier3/mcp_proof.py:581
↓ 1 callers
Method
emit
(self, event: ProgressEvent)
src/skillevaluator/tier3/harbor/progress.py:918
↓ 1 callers
Method
emit
(self, record)
tests/tier3/test_mcp_proof.py:76
↓ 1 callers
Function
emit_control
(variant: str, members: Sequence[Path], *, _agent: str = agent)
src/skillevaluator/tier3/harbor/runner.py:6346
↓ 1 callers
Function
emit_tasks
(_skill, output, **_kwargs)
tests/test_tier3_progress.py:2879
↓ 1 callers
Function
enable_hosting
(repo: Path, name: str, branch: str, state: dict, progress: list[str])
src/skillevaluator/ci_onboarding.py:637
↓ 1 callers
Method
endOf
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
end_statement
(self)
src/skillevaluator/tier3/eval_core/codex_tool_call_normalizer.py:1014
↓ 1 callers
Function
ended
(pid)
tests/ci/test_run_tier1.py:1529
↓ 1 callers
Function
ending
()
ci/run_tier1.py:688
↓ 1 callers
Function
endpoint_client_host
The host name a WHATWG client (Node, the MCP SDKs) looks up for ``host``. Percent-encoding is decoded and the name is lower-cased and IDNA-mapped
src/skillevaluator/validators/mcp_static.py:2922
↓ 1 callers
Function
engine_feed_rows
Render the engine progress tail as muted rows under the run config.
src/skillevaluator/reporting/console_ui.py:118
↓ 1 callers
Method
ensureScalesHaveIDs
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
ensure_bind_parents
(path: Path)
src/skillevaluator/tier3/harbor/local_sandbox.py:560
↓ 1 callers
Function
ensure_environment
(name: str, branch: str)
src/skillevaluator/ci_onboarding.py:607
↓ 1 callers
Function
ensure_gke_metadata_network_policy
Verify or create the pod-scoped GKE metadata-blocking NetworkPolicy in the target namespace.
src/skillevaluator/tier3/harbor/gke_environment.py:654
↓ 1 callers
Function
ensure_skillspector_wheel
Make sure the verified SkillSpector wheel is present; return an error or None.
src/skillevaluator/utils/scanner_install.py:94
↓ 1 callers
Function
es
(t,e,i,s)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
eval_source_exists
()
src/skillevaluator/cli.py:1206
↓ 1 callers
Function
evaluate
Run a live-agent evaluation for a skill on the selected execution backend.
src/skillevaluator/tier3/commands.py:668
← previous
next →
8,501–8,600 of 24,741, ranked by callers