Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/NVIDIA/SkillEvaluator
/ functions
Functions
24,741 in github.com/NVIDIA/SkillEvaluator
⨍
Functions
24,741
◇
Types & classes
1,292
↳
Endpoints
703
↓ 1 callers
Function
evaluate
(tier: int, workspace: Path, reports: Path, env: dict[str, str])
ci/run_tiers.py:424
↓ 1 callers
Function
evaluate
(options)
tests/tier3/test_private_comparison_engine_acceptance.py:225
↓ 1 callers
Function
evaluate_prepared_plugin
Evaluate a prepared plugin through the existing engine and remove the operation-owned staging. Results are written under the plugin's own ``evals
src/skillevaluator/tier3/plugin_execution.py:395
↓ 1 callers
Function
evaluate_qualification
Evaluate distinct-case coverage and existing attempt-level rates together.
src/skillevaluator/tier3/grader_policy.py:263
↓ 1 callers
Function
evaluate_skill
Run one evaluator process; return row fields, its report and whether time ran out. Scan workers call this concurrently. Raw scanner output stays
ci/run_tier1.py:410
↓ 1 callers
Function
evaluator_timeout_seconds
End the evaluator before the CI job limit so setup and evidence retention fit.
src/skillevaluator/_ci_onboarding_all_tiers.py:68
↓ 1 callers
Method
event_scope
(self, event: str)
src/skillevaluator/plugin_component_risk.py:434
↓ 1 callers
Function
evidence
(text: str)
tests/tier3/test_security_finding_evidence.py:2246
↓ 1 callers
Method
exclude
(self, path: Path, reason: str)
src/skillevaluator/embedding/extractor.py:136
↓ 1 callers
Method
exec
( self, command: str, cwd: str | None = None, env: dict[str, str] | None = Non
src/skillevaluator/tier3/harbor/secure_docker_environment.py:1957
↓ 1 callers
Method
exec
( self, command: str, cwd: str | None = None, env: dict[str, str] | None = Non
src/skillevaluator/tier3/harbor/secure_docker_environment.py:3457
↓ 1 callers
Method
exec_as_agent
( self, environment: BaseEnvironment, command: str, env: dict[str, str] | None
src/skillevaluator/tier3/harbor/local_agents.py:246
↓ 1 callers
Method
exec_as_agent
( self, environment: BaseEnvironment, command: str, env: dict[str, str] | None
src/skillevaluator/tier3/harbor/local_agents.py:421
↓ 1 callers
Method
exec_as_agent
( self, environment: BaseEnvironment, command: str, env: dict[str, str] | None
src/skillevaluator/tier3/harbor/local_agents.py:476
↓ 1 callers
Method
exec_with_sensitive_env
( self, command: str, env: dict[str, str] | None = None, **_kw
tests/test_harbor_local_mode.py:721
↓ 1 callers
Function
executable_report_paths
Return the scan-relative paths of components SkillSpector marks executable. A path that does not resolve inside the artifact is returned as `
src/skillevaluator/validators/skillspector_scope.py:315
↓ 1 callers
Function
execute
(_environment, **kwargs)
tests/test_hermes_agent.py:209
↓ 1 callers
Function
execution_context
(environ: dict[str, str])
ci/run_tier1.py:342
↓ 1 callers
Function
exercise_callback_interrupt
( hostile_command: str, interrupt_secret: str, pid_path: str,
tests/test_harbor_secure_docker_environment.py:8111
↓ 1 callers
Method
exit_code
(self)
tests/reporting/test_dashboard_cli.py:36
↓ 1 callers
Function
explicit
(name: str)
src/skillevaluator/cli.py:4377
↓ 1 callers
Function
export_history
(history: dict, suffix: str)
src/skillevaluator/tier3/history.py:479
↓ 1 callers
Method
extensions
Inventory Agent Plugins client-extension namespaces. A namespace is declared in the manifest ``extensions`` object and/or ships a top
src/skillevaluator/plugin_discovery.py:1101
↓ 1 callers
Function
extract_retry_after
Extract Retry-After header string from an exception if present.
src/skillevaluator/inference/retry.py:151
↓ 1 callers
Function
fa
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
factory
(headers=None, timeout=None, auth=None)
src/skillevaluator/tier3/mcp_proof.py:643
↓ 1 callers
Function
fail_after_client_close_starts
()
tests/tier3/test_judge_failure_artifacts.py:740
↓ 1 callers
Function
fail_after_release
()
tests/test_harbor_local_mode.py:3473
↓ 1 callers
Method
fail_unfinished
Fail every open stage and finish the run without masking its error. ``interrupted`` reports Ctrl+C or cancellation rather than an unexpected
src/skillevaluator/tier3/harbor/runner.py:5369
↓ 1 callers
Function
failed
(reason: str)
src/skillevaluator/tier3/generate_dataset.py:1210
↓ 1 callers
Function
failed_report
()
tests/ci/test_publish_reports.py:132
↓ 1 callers
Function
failed_summary
(*, advisory_downgraded=False)
tests/ci/test_publish_reports.py:110
↓ 1 callers
Function
fake_call_public_llm
(prompt, *args, **kwargs)
tests/tier3/test_behavior_evidence.py:446
↓ 1 callers
Function
fchmod
(descriptor: int, mode: int)
tests/test_harbor_secure_copy.py:660
↓ 1 callers
Function
fetch_openapi_spec
Fetch and parse an OpenAPI spec.
src/skillevaluator/tier3/reference_skills/api-caller/scripts/call_api.py:95
↓ 1 callers
Function
fetch_signing_keys
Fetch only GitHub's fixed public key endpoint, without credentials.
ci/verify_provenance.py:44
↓ 1 callers
Function
fetch_spec
Fetch OpenAPI spec from URL.
src/skillevaluator/tier3/reference_skills/api-caller/scripts/parse_openapi.py:18
↓ 1 callers
Function
find_bundled_plugin_skills
Find live skills under a plugin's ``skills/`` directory.
src/skillevaluator/utils/helpers.py:116
↓ 1 callers
Function
find_evals_config
Return the first supported evals config file for a skill, if present. A broken symlink counts as present, so loading rejects it instead of ru
src/skillevaluator/tier3/evals_config.py:141
↓ 1 callers
Function
find_offenders
( roots: list[Path], *, require_source_provenance: bool = False, expected_source: ExpectedSour
scripts/ci/check_public_benchmarks.py:2048
↓ 1 callers
Function
find_operation
Find an operation in the OpenAPI spec by operation ID.
src/skillevaluator/tier3/reference_skills/api-caller/scripts/call_api.py:103
↓ 1 callers
Function
find_repo_root
Return the enclosing catalog root by layout, or ``plugin_dir`` itself.
src/skillevaluator/plugin_dependencies.py:97
↓ 1 callers
Method
finish
(self)
src/skillevaluator/reporting/plugin_static.py:228
↓ 1 callers
Method
finish
(self)
src/skillevaluator/reporting/plugin_runtime.py:111
↓ 1 callers
Method
finish
Flush the suffix once later input cannot complete a secret.
src/skillevaluator/tier3/harbor/stream_redaction.py:267
↓ 1 callers
Method
finish
(self, *, stderr_suffix: str = "")
src/skillevaluator/tier3/harbor/local_environment.py:248
↓ 1 callers
Method
first
The hook of one of ``keys`` among the sites added from position ``start`` on (by set lookups).
src/skillevaluator/plugin_component_risk.py:2906
↓ 1 callers
Method
fit
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
flag_value_end
Return where the value the flag rule reads at *start* ends (None: it reads none there). The value is _FINDING_EVIDENCE_FLAG_VALUE, or for a n
src/skillevaluator/tier3/eval_core/checks.py:4905
↓ 1 callers
Method
flatten_mapping
(self, node: MappingNode)
src/skillevaluator/utils/structured_data.py:67
↓ 1 callers
Function
flush
()
src/skillevaluator/tier3/eval_core/shell_lexing.py:87
↓ 1 callers
Function
flush
(last: int)
src/skillevaluator/deduplication/utils/chunker.py:99
↓ 1 callers
Function
flush_logs
(*, final: bool = False)
ci/run_tier1.py:745
↓ 1 callers
Function
fo
(t,e,i={})
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
fork_pull
(head_sha="a" * 40, *, base_sha="d" * 40, repo=None)
tests/ci/test_publish_reports.py:439
↓ 1 callers
Function
fork_record
(**changes)
tests/ci/test_publish_reports.py:428
↓ 1 callers
Function
format_lint_findings
Return indented lines for the first *limit* script lint findings.
src/skillevaluator/precommit.py:171
↓ 1 callers
Function
format_report
(stats: dict)
src/skillevaluator/tier3/reference_skills/text-analyzer/scripts/analyze_text.py:41
↓ 1 callers
Function
format_result
Format result for human-readable output.
src/skillevaluator/tier3/reference_skills/task-list/scripts/tasks.py:284
↓ 1 callers
Function
format_result_line
Return one compact PASS/FAIL line for a skill.
src/skillevaluator/precommit.py:180
↓ 1 callers
Method
formats
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
from_entries
(cls, entries: Iterable[str])
src/skillevaluator/plugin_component_risk.py:2731
↓ 1 callers
Method
from_path
Create structure representation from a workflow path.
src/skillevaluator/models/workflows.py:346
↓ 1 callers
Function
frontmatter_census_check
The listing check for a frontmatter hook source in the staged plugin, or its ``not_loaded`` row.
src/skillevaluator/tier3/plugin_native.py:781
↓ 1 callers
Function
fs
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
ga
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
gate_failures
(result, gates)
src/skillevaluator/tier3/grader_validation.py:639
↓ 1 callers
Method
gate_failures
Failed requirements independent of finding severity, such as a minimum score.
src/skillevaluator/models/result.py:434
↓ 1 callers
Function
gateway_fallback_403_stream
Fallback on: the CLI swapped models after a cyber refusal, and the gateway answered 403.
tests/claude_refusal_fixtures.py:112
↓ 1 callers
Function
generate
(self, skill_path, *, use_llm)
tests/tier3/test_workflow.py:123
↓ 1 callers
Method
generateTickLabels
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
generate_one_case
Create exactly one new eval case without overwriting an existing dataset.
src/skillevaluator/tier3/generate_dataset.py:876
↓ 1 callers
Function
generated_output_marker_payload
Return marker bytes signed for one canonical public destination.
src/skillevaluator/tier3/output_provenance.py:537
↓ 1 callers
Method
get
(self, path)
tests/ci/test_prepare_comments.py:35
↓ 1 callers
Method
getAfterBody
(t,e)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
getBeforeBody
(t,e)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
getBody
(t,e)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
getCaretPosition
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
getController
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
getFooter
(t,e)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
getLabelAndValue
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
getLabelItems
(t=this.chart.chartArea)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
getLineWidthForValue
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
getMaxBorderWidth
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
getMaxOffset
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
getMaxOverflow
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
getMaxOverflow
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
getMaximumSize
(t,e,i,s)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
getMeta
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
getPadding
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
getPlugin
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
getRange
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
getScale
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
getScaleForId
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
getTickLimit
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
getTitle
(t,e)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
getValueForPixel
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Method
getVisibleDatasetCount
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callers
Function
get_all_tool_calls
Extract all tool calls with function name, arguments, and observation text. Returns ``[{"fn": str, "args": dict, "args_text": str, "obs": str}]``
src/skillevaluator/tier3/eval_core/atif_helpers.py:60
↓ 1 callers
Method
get_api_resources
(self, **_kwargs)
tests/test_harbor_gke_mode.py:293
← previous
next →
8,601–8,700 of 24,741, ranked by callers