MCPcopy Create free account

hub / github.com/NVIDIA/SkillEvaluator / functions

Functions24,741 in github.com/NVIDIA/SkillEvaluator

↓ 1 callersFunctionevaluate
(tier: int, workspace: Path, reports: Path, env: dict[str, str])
ci/run_tiers.py:424
↓ 1 callersFunctionevaluate
(options)
tests/tier3/test_private_comparison_engine_acceptance.py:225
↓ 1 callersFunctionevaluate_prepared_plugin
Evaluate a prepared plugin through the existing engine and remove the operation-owned staging. Results are written under the plugin's own ``evals
src/skillevaluator/tier3/plugin_execution.py:395
↓ 1 callersFunctionevaluate_qualification
Evaluate distinct-case coverage and existing attempt-level rates together.
src/skillevaluator/tier3/grader_policy.py:263
↓ 1 callersFunctionevaluate_skill
Run one evaluator process; return row fields, its report and whether time ran out. Scan workers call this concurrently. Raw scanner output stays
ci/run_tier1.py:410
↓ 1 callersFunctionevaluator_timeout_seconds
End the evaluator before the CI job limit so setup and evidence retention fit.
src/skillevaluator/_ci_onboarding_all_tiers.py:68
↓ 1 callersMethodevent_scope
(self, event: str)
src/skillevaluator/plugin_component_risk.py:434
↓ 1 callersFunctionevidence
(text: str)
tests/tier3/test_security_finding_evidence.py:2246
↓ 1 callersMethodexclude
(self, path: Path, reason: str)
src/skillevaluator/embedding/extractor.py:136
↓ 1 callersMethodexec
( self, command: str, cwd: str | None = None, env: dict[str, str] | None = Non
src/skillevaluator/tier3/harbor/secure_docker_environment.py:1957
↓ 1 callersMethodexec
( self, command: str, cwd: str | None = None, env: dict[str, str] | None = Non
src/skillevaluator/tier3/harbor/secure_docker_environment.py:3457
↓ 1 callersMethodexec_as_agent
( self, environment: BaseEnvironment, command: str, env: dict[str, str] | None
src/skillevaluator/tier3/harbor/local_agents.py:246
↓ 1 callersMethodexec_as_agent
( self, environment: BaseEnvironment, command: str, env: dict[str, str] | None
src/skillevaluator/tier3/harbor/local_agents.py:421
↓ 1 callersMethodexec_as_agent
( self, environment: BaseEnvironment, command: str, env: dict[str, str] | None
src/skillevaluator/tier3/harbor/local_agents.py:476
↓ 1 callersMethodexec_with_sensitive_env
( self, command: str, env: dict[str, str] | None = None, **_kw
tests/test_harbor_local_mode.py:721
↓ 1 callersFunctionexecutable_report_paths
Return the scan-relative paths of components SkillSpector marks executable. A path that does not resolve inside the artifact is returned as `
src/skillevaluator/validators/skillspector_scope.py:315
↓ 1 callersFunctionexecute
(_environment, **kwargs)
tests/test_hermes_agent.py:209
↓ 1 callersFunctionexecution_context
(environ: dict[str, str])
ci/run_tier1.py:342
↓ 1 callersFunctionexercise_callback_interrupt
( hostile_command: str, interrupt_secret: str, pid_path: str,
tests/test_harbor_secure_docker_environment.py:8111
↓ 1 callersMethodexit_code
(self)
tests/reporting/test_dashboard_cli.py:36
↓ 1 callersFunctionexplicit
(name: str)
src/skillevaluator/cli.py:4377
↓ 1 callersFunctionexport_history
(history: dict, suffix: str)
src/skillevaluator/tier3/history.py:479
↓ 1 callersMethodextensions
Inventory Agent Plugins client-extension namespaces. A namespace is declared in the manifest ``extensions`` object and/or ships a top
src/skillevaluator/plugin_discovery.py:1101
↓ 1 callersFunctionextract_retry_after
Extract Retry-After header string from an exception if present.
src/skillevaluator/inference/retry.py:151
↓ 1 callersFunctionfa
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctionfactory
(headers=None, timeout=None, auth=None)
src/skillevaluator/tier3/mcp_proof.py:643
↓ 1 callersFunctionfail_after_client_close_starts
()
tests/tier3/test_judge_failure_artifacts.py:740
↓ 1 callersFunctionfail_after_release
()
tests/test_harbor_local_mode.py:3473
↓ 1 callersMethodfail_unfinished
Fail every open stage and finish the run without masking its error. ``interrupted`` reports Ctrl+C or cancellation rather than an unexpected
src/skillevaluator/tier3/harbor/runner.py:5369
↓ 1 callersFunctionfailed
(reason: str)
src/skillevaluator/tier3/generate_dataset.py:1210
↓ 1 callersFunctionfailed_report
()
tests/ci/test_publish_reports.py:132
↓ 1 callersFunctionfailed_summary
(*, advisory_downgraded=False)
tests/ci/test_publish_reports.py:110
↓ 1 callersFunctionfake_call_public_llm
(prompt, *args, **kwargs)
tests/tier3/test_behavior_evidence.py:446
↓ 1 callersFunctionfchmod
(descriptor: int, mode: int)
tests/test_harbor_secure_copy.py:660
↓ 1 callersFunctionfetch_openapi_spec
Fetch and parse an OpenAPI spec.
src/skillevaluator/tier3/reference_skills/api-caller/scripts/call_api.py:95
↓ 1 callersFunctionfetch_signing_keys
Fetch only GitHub's fixed public key endpoint, without credentials.
ci/verify_provenance.py:44
↓ 1 callersFunctionfetch_spec
Fetch OpenAPI spec from URL.
src/skillevaluator/tier3/reference_skills/api-caller/scripts/parse_openapi.py:18
↓ 1 callersFunctionfind_bundled_plugin_skills
Find live skills under a plugin's ``skills/`` directory.
src/skillevaluator/utils/helpers.py:116
↓ 1 callersFunctionfind_evals_config
Return the first supported evals config file for a skill, if present. A broken symlink counts as present, so loading rejects it instead of ru
src/skillevaluator/tier3/evals_config.py:141
↓ 1 callersFunctionfind_offenders
( roots: list[Path], *, require_source_provenance: bool = False, expected_source: ExpectedSour
scripts/ci/check_public_benchmarks.py:2048
↓ 1 callersFunctionfind_operation
Find an operation in the OpenAPI spec by operation ID.
src/skillevaluator/tier3/reference_skills/api-caller/scripts/call_api.py:103
↓ 1 callersFunctionfind_repo_root
Return the enclosing catalog root by layout, or ``plugin_dir`` itself.
src/skillevaluator/plugin_dependencies.py:97
↓ 1 callersMethodfinish
(self)
src/skillevaluator/reporting/plugin_static.py:228
↓ 1 callersMethodfinish
(self)
src/skillevaluator/reporting/plugin_runtime.py:111
↓ 1 callersMethodfinish
Flush the suffix once later input cannot complete a secret.
src/skillevaluator/tier3/harbor/stream_redaction.py:267
↓ 1 callersMethodfinish
(self, *, stderr_suffix: str = "")
src/skillevaluator/tier3/harbor/local_environment.py:248
↓ 1 callersMethodfirst
The hook of one of ``keys`` among the sites added from position ``start`` on (by set lookups).
src/skillevaluator/plugin_component_risk.py:2906
↓ 1 callersMethodfit
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodflag_value_end
Return where the value the flag rule reads at *start* ends (None: it reads none there). The value is _FINDING_EVIDENCE_FLAG_VALUE, or for a n
src/skillevaluator/tier3/eval_core/checks.py:4905
↓ 1 callersMethodflatten_mapping
(self, node: MappingNode)
src/skillevaluator/utils/structured_data.py:67
↓ 1 callersFunctionflush
()
src/skillevaluator/tier3/eval_core/shell_lexing.py:87
↓ 1 callersFunctionflush
(last: int)
src/skillevaluator/deduplication/utils/chunker.py:99
↓ 1 callersFunctionflush_logs
(*, final: bool = False)
ci/run_tier1.py:745
↓ 1 callersFunctionfo
(t,e,i={})
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctionfork_pull
(head_sha="a" * 40, *, base_sha="d" * 40, repo=None)
tests/ci/test_publish_reports.py:439
↓ 1 callersFunctionfork_record
(**changes)
tests/ci/test_publish_reports.py:428
↓ 1 callersFunctionformat_lint_findings
Return indented lines for the first *limit* script lint findings.
src/skillevaluator/precommit.py:171
↓ 1 callersFunctionformat_report
(stats: dict)
src/skillevaluator/tier3/reference_skills/text-analyzer/scripts/analyze_text.py:41
↓ 1 callersFunctionformat_result
Format result for human-readable output.
src/skillevaluator/tier3/reference_skills/task-list/scripts/tasks.py:284
↓ 1 callersFunctionformat_result_line
Return one compact PASS/FAIL line for a skill.
src/skillevaluator/precommit.py:180
↓ 1 callersMethodformats
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodfrom_entries
(cls, entries: Iterable[str])
src/skillevaluator/plugin_component_risk.py:2731
↓ 1 callersMethodfrom_path
Create structure representation from a workflow path.
src/skillevaluator/models/workflows.py:346
↓ 1 callersFunctionfrontmatter_census_check
The listing check for a frontmatter hook source in the staged plugin, or its ``not_loaded`` row.
src/skillevaluator/tier3/plugin_native.py:781
↓ 1 callersFunctionfs
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctionga
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctiongate_failures
(result, gates)
src/skillevaluator/tier3/grader_validation.py:639
↓ 1 callersMethodgate_failures
Failed requirements independent of finding severity, such as a minimum score.
src/skillevaluator/models/result.py:434
↓ 1 callersFunctiongateway_fallback_403_stream
Fallback on: the CLI swapped models after a cyber refusal, and the gateway answered 403.
tests/claude_refusal_fixtures.py:112
↓ 1 callersFunctiongenerate
(self, skill_path, *, use_llm)
tests/tier3/test_workflow.py:123
↓ 1 callersMethodgenerateTickLabels
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctiongenerate_one_case
Create exactly one new eval case without overwriting an existing dataset.
src/skillevaluator/tier3/generate_dataset.py:876
↓ 1 callersFunctiongenerated_output_marker_payload
Return marker bytes signed for one canonical public destination.
src/skillevaluator/tier3/output_provenance.py:537
↓ 1 callersMethodget
(self, path)
tests/ci/test_prepare_comments.py:35
↓ 1 callersMethodgetAfterBody
(t,e)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodgetBeforeBody
(t,e)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodgetBody
(t,e)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodgetCaretPosition
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodgetController
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodgetFooter
(t,e)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodgetLabelAndValue
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodgetLabelItems
(t=this.chart.chartArea)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodgetLineWidthForValue
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodgetMaxBorderWidth
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodgetMaxOffset
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodgetMaxOverflow
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodgetMaxOverflow
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodgetMaximumSize
(t,e,i,s)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodgetMeta
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodgetPadding
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodgetPlugin
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodgetRange
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodgetScale
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodgetScaleForId
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodgetTickLimit
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodgetTitle
(t,e)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodgetValueForPixel
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodgetVisibleDatasetCount
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctionget_all_tool_calls
Extract all tool calls with function name, arguments, and observation text. Returns ``[{"fn": str, "args": dict, "args_text": str, "obs": str}]``
src/skillevaluator/tier3/eval_core/atif_helpers.py:60
↓ 1 callersMethodget_api_resources
(self, **_kwargs)
tests/test_harbor_gke_mode.py:293
← previousnext →8,601–8,700 of 24,741, ranked by callers