MCPcopy Create free account

hub / github.com/NVIDIA/SkillEvaluator / functions

Functions24,741 in github.com/NVIDIA/SkillEvaluator

↓ 1 callersMethodget_fallback_response
Return a safe fallback result. Override in subclasses.
src/skillevaluator/inference/client.py:903
↓ 1 callersMethodget_fallback_response
(self, **_kwargs)
tests/inference/test_llm_client.py:1822
↓ 1 callersMethodget_file_extension
(self)
src/skillevaluator/reporting/sarif_reporter.py:388
↓ 1 callersMethodget_file_extension
Return the default file extension for this reporter's output. Returns: File extension including the dot (e.g., '.json', '.html')
src/skillevaluator/reporting/base.py:2716
↓ 1 callersMethodget_file_extension
(self)
src/skillevaluator/reporting/junit_reporter.py:482
↓ 1 callersFunctionget_skill_name_from_path
Extract skill name from path. Args: skill_path: Path to skill directory Returns: Skill name (directory name)
src/skillevaluator/utils/helpers.py:261
↓ 1 callersMethodget_system_prompt
Return the system-role prompt. Override in subclasses.
src/skillevaluator/inference/client.py:887
↓ 1 callersMethodget_version_command
(self)
src/skillevaluator/tier3/harbor/hermes_agent.py:46
↓ 1 callersMethodgetcode
(self)
tests/ci/test_gitlab_feedback_relation.py:20
↓ 1 callersMethodgetresponse
(self)
src/skillevaluator/model_catalog.py:236
↓ 1 callersFunctiongi
(t,e,i,s)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctiongit
(directory, *args)
src/skillevaluator/tier3/grader_validation.py:471
↓ 1 callersFunctiongit
(*args)
tests/test_script_invocation_differential.py:63
↓ 1 callersFunctiongithub_benchmark_publish
Authenticate evidence, regenerate cards, then propose only eligible cards. No source checkout or artifact Markdown is read. Updates fast-forward
ci/benchmark_publish.py:112
↓ 1 callersFunctiongithub_feedback
Authenticate immutable producer identity and upsert current same-repo PR feedback.
ci/feedback.py:435
↓ 1 callersFunctiongitignore_entry_for_skill_results
Return a repo-root-relative ignore entry for a skill's generated results.
src/skillevaluator/tier3/results_location.py:1153
↓ 1 callersFunctiongitlab_config_problem
Mirror ci/feedback.py validate_gitlab_config for the default-branch root config.
src/skillevaluator/_ci_onboarding_all_tiers.py:881
↓ 1 callersFunctiongitlab_feedback
Bind the trusted downstream job to one current same-project MR producer.
ci/feedback.py:813
↓ 1 callersFunctiongitleaks_url
(key: tuple[str, str])
src/skillevaluator/utils/scanner_install.py:143
↓ 1 callersFunctiongoal_reward
(case_id: str, score: float, method: str, step: int | None = None)
tests/test_harbor_metrics_truth.py:745
↓ 1 callersFunctiongroups_by_display_priority
Return a summary's groups with the most severe and most repeated first. ``groups`` stays ordered by ``finding_id`` so machine output is stable.
src/skillevaluator/reporting/finding_summary.py:187
↓ 1 callersFunctiongt
(t,e,i,s)
src/skillevaluator/reporting/assets/chart.umd.min.js:7
↓ 1 callersFunctionguard
(name)
tests/test_baseline_store.py:249
↓ 1 callersFunctionguarded
()
ci/benchmark_publish.py:277
↓ 1 callersFunctionha
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodhandleEvent
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodhandleTickRangeOptions
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctionhandle_operation
Handle a task operation with persisted state. This is the main entry point for module usage. Args: args: Command line style arg
src/skillevaluator/tier3/reference_skills/task-list/scripts/tasks.py:420
↓ 1 callersMethodhandle_starttag
(self, tag: str, attrs: list[tuple[str, str | None]])
src/skillevaluator/validators/markdown.py:177
↓ 1 callersMethodhandle_starttag
(self, tag: str, attrs: list[tuple[str, str | None]])
scripts/ci/check_public_benchmarks.py:532
↓ 1 callersMethodhandle_starttag
(self, tag: str, attrs: list[tuple[str, str | None]])
scripts/ci/check_public_benchmarks.py:599
↓ 1 callersMethodhandle_starttag
(self, tag: str, attrs: list[tuple[str, str | None]])
scripts/ci/check_public_benchmarks.py:631
↓ 1 callersMethodhandle_starttag
(self, tag: str, attrs: list[tuple[str, str | None]])
scripts/ci/check_public_benchmarks.py:656
↓ 1 callersFunctionharbor_job_passed
Return whether a complete logical attempt meets the required checks. This deliberately shares collection's failure filtering and multi-step r
src/skillevaluator/tier3/harbor/collector.py:4812
↓ 1 callersFunctionhas_controls
(value: str)
src/skillevaluator/reporting/terminal_styles.py:40
↓ 1 callersMethodhash_tasks
Hash the tasks the runner emitted for ``agent`` (``{arm: [task dir, ...]}``) into its arm's ``content``.
src/skillevaluator/tier3/harbor/loose_parts_arm.py:123
↓ 1 callersFunctionheartbeat
()
tests/test_harbor_secure_docker_environment.py:893
↓ 1 callersMethodheartbeat
(self)
src/skillevaluator/tier3/harbor/progress.py:921
↓ 1 callersMethodheartbeat
(self)
tests/test_tier3_progress.py:1077
↓ 1 callersFunctionhi
(t,e,i,s,n)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodhide
(t,e)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctionhistory_directories
Keep shared ordering, including reservations without completion artifacts.
src/skillevaluator/tier3/history.py:36
↓ 1 callersFunctionhistory_preflight
(name: str)
src/skillevaluator/ci_onboarding.py:484
↓ 1 callersFunctionhn
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctionho
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctionhook_dialect
The hook dialect of a hooks file: by manifest format, and by namespace for Agent Plugins.
src/skillevaluator/plugin_component_risk.py:537
↓ 1 callersMethodhooks
(self)
src/skillevaluator/plugin_discovery.py:940
↓ 1 callersFunctionhost_name_is_allowlisted
True when a policy entry names this host (exact name or ``*.suffix``). Only host names match here: IP literals and CIDR entries are checked again
src/skillevaluator/validators/mcp_static.py:3036
↓ 1 callersFunctionidentity
(trials: list[dict[str, Any]])
src/skillevaluator/tier3/harbor/resource_usage.py:63
↓ 1 callersMethodidentity
``(server, tool)`` of an MCP tool call, with the server mapped to its declared name when known. Recognized spellings: ``mcp__<server>__<tool>
src/skillevaluator/tier3/eval_core/plugin_signals.py:2193
↓ 1 callersFunctionidentity_allowed
(workflow: dict, job: dict)
src/skillevaluator/_ci_onboarding_workflows.py:66
↓ 1 callersFunctionidentity_dataset_digest
Hash staged baseline entries without fields that identify one comparison arm.
src/skillevaluator/tier3/baseline_store.py:82
↓ 1 callersFunctioninit_harbor_task
Create a BYOT Harbor starter template under evals/harbor/.
src/skillevaluator/tier3/commands.py:527
↓ 1 callersMethodinitialize
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctioninitialize_history
(repo: Path, name: str)
src/skillevaluator/ci_onboarding.py:584
↓ 1 callersFunctioninnermost
()
src/skillevaluator/tier3/eval_core/script_invocation.py:2880
↓ 1 callersFunctioninspect
(path, scope)
tests/validators/test_private_plugin_composition.py:356
↓ 1 callersFunctioninspect_bound_gcp_service_account
Return the bound GCP identity if the Kubernetes ServiceAccount has Workload Identity annotations.
src/skillevaluator/tier3/harbor/gke_environment.py:457
↓ 1 callersFunctioninspect_candidate
( verifier_dir: Path, *, location: str, )
src/skillevaluator/tier3/harbor/collector.py:992
↓ 1 callersFunctioninspect_fragment
(content: str, base_line: int)
scripts/ci/check_public_benchmarks.py:956
↓ 1 callersFunctioninspect_plugin
Check that Tier 1, Tier 2 and Tier 3 agree; scanner findings are reported, never hidden.
scripts/ci/smoke_openclaw_plugins.py:44
↓ 1 callersMethodinstall
(self, environment: BaseEnvironment)
src/skillevaluator/tier3/harbor/installed_agents.py:144
↓ 1 callersFunctioninstall_agent
(agent: str)
ci/bootstrap_tiers.py:26
↓ 1 callersFunctioninstall_gitleaks
Download, verify and install the pinned Gitleaks binary; return an error or None.
src/skillevaluator/utils/scanner_install.py:164
↓ 1 callersFunctionintegration_claim
Eligibility and advisory integration claim, never an evaluation gate. As in the source contract, an interval beginning at +.05 is real and one
src/skillevaluator/tier3/harbor/stats.py:1737
↓ 1 callersFunctionintegration_completeness
Check that the Integration arms cover the same cases with enough attempts. Coverage counts only scoreable attempts. ``complete`` requires every
src/skillevaluator/tier3/harbor/stats.py:1471
↓ 1 callersFunctioninter_plugin_verdict_to_severity
(verdict)
src/skillevaluator/deduplication/plugin/llm_analyzer.py:96
↓ 1 callersFunctioninvalid
(*_args)
tests/tier3/test_decoy_workspace.py:142
↓ 1 callersFunctioninvalid_strings
(*names: str)
src/skillevaluator/tier3/harbor/runner.py:2304
↓ 1 callersFunctioninvoke
(call_prompt: str)
src/skillevaluator/tier3/eval_core/llm_judge.py:585
↓ 1 callersFunctioninvoke
(attempt, call_prompt)
src/skillevaluator/tier3/harbor/templates/eval.py:3162
↓ 1 callersMethodisAttached
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodisPluginEnabled
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctionis_allowed
(finding: BoundaryFinding)
scripts/check_oss_boundary.py:882
↓ 1 callersFunctionis_artifact_wide_issue
Return whether a SkillSpector rule applies to every shipped file.
src/skillevaluator/validators/skillspector_scope.py:405
↓ 1 callersFunctionis_blob
(item: dict[str, Any], *, conclusion: bool)
src/skillevaluator/reporting/insights_view.py:124
↓ 1 callersFunctionis_cross_component_case
Whether a case can show the plugin's parts working together. A cross-component case is marked ``cross_component: true`` and names two or more
src/skillevaluator/tier3/eval_core/plugin_signals.py:1248
↓ 1 callersFunctionis_newer
(candidate: dict, existing: dict | None)
ci/publish_reports.py:424
↓ 1 callersFunctionis_noop_summary
Recognize only a complete, neutral Git changed-selection receipt.
ci/report_views.py:319
↓ 1 callersMethodis_open
(self)
tests/test_harbor_gke_environment.py:704
↓ 1 callersFunctionis_pep440_version
Whether *text* is one valid PEP 440 version, in any spelling PEP 440 accepts.
src/skillevaluator/validators/mcp_static.py:2270
↓ 1 callersFunctionis_remote_npm_spec
Whether an npm spec is fetched from git or a URL (``github:o/r``, ``git+https://...``, ``o/r``), not the registry.
src/skillevaluator/validators/mcp_static.py:2242
↓ 1 callersFunctionis_remote_pypi_spec
Whether a PyPI spec is fetched from git or a URL (``git+https://...``, ``pkg @ git+https://...``).
src/skillevaluator/validators/mcp_static.py:2247
↓ 1 callersFunctionis_reparse_point
(metadata: os.stat_result)
src/skillevaluator/tier3/harbor/runner.py:3777
↓ 1 callersFunctionissue_report_files
Return the location file and every occurrence file of a SkillSpector issue. The location file comes first. A report without ``occurrences`` names
src/skillevaluator/validators/skillspector_scope.py:414
↓ 1 callersMethoditems
(self)
tests/reporting/test_unified_tier3_report.py:2200
↓ 1 callersFunctioniter_raw_refs
Return the raw ref entries (str or mapping) for a dependency section. ``limit`` is the staging limit (Tier 3 refuses more refs). Tier 1 passes
src/skillevaluator/plugin_dependencies.py:261
↓ 1 callersFunctionji
(t,e,i,n)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctionjn
(t,{inflateAmount:e},i)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctionjob_enabled
(job, env)
tests/ci/test_gitlab_enriched_admission.py:60
↓ 1 callersFunctionjson_nesting_within_limit
Bound structural nesting of *text* without recursively parsing it. Checked before decoding a whole reply, because the decoder's own depth lim
src/skillevaluator/inference/json_span.py:54
↓ 1 callersFunctionjt
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctionkey_at
(limit: int)
tests/evaluation/test_tier3_feedback_chat.py:867
↓ 1 callersMethodkill
(self)
tests/test_harbor_secure_docker_environment.py:3592
↓ 1 callersFunctionkilled
(suffix: str)
tests/tier3/test_token_usage.py:654
↓ 1 callersFunctionko
(t,{min:e,max:i})
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctionkt
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctionla
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethodlabels
(self, key: str, raw: object)
src/skillevaluator/reporting/plugin_runtime.py:92
↓ 1 callersFunctionlatest_frame
()
tests/test_tier3_progress.py:433
← previousnext →8,701–8,800 of 24,741, ranked by callers