MCPcopy Create free account

hub / github.com/NVIDIA/SkillEvaluator / functions

Functions24,741 in github.com/NVIDIA/SkillEvaluator

↓ 1 callersFunctionprobe_repository_path
Probe ``clone_root / relative`` without following any link. Each component is inspected with ``lstat``; a symlink or reparse point at any lev
src/skillevaluator/plugin_dependencies.py:459
↓ 1 callersFunctionproduce
()
tests/test_harbor_secure_docker_environment.py:4583
↓ 1 callersFunctionprofile_names
Harness names of the profiles in a directory (their ``harness:`` field, which versions are keyed by). Each file is read on its own, so one that w
src/skillevaluator/harness/overlay.py:107
↓ 1 callersFunctionproject
(payload)
tests/reporting/test_report_clarity.py:131
↓ 1 callersFunctionpt
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:7
↓ 1 callersFunctionpublication_source_link_is_generated
Return whether a link entry uses a name that v2 excludes at its position. The digest refuses trees that contain links, but runtime projections st
src/skillevaluator/publication_identity.py:185
↓ 1 callersFunctionqi
(t,e,i,s,n)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctionqn
(t,e,i,s)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctionqo
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctionqualify
( root, suite, cases, output, repeats, concurrency, timeout, split, provid
src/skillevaluator/tier3/grader_validation.py:499
↓ 1 callersFunctionquestion
(number: int, title: str, *content)
src/skillevaluator/ci_onboarding.py:48
↓ 1 callersFunctionra
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctionrate
A proportion and Wilson 95% bounds; undefined when denominator is zero.
src/skillevaluator/tier3/grader_validation.py:282
↓ 1 callersFunctionrate_value
(value: object)
src/skillevaluator/reporting/summary_copy.py:53
↓ 1 callersMethodraw_output
(self, stream: OutputStream)
src/skillevaluator/tier3/harbor/local_environment.py:196
↓ 1 callersFunctionread
(field_name: str, value: Any)
src/skillevaluator/tier3/evals_spec.py:982
↓ 1 callersFunctionread
(start: int, end: int, depth: int, joined: bool)
src/skillevaluator/tier3/eval_core/checks.py:991
↓ 1 callersFunctionread
(name)
ci/feedback.py:158
↓ 1 callersFunctionread_artifact
Validate every member, but deserialize only expected JSON without extraction.
ci/publish_reports.py:329
↓ 1 callersFunctionread_comment
(start: int, end: int)
src/skillevaluator/tier3/eval_core/checks.py:979
↓ 1 callersMethodread_lenient_text
Read the discovered inode with a larger bound and lenient decoding. Clients do not share SkillEvaluator's 1 MiB manifest bound or its strict
src/skillevaluator/plugin_manifest.py:210
↓ 1 callersFunctionread_once
(self, path, *args, **kwargs)
tests/tier3/test_plugin_evidence.py:213
↓ 1 callersFunctionread_receipt
Read exactly one bounded, regular execution.jwt member without extraction.
ci/verify_provenance.py:68
↓ 1 callersFunctionread_rollout_failures
Map each task folder name to the failure messages Gym recorded in ``<stem>_failures.jsonl``.
src/skillevaluator/tier3/nemo_gym/results.py:64
↓ 1 callersMethodread_script_bytes
Whole, bounded, anchored, no-follow read of a script a hook runs; hard links are allowed. A hook script is only scanned for evidence (no file
src/skillevaluator/plugin_paths.py:206
↓ 1 callersFunctionread_skill_models
Read each skill's retained JSON once, so every view of a run shares one parse.
ci/report_views.py:143
↓ 1 callersMethodread_text
Read the discovered inode through the anchored plugin root descriptor.
src/skillevaluator/plugin_manifest.py:206
↓ 1 callersFunctionreadiness_rows
Return ``(check, pass|warn|fail, detail)`` rows for Tier 1 or Tier 2. Tier 1 reports the external scanner each selected check runs. Tier 2 re
src/skillevaluator/doctor.py:207
↓ 1 callersMethodreconcile
(self, declared_bytes: int, actual_bytes: int)
src/skillevaluator/embedding/extractor.py:156
↓ 1 callersFunctionrecord
(trial: object, name: object, condition: str)
src/skillevaluator/reporting/harbor_viewer.py:140
↓ 1 callersFunctionrecord
(name)
tests/cli/test_validate_defaults.py:66
↓ 1 callersFunctionrecord
(run_id, status)
tests/ci/test_publish_reports.py:1804
↓ 1 callersFunctionrecord_failure
(variant: str, failures: list[str])
src/skillevaluator/tier3/harbor/runner.py:5186
↓ 1 callersFunctionrecorded_skill_name
Return the skill name the run recorded in ``result.json``. The publication target that belongs to this run (its ``run_id`` names the director
src/skillevaluator/evaluation/tier3_feedback_chat.py:108
↓ 1 callersMethodrecords
(self, value: object)
src/skillevaluator/reporting/plugin_static.py:154
↓ 1 callersFunctionreference_caveat_metadata
Return honest warning metadata only for the verified 2.x report contract.
src/skillevaluator/skillspector_reference_caveats.py:51
↓ 1 callersFunctionreference_suggestion
The suggestion of an AE1 finding: what was not inspected, why, and what to do. SkillSpector's own remediation is kept unless it is missing or the
src/skillevaluator/skillspector_references.py:376
↓ 1 callersFunctionreference_summary
Count the referenced artifacts and distinct reference lines behind *findings*' AE1 evidence. A finding counts when its metadata holds ``skillspec
src/skillevaluator/skillspector_references.py:411
↓ 1 callersFunctionreferenced_report_paths
Return the *candidates* reachable from agent control files. Control files (by role, plus executable components) seed a walk that follows text
src/skillevaluator/validators/skillspector_scope.py:952
↓ 1 callersFunctionrefresh_signal
()
src/skillevaluator/evaluation/tier3_report.py:1616
↓ 1 callersFunctionrefreshed_coverage
(item: dict[str, Any])
src/skillevaluator/reporting/insights_view.py:136
↓ 1 callersFunctionrefusal
(severity: Severity)
tests/test_commands.py:3446
↓ 1 callersFunctionrefuse
(kind: str, name: str, message: str | None)
src/skillevaluator/tier3/plugin_prepare.py:412
↓ 1 callersMethodregister_connection
(self, connection: Any)
src/skillevaluator/tier3/harbor/nvidia_build_bridge.py:481
↓ 1 callersMethodregister_response
(self, response: Any)
src/skillevaluator/tier3/harbor/nvidia_build_bridge.py:487
↓ 1 callersFunctionregular
(name: str)
ci/diagnostics.py:101
↓ 1 callersMethodreleaseContext
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctionrelevant
(value: Any)
src/skillevaluator/tier3/baseline_store.py:140
↓ 1 callersFunctionreliability_summary
Report pass@k next to pass^k (every one of the k attempts passed). pass@k keeps its existing meaning. pass^k needs all k attempts to be obser
src/skillevaluator/tier3/harbor/stats.py:1173
↓ 1 callersMethodremoveEventListener
(t,e)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctionremove_output_reservation_if_identity_matches
Clean an exact new reservation; fallback platforms require it to be empty.
src/skillevaluator/tier3/output_provenance.py:748
↓ 1 callersMethodremoves
(self)
src/skillevaluator/evaluation/dataset_case_removal.py:262
↓ 1 callersFunctionremoves_dataset_case
True when ``text`` advises taking a dataset case out of the dataset (deleting, excluding, replacing it). ``case_ids`` are the ids of the dataset
src/skillevaluator/evaluation/dataset_case_removal.py:547
↓ 1 callersFunctionrender
(name: str)
tests/reporting/test_tier3_token_usage_reports.py:645
↓ 1 callersFunctionrender
(_skill_path: Path, target: Path, **kwargs: Any)
tests/tier3/test_view_results_feedback.py:225
↓ 1 callersMethodrender_all
Render multiple validation results to string. Args: results: List of ValidationResults to render Returns: St
src/skillevaluator/reporting/base.py:2686
↓ 1 callersMethodrender_all
Render all results to Markdown with summary.
src/skillevaluator/reporting/markdown.py:216
↓ 1 callersFunctionrender_element
(element: str)
src/skillevaluator/tier3/eval_core/codex_tool_call_normalizer.py:1052
↓ 1 callersFunctionrender_files
( release: dict, roots: list[str], score: int, scan_mode: str, branch: str, name: str,
src/skillevaluator/ci_onboarding.py:187
↓ 1 callersFunctionrender_markdown
Render the required gate, every tier status, and actual native evidence links.
ci/tier_manifest.py:367
↓ 1 callersFunctionrender_next_steps
Print the run-level next steps under the case summary.
src/skillevaluator/tier3/next_steps.py:281
↓ 1 callersFunctionrender_reports
Write a short Actions summary, detailed Markdown and a PR comment. Optional context keys: run_url, commit, image, report_url, llm_enabled, ci_con
ci/report_views.py:611
↓ 1 callersFunctionrender_templates
( output: Path, workflow_ref: str, image: str, repository: str = "NVIDIA/SkillEvaluator",
ci/render_templates.py:22
↓ 1 callersFunctionrendered
(repository, head_repository, head_branch, run_id, head_sha)
tests/ci/test_all_tier_workflows.py:381
↓ 1 callersMethodreplace
(match: re.Match[str])
src/skillevaluator/tier3/harbor/local_environment.py:1972
↓ 1 callersFunctionrepresented
(step: dict[str, Any], card: dict[str, Any])
src/skillevaluator/reporting/html.py:1636
↓ 1 callersFunctionrequire_bound_evidence
( tier_results: list[ValidationResult], tier_label: str, )
src/skillevaluator/reporting/base.py:2489
↓ 1 callersFunctionrequire_bounded_llm_string
Return ``value`` when it is a string of at most ``max_chars`` characters. Nothing is coerced: a number, list, mapping or ``None`` is an error, so
src/skillevaluator/inference/types.py:57
↓ 1 callersFunctionrequire_supported_platform
Return the supported host system or reject local mode before overrides.
src/skillevaluator/tier3/harbor/local_sandbox.py:161
↓ 1 callersMethodreserve
(self, file_path: Path, declared_bytes: int)
src/skillevaluator/embedding/extractor.py:141
↓ 1 callersFunctionresolve
()
src/skillevaluator/model_catalog.py:260
↓ 1 callersMethodresolveNamedOptions
(t,e,i,s=[""])
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctionresolve_digest
(image: str, revision: str, *, token: str = "", actor: str = "")
ci/release_image.py:25
↓ 1 callersFunctionresolve_provider
()
tests/tier3/test_dataset_auto_grounding.py:766
↓ 1 callersFunctionresolve_rules_path
Return path as-is for rules (can be file or directory).
src/skillevaluator/cli_core.py:129
↓ 1 callersFunctionrestore_original_dataset
()
src/skillevaluator/tier3/generate_dataset.py:1972
↓ 1 callersFunctionresult_has_publication_evidence
Return whether a result came through a recognized built-in tier wrapper.
src/skillevaluator/publication_evidence.py:108
↓ 1 callersFunctionresult_matches_publication_target
Return whether one result is bound to the selected exact source.
src/skillevaluator/reporting/base.py:978
↓ 1 callersFunctionresults
(blocking: bool)
tests/reporting/test_report_redesign.py:293
↓ 1 callersFunctionresults_help
(name: str, full: bool)
src/skillevaluator/ci_onboarding.py:65
↓ 1 callersFunctionretain
(run: _PackageRun)
src/skillevaluator/plugin_component_risk.py:2626
↓ 1 callersFunctionretain
()
ci/run_tiers.py:455
↓ 1 callersFunctionretain_findings
(findings: list[Finding], ecosystem: str)
src/skillevaluator/plugin_dependency_audit.py:664
↓ 1 callersFunctionretained_rows
(value: object)
src/skillevaluator/reporting/presentation.py:206
↓ 1 callersFunctionreward
(command: str)
tests/tier3/test_security_finding_evidence.py:891
↓ 1 callersFunctionreward
(*, planted=True, leaked=False, findings=())
tests/tier3/test_private_runtime_evidence.py:86
↓ 1 callersFunctionreward
(case: str, **overrides: float | None)
tests/tier3/test_baseline_dimension_applicability.py:15
↓ 1 callersFunctionrewards
(arm)
tests/reporting/test_declarative_coverage.py:409
↓ 1 callersFunctionrewritten
(source: str, spans: list[tuple[int, int]], rewrite: Callable[[str], str])
src/skillevaluator/tier3/eval_core/checks.py:1091
↓ 1 callersFunctionri
(t,e="x")
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctionrn
(t,{plugin:e,local:i},s,n)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctionrollout_failure_text
Return why a Gym rollout failed, or an empty string when its verifier ran.
src/skillevaluator/tier3/nemo_gym/results.py:109
↓ 1 callersFunctionrows
(second_type: str)
tests/test_harbor_metrics_truth.py:528
↓ 1 callersFunctionrs
(t,e,i,s)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunctionrule_traits
How SkillEvaluator's native adapters stage one rule (``tier3.plugin_native``). A rule without frontmatter is always on. With frontmatter: ``a
src/skillevaluator/plugin_context_cost.py:226
↓ 1 callersMethodrules
(self)
src/skillevaluator/plugin_discovery.py:887
↓ 1 callersFunctionrun
(args: list[str], *, cwd: Path | None = None, optional: bool = False, timeout: int = 60)
src/skillevaluator/_ci_onboarding_git.py:36
↓ 1 callersFunctionrun
(command: list[str], log: Path, expected_exit: int)
scripts/demo_starter.py:37
↓ 1 callersFunctionrun
Run selected skills; advisory mode only relaxes complete policy verdicts. ``execute`` is called like subprocess.run. The default, run_scan, also
ci/run_tier1.py:525
↓ 1 callersFunctionrun
()
tests/test_nemo_gym_backend.py:1571
← previousnext →9,001–9,100 of 24,741, ranked by callers