MCPcopy Create free account

hub / github.com/NVIDIA/SkillEvaluator / functions

Functions24,741 in github.com/NVIDIA/SkillEvaluator

Functionreport
(args, files)
tests/validators/test_private_dependency_audit.py:432
Methodreport
(status: str, message: str, *, problem: bool)
src/skillevaluator/validators/security.py:5627
Methodreport_late_cleanup_failure
( completed_cleanup: asyncio.Task[None], )
src/skillevaluator/tier3/harbor/secure_docker_environment.py:1493
Methodreport_on_copy
(args, **kwargs)
tests/validators/test_artifact_dir_exclusion.py:249
Functionreport_url
Accept a default public URL, or the exact private URL verified by GitHub. ``verified_private_url`` must come from ``private_pages_url`` using an
src/skillevaluator/_ci_onboarding_pages.py:64
Functionreports
(tmp_path_factory)
tests/reporting/test_report_browser.py:144
Functionrepository
(tmp_path)
tests/test_ci_onboarding.py:27
Functionrepository
(tmp_path)
tests/ci/test_select_changed_skills.py:36
Functionrepository_root
(path: Path)
src/skillevaluator/_ci_onboarding_git.py:76
Functionrepresent_string
(dumper, value)
src/skillevaluator/_ci_onboarding_git.py:225
Functionrequest_env
(monkeypatch)
tests/ci/test_gitlab_feedback_request.py:28
Functionrequire
(condition, message)
tests/ci/test_feedback.py:1591
Functionrequire_clean
(repo: Path)
src/skillevaluator/_ci_onboarding_git.py:229
Functionrequire_identity
Fail before changing GitHub settings if setup cannot create commits.
src/skillevaluator/_ci_onboarding_git.py:234
Functionrequire_resources
(_path: Path, _required_bytes: int, **kwargs: object)
tests/test_harbor_secure_docker_environment.py:4296
Functionrescue_blocked_cleanup
()
tests/tier3/test_judge_failure_artifacts.py:694
Functionreset
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
Methodreset
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
Functionresistant_close
(self)
tests/tier3/test_judge_failure_artifacts.py:673
Functionresolve
()
src/skillevaluator/tier3/harbor/nvidia_build_bridge.py:552
Functionresolve
(host, port, timeout)
tests/validators/test_private_endpoint_resolution.py:34
Functionresolve_alias
(provider, model_id, *, timeout_seconds)
tests/test_harbor_runtime_preflight.py:905
Functionresolve_gateway
(host, *args, **kwargs)
tests/test_model_catalog.py:832
Functionresolve_mode
Resolve the sandbox mode: explicit value, then env var, then ``require``.
src/skillevaluator/tier3/harbor/local_sandbox.py:222
Methodresolve_model_path
(raw_path: object, *, relative_to: Path)
src/skillevaluator/tier3/harbor/secure_docker_environment.py:2081
Functionrespond
(request, **_kwargs)
tests/ci/test_github_admission_workflow.py:65
Functionrestore
(service: str, *, snapshot: object)
tests/test_harbor_secure_docker_environment.py:5906
Functionrestrict_census
Keep only census entries for components SkillEvaluator staged for ``agent``. The census file is writable from inside the sandbox. An entry for a
src/skillevaluator/tier3/plugin_native.py:2497
Methodresult_has_execution_evidence
(result: ValidationResult)
src/skillevaluator/reporting/html.py:3197
Methodresult_texts
The result text plus the string values of JSON inside it, decoded once per call.
src/skillevaluator/tier3/eval_core/plugin_signals.py:1698
Methodretire_delivery
(completed: asyncio.Task[None])
src/skillevaluator/tier3/harbor/local_environment.py:228
Methodretry_base_delay
Return the initial base backoff delay in seconds.
src/skillevaluator/inference/client.py:562
Methodretry_max_delay
Return the maximum delay ceiling in seconds for a retry backoff.
src/skillevaluator/inference/client.py:567
Methodreturncode
(self)
tests/test_harbor_gke_environment.py:711
Functionreusable_feedback
(repository)
tests/test_ci_onboarding_all_tiers.py:44
Functionreversed_glob
(self, pattern, *args, **kwargs)
tests/validators/test_dependency_advisory_findings.py:203
Functionrevoke_allowlist
(*args, **kwargs)
tests/test_model_catalog.py:841
Functionrewrite_during_read
(fd: int, length: int)
tests/test_results_location_legacy_compatibility.py:886
Methodrewrite_named_source
(descriptor: int, size: int)
tests/test_harbor_input_staging.py:624
Methodrgb
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
MethodrgbString
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
Functionroot_exec
( _self: Codex, _environment: object, command: str, env: dict[str, str] | None
tests/test_harbor_local_mode.py:1061
Functionrouting_release
(tmp_path, monkeypatch)
tests/test_ci_onboarding_model_routing.py:20
Methodrows
(self)
src/skillevaluator/plugin_dependencies.py:573
Functionrubric
(path, **kwargs)
tests/cli/test_tier_workflows.py:132
Functionrubric_eval
Run LLM-as-judge rubric evaluation for a skill.
src/skillevaluator/cli.py:3282
Methodrule_with_invalid_yaml
Create a rule file with invalid YAML.
tests/validators/test_rules_schema.py:81
Functionrun
()
src/skillevaluator/tier3/mcp_proof.py:331
Functionrun
(command: list[str], **_kwargs: object)
tests/test_harbor_secure_docker_environment.py:2245
Functionrun
(command, **kwargs)
tests/test_harbor_runtime_preflight.py:151
Functionrun
(args, **kwargs)
tests/test_ci_onboarding_git.py:74
Functionrun
(command, **kwargs)
tests/test_harbor_gke_mode.py:433
Functionrun
(args, **kwargs)
tests/validators/test_target_dependencies.py:20
Functionrun
(args, **kwargs)
tests/validators/test_dependency_advisory_findings.py:44
Functionrun
(args, **kwargs)
tests/validators/test_static_requirements_audit.py:19
Functionrun
(_command, *, env, **_kwargs)
tests/tier3/test_grader_validation.py:595
Functionrun
(argv, **_kwargs)
tests/tier3/test_local_runtime_install.py:42
Methodrun
Run Harbor's agent; fail when its launch command never got the native setup.
src/skillevaluator/tier3/harbor/native_agents.py:188
Methodrun
(self, args, **kwargs)
tests/validators/test_private_format_boundaries.py:32
Methodrun
(self, args, **kwargs)
tests/validators/test_private_dependency_audit.py:40
Functionrun_agent
(**kwargs: Any)
tests/test_tier3_progress.py:4768
Functionrun_agent
(agent)
tests/tier3/test_run_budget.py:259
Functionrun_case
(task_index: int, task_name: str)
src/skillevaluator/tier3/harbor/runner.py:4905
Functionrun_compose
( command: list[str], check: bool = True, timeout_sec: float | None = None, st
tests/test_harbor_secure_docker_environment.py:6015
Methodrun_config
(self)
src/skillevaluator/tier3/plugin_comparisons.py:227
Methodrun_forever
(self, timeout: int | float | None = None)
tests/test_harbor_gke_environment.py:707
Methodrun_forever
(self, timeout: int | float | None = None)
tests/test_harbor_gke_environment.py:932
Functionrun_lane
(ctx: contextvars.Context, lane: Callable[[], None])
tests/test_commands.py:2217
Functionrun_plugin_dedup_scan
A, C-intra, then fresh local-catalog C-inter and B; no public registration.
src/skillevaluator/deduplication/plugin/commands.py:189
Functionrun_probe
()
src/skillevaluator/tier3/harbor/runtime_preflight.py:1407
Functionrun_result
(tmp_path: Path)
tests/reporting/test_tier3_token_usage_reports.py:154
Methodrun_root
(self, tmp_path: Path)
tests/test_harbor_local_sandbox.py:1131
Methodrun_root
(self, tmp_path: Path)
tests/test_harbor_local_sandbox.py:1638
Functionrun_scan
Run one evaluator process like subprocess.run, and end it early when the run aborts. Scan worker threads never see Ctrl-C, and Docker sends it on
ci/run_tier1.py:372
Functionrun_server
()
src/skillevaluator/tier3/harbor/nvidia_build_bridge.py:781
Methodrun_sites
(self)
src/skillevaluator/plugin_component_risk.py:2082
Functionrun_without_file_report
(*_args, **_kwargs)
tests/test_cli.py:472
Methodrunnable
(self)
src/skillevaluator/plugin_mcp.py:99
Methodrunnable
Whether there is anything a runtime arm can load.
src/skillevaluator/tier3/plugin_prepare.py:136
Methodruns_truncated
Whether the run sites were needed and the text runs more than ``MAX_RUN_SITES`` files.
src/skillevaluator/plugin_component_risk.py:2086
Functionruntime_dir
(tmp_path, monkeypatch)
tests/utils/test_scanner_install.py:25
Methods
(t,e,i,s)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
Methods
(t,e)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
Methods
(t,e,i)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
Functionsafe
(value: str)
tests/reporting/test_tier3_token_usage_reports.py:1332
Functionsafety
Make Safety available; set ``state["report"]`` to the JSON it prints.
tests/validators/test_dependency_advisory_findings.py:60
Functionsamefile
(path: Path, other: Path)
tests/tier3/test_decoy_commands.py:230
Functionsample_rule_file
Create a sample valid .mdc rule file per SkillEvaluator spec. Structure: team-rules/<team-name>/<rule-name>.mdc Required fields: alwaysApply,
tests/conftest.py:289
Functionsample_skill_dir
Create a sample valid skill directory per SkillEvaluator spec. Structure: skills/sample-skill/SKILL.md Required fields: name, description
tests/conftest.py:58
Functionsample_workflow_dir
Create a sample valid workflow directory per SkillEvaluator spec. Structure: workflows/<workflow-name>/ Required files: README.md, workflow-r
tests/conftest.py:393
Methodsave
Validate the complete index before an atomic, no-follow local write.
src/skillevaluator/deduplication/plugin/catalog.py:313
Functionscan
(path: Path)
tests/reporting/test_skillspector_reference_summary.py:62
Functionscan
()
tests/utils/test_structured_data.py:181
Functionscan
(path)
tests/validators/test_private_plugin_composition.py:105
Methodscan
(version: str)
tests/validators/test_security.py:11609
Functionscan_plugin_security
Run expanded rules privately while retaining current rm/xargs/link semantics.
src/skillevaluator/tier3/eval_core/plugin_security.py:3919
Functionscan_then_swap
(*args: object, **kwargs: object)
tests/test_harbor_secure_copy.py:293
Functionscandir
(path: Path)
tests/utils/test_secure_fs_platform.py:126
Methodscanner_bin
(self, tmp_path, monkeypatch)
tests/utils/test_tool_runner.py:469
Functionscanners
Resolve every scanner to a fake path and answer its version probe in-process.
tests/test_doctor.py:50
← previousnext →11,801–11,900 of 24,741, ranked by callers