MCPcopy Create free account

hub / github.com/NVIDIA/SkillEvaluator / functions

Functions24,741 in github.com/NVIDIA/SkillEvaluator

↓ 6 callersFunction_audit
(tmp_path, monkeypatch, text, *, returned=None)
tests/validators/test_static_requirements_audit.py:13
↓ 6 callersFunction_authenticated_generated_output_ancestor
Find an authenticated generated-output boundary or reject an unsafe marker.
src/skillevaluator/tier3/harbor/adapter.py:582
↓ 6 callersFunction_await_task_uninterruptibly
Await a cleanup task to completion despite repeated cancellation.
src/skillevaluator/tier3/harbor/local_environment.py:255
↓ 6 callersFunction_await_task_uninterruptibly
Await process cleanup to completion despite repeated cancellation.
src/skillevaluator/tier3/harbor/secure_docker_environment.py:518
↓ 6 callersFunction_baseline_skipped
(agent: Mapping[str, Any])
src/skillevaluator/tier3/case_summary.py:104
↓ 6 callersFunction_bash
(call_id: str, command: str, output: str = "", **extra: Any)
tests/tier3/test_f90_signals_handoff.py:64
↓ 6 callersFunction_build_tree_manifest
Validate a tree before copying (separate for change-detection tests).
src/skillevaluator/tier3/harbor/secure_copy.py:649
↓ 6 callersFunction_call
(command, *, observation="", is_error=None)
tests/tier3/test_declarative_checks.py:29
↓ 6 callersFunction_canary_fd
``words[index]`` is a file descriptor number in front of a redirection operator.
src/skillevaluator/tier3/eval_core/plugin_security.py:858
↓ 6 callersFunction_canary_resolve
Resolve ``path`` against ``cwd``: relative to a workspace root (``.`` for the root), else absolute. ``cwd`` is a value this function returned; a
src/skillevaluator/tier3/eval_core/plugin_security.py:710
↓ 6 callersFunction_canonical_export
(run: Path)
tests/reporting/test_dashboard_data.py:760
↓ 6 callersFunction_capture_prompts
(module: ModuleType, monkeypatch: pytest.MonkeyPatch)
tests/tier3/test_judge_contracts.py:88
↓ 6 callersMethod_card_from
(self, *results: ValidationResult)
tests/test_benchmark_source_provenance.py:831
↓ 6 callersFunction_case
(**fields: Any)
tests/tier3/test_skill_metric_applicability.py:61
↓ 6 callersFunction_catalog
(root: Path, count: int, desc_len: int = 300)
tests/harness/test_overlay.py:325
↓ 6 callersMethod_check_requirements_file
Audit a single requirements.txt for banned/unpinned packages.
src/skillevaluator/validators/hygiene.py:149
↓ 6 callersFunction_claude_call
(call_id: str, fn: str, args: dict[str, Any], result: dict[str, Any])
tests/tier3/test_f90_mcp_execution.py:38
↓ 6 callersFunction_claude_type_issue
(key: str, expected: str, value: Any, *, label: str)
src/skillevaluator/plugin_format_schema.py:470
↓ 6 callersFunction_codex
(*steps: dict[str, Any])
tests/tier3/test_f90_signals_handoff.py:53
↓ 6 callersFunction_codex_read
(call_id: str, *members: str)
tests/tier3/test_f90_signals_handoff.py:73
↓ 6 callersFunction_completed_run
A completed run directory: ``run_config.json`` plus a ``result.json`` owned by the run.
tests/evaluation/test_tier3_feedback_chat.py:43
↓ 6 callersFunction_condition_usable
(data: Mapping[str, Any], variant: str)
src/skillevaluator/tier3/result_display.py:237
↓ 6 callersFunction_contract_mismatch
(agent: Mapping[str, Any])
src/skillevaluator/tier3/case_summary.py:114
↓ 6 callersFunction_convert
(agent_class, events, tmp_path)
tests/tier3/test_opencode_exit_status.py:30
↓ 6 callersMethod_convert_events_to_trajectory
(self, events: list[dict[str, Any]])
src/skillevaluator/tier3/harbor/installed_agents.py:187
↓ 6 callersFunction_copied
(step: dict[str, Any])
tests/tier3/test_trajectory_timing.py:395
↓ 6 callersMethod_declared_values
(self, field_name: str, value: Any)
src/skillevaluator/plugin_discovery.py:287
↓ 6 callersFunction_display_data
(payload: dict[str, Any])
tests/reporting/test_tier3_failure_reasons.py:839
↓ 6 callersFunction_dumped
(result: ValidationResult)
tests/validators/test_plugin_component_risk.py:754
↓ 6 callersFunction_email_findings
(result)
tests/validators/test_pii_grouping.py:36
↓ 6 callersFunction_embedded_payload
(html)
tests/reporting/test_native_report_parity.py:24
↓ 6 callersFunction_embedded_tier3_payload
(html: str)
tests/reporting/test_unified_tier3_report.py:157
↓ 6 callersFunction_entry_from_stat
( parts: tuple[str, ...], kind: str, metadata: os.stat_result, *, digest: str | None = Non
src/skillevaluator/tier3/harbor/secure_copy.py:258
↓ 6 callersFunction_environment_kwargs
(command: list[str])
tests/test_harbor_environment_contract.py:21
↓ 6 callersFunction_evidence_ref
( *, source: str, kind: str, label: str, json_pointer: str | None = None, path: str |
src/skillevaluator/tier3/eval_core/atif_helpers.py:615
↓ 6 callersFunction_exec
(call_id: str, cmd: str, output: str = "", *, code: int = 0)
tests/tier3/test_f90_signals_handoff.py:68
↓ 6 callersFunction_exec
(call_id: str, cmd: str, output: str = "")
tests/tier3/test_f90_signals_conflict.py:61
↓ 6 callersFunction_extract_from_file
Read once, parse frontmatter, and build a bounded content entry. Errors name the manifest by *label*, or else by its path under the scan root.
src/skillevaluator/embedding/extractor.py:333
↓ 6 callersFunction_failing_multi_agent_payload
Two of six with-skill and four of six baseline metrics fail on every trial.
tests/reporting/test_tier3_failure_reasons.py:802
↓ 6 callersFunction_fairness_warnings
(skill: Path)
tests/tier3/test_dataset_baseline_fairness.py:1949
↓ 6 callersFunction_fallback_mode_matches
Check the mode bits that the platform's path-based chmod can set.
src/skillevaluator/tier3/harbor/secure_copy.py:1703
↓ 6 callersMethod_gateway_env
(monkeypatch: pytest.MonkeyPatch, model: str)
tests/validators/test_rubric_eval.py:140
↓ 6 callersFunction_generate_full
Generate the template full-bucket set (three or four cases, no LLM needed). The negative bucket is included only when eval guidance supplies a sa
src/skillevaluator/tier3/generate_dataset.py:617
↓ 6 callersFunction_git
(repo: Path, *args: str)
tests/test_ci_change_classifier.py:20
↓ 6 callersFunction_git_repo
(root: Path, origin: str | None = ORIGIN)
tests/validators/test_plugin_dependencies.py:38
↓ 6 callersFunction_handoff
(trajectory: dict[str, Any], *handoffs: dict[str, Any], arm: str = ARM_WITH_SKILL)
tests/tier3/test_f90_signals_handoff.py:78
↓ 6 callersFunction_has_unsupported_native_codex_call
(tool_calls: list[dict[str, Any]])
src/skillevaluator/tier3/eval_core/checks.py:6988
↓ 6 callersFunction_heredoc_operator_index
Index of the first ``<<`` that is really a heredoc or here-string operator. Quoted text and arithmetic are skipped, so neither ``echo '<<'`` nor
src/skillevaluator/tier3/eval_core/script_invocation.py:2125
↓ 6 callersFunction_html_coverage_notes
(report: str)
tests/reporting/test_tier3_incomplete_arms.py:138
↓ 6 callersFunction_init
(**overrides: Any)
tests/tier3/test_private_loose_source.py:586
↓ 6 callersFunction_initialize_harbor_context
(environment: object)
tests/test_secure_docker_environment.py:25
↓ 6 callersFunction_inspect_skillspector_baseline
Return the reportable facts of an operator-selected baseline and any blocking error. SkillSpector validates the full schema itself. SkillEvaluato
src/skillevaluator/validators/security.py:919
↓ 6 callersFunction_int
(value: Any)
src/skillevaluator/tier3/eval_core/runtime_evidence.py:58
↓ 6 callersFunction_invalid_checks
(case: str)
tests/validators/test_rubric_eval.py:1233
↓ 6 callersFunction_inventory
(root: Path)
tests/tier3/test_plugin_prepare.py:33
↓ 6 callersFunction_is_link
(metadata: os.stat_result)
src/skillevaluator/publication_identity.py:90
↓ 6 callersFunction_is_output_redirect
(token: str)
src/skillevaluator/tier3/eval_core/script_invocation.py:48
↓ 6 callersFunction_is_str_list
(value: Any, *, non_empty: bool = False)
src/skillevaluator/plugin_format_schema.py:370
↓ 6 callersFunction_is_symlink_or_reparse
Return whether *path* redirects traversal through a link or reparse point.
src/skillevaluator/embedding/extractor.py:298
↓ 6 callersFunction_jpeg_bytes
Return the 1x1 grey baseline JPEG that the path-reference SkillSpector fixture scanned.
tests/validators/test_security.py:8889
↓ 6 callersFunction_judge_model_config
Describe the configured standard-grading judge before any provider fallback.
src/skillevaluator/tier3/harbor/runner.py:3075
↓ 6 callersFunction_link_or_skip
(link, target, *, hard=False, target_is_directory=False)
tests/tier3/test_evals_config.py:31
↓ 6 callersFunction_load_script
(module_name: str)
tests/test_reference_api_caller.py:26
↓ 6 callersMethod_local_command_guardrail_reason
Advisory defense-in-depth checks with friendly error messages. The security boundary is the OS sandbox in ``local_sandbox``; these st
src/skillevaluator/tier3/harbor/local_environment.py:1649
↓ 6 callersFunction_lock
()
tests/test_oss_packaging.py:90
↓ 6 callersFunction_logical_score
(value: Any)
src/skillevaluator/tier3/harbor/stats.py:123
↓ 6 callersFunction_make_fake_response
(vectors: list[list[float]])
tests/embedding/test_client.py:92
↓ 6 callersFunction_manifest
()
tests/tier3/test_decoy_commands.py:19
↓ 6 callersFunction_mapping
(value: object)
src/skillevaluator/reporting/native_evidence.py:66
↓ 6 callersFunction_marketplace
(root: Path, plugins: list[dict], **extra)
tests/test_plugin_manifest.py:99
↓ 6 callersFunction_metadata_field_matches
( metadata_lines: list[tuple[int, str]], field: str, )
scripts/ci/check_public_benchmarks.py:1130
↓ 6 callersFunction_negative_test_allowlist
(path: Path)
tests/test_oss_boundary.py:1164
↓ 6 callersFunction_never_activated
(agent: dict[str, Any])
src/skillevaluator/evaluation/tier3_report.py:71
↓ 6 callersFunction_normalize_path
(value: str)
src/skillevaluator/tier3/eval_core/plugin_signals.py:2258
↓ 6 callersFunction_observer
(job, *, final=None)
tests/tier3/test_private_usage_recovery_review2.py:15
↓ 6 callersMethod_openai_request
(judge: RubricJudge)
tests/validators/test_rubric_eval.py:147
↓ 6 callersFunction_outcomes
(contents: list[str], *, codex: bool)
tests/tier3/test_f90_mcp_failure_text.py:27
↓ 6 callersFunction_outputs
(tmp_path)
tests/tier3/test_skill_metric_applicability.py:55
↓ 6 callersFunction_overall_score
(reward: dict[str, Any])
src/skillevaluator/tier3/harbor/collector.py:4335
↓ 6 callersFunction_override_findings
( issues: Iterable[OverrideIssue], file_path: str, *, where: str, component: tuple[str, st
src/skillevaluator/plugin_config_risk.py:40
↓ 6 callersFunction_path_is_canonically_contained
Require exact-case lexical and resolved containment for safety exceptions.
src/skillevaluator/tier3/harbor/adapter.py:569
↓ 6 callersFunction_pick_best_agent
Select the same best agent identity as the canonical Tier 3 report.
src/skillevaluator/tier3/harbor/report.py:125
↓ 6 callersFunction_plugin
(tmp_path: Path)
tests/validators/test_skillspector_hook_surface.py:206
↓ 6 callersFunction_quality_result
(quality_config: dict | None)
tests/reporting/test_quality_config_reporting.py:16
↓ 6 callersFunction_raw_trajectory_sha256
(trajectory: dict[str, Any])
src/skillevaluator/tier3/harbor/collector.py:2159
↓ 6 callersFunction_record_installed_agent_exec
(monkeypatch: pytest.MonkeyPatch)
tests/tier3/test_harbor_local_agents.py:139
↓ 6 callersFunction_recorded_pair_script
( responses: list[tuple[str | None, str | None]], calls: list[dict[str, Any]], )
tests/tier3/test_judge_result_semantics.py:223
↓ 6 callersFunction_redact_finding_evidence
Return *text* as security finding evidence with credentials masked, cut to *limit* characters.
src/skillevaluator/tier3/eval_core/checks.py:3969
↓ 6 callersMethod_redact_output
(text: str, secret_values: set[str])
src/skillevaluator/tier3/harbor/local_environment.py:1860
↓ 6 callersFunction_redacted_trajectory_data
Redact one ATIF document without changing schema field types.
src/skillevaluator/tier3/harbor/collector.py:1256
↓ 6 callersFunction_ref_matches
Whether ``ref`` names ``ident`` (see the module docs). The generated wrapper skill is the harness's way in, not a component, so no ref matche
src/skillevaluator/tier3/eval_core/plugin_signals.py:3455
↓ 6 callersMethod_remaining_timeout
(self)
src/skillevaluator/model_catalog.py:186
↓ 6 callersFunction_render
(payload: dict)
tests/test_judge_lift_integrity.py:374
↓ 6 callersFunction_render
(result)
tests/reporting/test_report_readability.py:25
↓ 6 callersFunction_render_reports_and_message
Like :func:`_render_reports`, and also return the Tier 3 result's ``agent_eval`` message.
tests/tier3/test_baseline_timeouts.py:749
↓ 6 callersFunction_report
(status: str | None = "never_activated")
tests/reporting/test_dashboard_activation_regressions.py:19
↓ 6 callersFunction_require
(condition: bool, message: str)
ci/tier_manifest.py:20
↓ 6 callersFunction_require_list
(value: Any, field_name: str)
src/skillevaluator/tier3/harbor/nvidia_build_bridge.py:1449
↓ 6 callersFunction_resolve_agent_runtime_plan
Resolve the single credential plan used by staging and execution. Skill-owned configuration may add non-credential runtime values, but agent
src/skillevaluator/tier3/harbor/runner.py:3304
↓ 6 callersMethod_resolve_component
A declared component path that can be loaded, or ``None`` when it cannot. A path that cannot be loaded gets its finding (:meth:`_resolve_decl
src/skillevaluator/plugin_discovery.py:445
← previousnext →1,401–1,500 of 24,741, ranked by callers