MCPcopy Create free account

hub / github.com/NVIDIA/SkillEvaluator / functions

Functions24,741 in github.com/NVIDIA/SkillEvaluator

↓ 1 callersFunction_custom_only_with_skill_overall
(data: Mapping[str, Any])
src/skillevaluator/tier3/result_display.py:254
↓ 1 callersFunction_cut_point
(limit: int)
tests/tier3/test_judge_contracts.py:1837
↓ 1 callersFunction_cwsandbox_prerequisite_errors
Check what Harbor's cwsandbox backend needs; Harbor 0.24 no longer checks it.
src/skillevaluator/tier3/harbor/runner.py:2391
↓ 1 callersFunction_damaged
Every prefix and every single-character deletion of a command: the shapes a cut-off or mistyped tool call takes.
tests/tier3/test_script_invocation_evidence.py:2655
↓ 1 callersFunction_dangerous_bash_prefix
Claude Code's ``dangerous_prefix`` test for Bash rule content.
src/skillevaluator/plugin_permissions.py:231
↓ 1 callersFunction_dangerous_powershell_prefix
Claude Code's dangerous-prefix test for PowerShell rule content: each prefix also as ``<word>.exe``.
src/skillevaluator/plugin_permissions.py:247
↓ 1 callersFunction_database_url_line
()
tests/ci/test_secret_redaction.py:272
↓ 1 callersFunction_dataset
(ae: dict[str, Any] | None)
src/skillevaluator/reporting/benchmark.py:1669
↓ 1 callersFunction_dataset_composition
(dataset: list[dict[str, Any]])
src/skillevaluator/reporting/benchmark.py:1717
↓ 1 callersFunction_dataset_composition_label
(summary: dict[str, int | str])
src/skillevaluator/reporting/benchmark.py:1729
↓ 1 callersFunction_dataset_entry_identity
(entry: dict[str, Any])
src/skillevaluator/tier3/harbor/report_data.py:104
↓ 1 callersFunction_dataset_file
(directory: Path, layouts: Sequence[tuple[str, str]])
src/skillevaluator/tier3/plugin_prepare.py:765
↓ 1 callersFunction_dataset_for_sampled_trials
Keep one copy of every case joined to a sampled trial, in trial order.
src/skillevaluator/evaluation/insights_judge.py:350
↓ 1 callersFunction_date_field
(item: dict, name: str, location: str)
src/skillevaluator/validators/pii_waivers.py:123
↓ 1 callersFunction_decimal_digit_count
Count base-10 digits without invoking CPython's guarded int-to-string path.
src/skillevaluator/tier3/harbor/collector.py:4912
↓ 1 callersFunction_decision_alias_pattern
Match one decision phrase while failing closed on unmapped lookalikes.
scripts/ci/check_public_benchmarks.py:1762
↓ 1 callersFunction_decision_phrase_surface
Project text the way the public gate does before matching decision wording.
src/skillevaluator/reporting/benchmark.py:2264
↓ 1 callersFunction_declaration_options
Split a declaration's words into operands and option effects, and say whether every option is one this shell accepts and the walk models.
src/skillevaluator/tier3/eval_core/script_invocation.py:1019
↓ 1 callersFunction_declarative_rewards
(arm: str, *, cases: int, attempts: int, checks: int)
tests/test_harbor_runner_artifacts.py:584
↓ 1 callersFunction_declarative_workspace_roots
()
src/skillevaluator/tier3/harbor/templates/eval.py:645
↓ 1 callersFunction_declare_trial_steps
Turn a fixture trial into a multi-step one that declares ``step_names``. ``in_root`` moves the trial result into the attempt root's ``trial_resul
tests/test_harbor_runner_status.py:1996
↓ 1 callersFunction_declared_command
Whether a ``Skill`` tool name is a declared plugin command (``<plugin>:<command>`` or bare). Claude Code runs plugin commands through its ``Skill
src/skillevaluator/tier3/eval_core/plugin_signals.py:2757
↓ 1 callersFunction_declared_component
(ident: _Ident, declared: Mapping[str, Sequence[str]])
src/skillevaluator/tier3/eval_core/plugin_signals.py:3288
↓ 1 callersMethod_declared_compose_service_names
(self)
src/skillevaluator/tier3/harbor/secure_docker_environment.py:2216
↓ 1 callersFunction_declared_entries
The declared ``mcpServers`` shapes in order: an inline map, a path, or the first entries of an array. An array past the item cap gets a HIGH find
src/skillevaluator/plugin_mcp.py:303
↓ 1 callersFunction_declared_keys
(declared: Mapping[str, Sequence[str]] | None)
src/skillevaluator/tier3/eval_core/plugin_signals.py:4664
↓ 1 callersMethod_declared_skill_dir
A declared skills dir holds ``SKILL.md`` directly or ``<name>/SKILL.md`` folders. Codex searches a declared skills folder at any depth, like
src/skillevaluator/plugin_discovery.py:737
↓ 1 callersMethod_declared_skill_tree
Every skill below a declared folder, at any depth (Codex recursive discovery). The folder is searched like ``skills/``: an ``evals``, ``resul
src/skillevaluator/plugin_discovery.py:815
↓ 1 callersFunction_declared_unsupported_paths
Manifest-declared LSP and monitor files, which the native copy never carries.
src/skillevaluator/tier3/harbor/native_staging.py:158
↓ 1 callersFunction_declares_read_only_flag
A bare ``--read-only`` (not followed by a false value) or ``--read-only=<true value>``.
src/skillevaluator/plugin_component_risk.py:688
↓ 1 callersFunction_declares_task_positional
Whether argparse help lists a task-folder positional under ``positional arguments:``. Only entries at argparse's two-space item indent count, so
src/skillevaluator/tier3/nemo_gym/backend.py:163
↓ 1 callersFunction_decode_bash_ansi_c_literals
(value: str)
scripts/check_oss_boundary.py:475
↓ 1 callersFunction_decode_bash_escape
(value: str, index: int)
scripts/check_oss_boundary.py:430
↓ 1 callersFunction_decode_js_identifier_escapes
Decode JavaScript Unicode escapes for lexical tool-reference matching.
src/skillevaluator/tier3/eval_core/codex_tool_call_normalizer.py:357
↓ 1 callersFunction_decode_projection_config
Decode only the source-selection hint from already-secured config bytes.
src/skillevaluator/tier3/harbor/adapter.py:6488
↓ 1 callersFunction_decode_static_js_object
Decode a JSON-compatible object literal, including unquoted property names.
src/skillevaluator/tier3/eval_core/codex_tool_call_normalizer.py:212
↓ 1 callersMethod_decode_tag_payload
Decode Unicode Tag characters to their ASCII equivalents.
src/skillevaluator/validators/unicode_smuggle.py:453
↓ 1 callersFunction_decoded_policy_bytes
Also inspect decoded strings that scanner reports can echo after YAML escapes.
ci/security_baselines.py:82
↓ 1 callersFunction_decoded_shell_codepoint
(value: int)
scripts/check_oss_boundary.py:424
↓ 1 callersFunction_deduction_amounts_by_area
Literal ``deduct`` amounts in ``quality_score.py``, grouped by quality area. The area is resolved from the source rather than hardcoded: a functi
tests/test_metrics_reference_docs.py:422
↓ 1 callersFunction_dedupe_models
(models: list[str])
src/skillevaluator/tier3/eval_core/llm_judge.py:75
↓ 1 callersFunction_dedupe_models
(models)
src/skillevaluator/tier3/harbor/templates/eval.py:911
↓ 1 callersFunction_default_report_output_error
Say why the default report directory was refused and how to choose another.
src/skillevaluator/cli.py:550
↓ 1 callersFunction_default_to_string
(value: Any)
tests/golden/_cli_surface.py:19
↓ 1 callersFunction_defer_termination_signals
()
src/skillevaluator/tier3/nemo_gym/runner.py:481
↓ 1 callersFunction_delivery
(payload: dict, budget: _Budget, warnings: list[NativeNotice])
src/skillevaluator/reporting/native_evidence.py:365
↓ 1 callersMethod_deny
(self, attempts: list[dict[str, Any]])
src/skillevaluator/tier3/harbor/run_budget.py:220
↓ 1 callersFunction_dependency_context
Read bounded dependency evidence from the evaluator-staged skill.
src/skillevaluator/tier3/harbor/templates/eval.py:4406
↓ 1 callersFunction_derive_html_tabs
Build populated tabs with the same tier classifier as the HTML evidence.
src/skillevaluator/tier1/commands.py:632
↓ 1 callersFunction_description
(command: click.Command)
src/skillevaluator/cli_help.py:150
↓ 1 callersFunction_description_lower
The skill description as template cases quote it.
src/skillevaluator/tier3/generate_dataset.py:435
↓ 1 callersFunction_descriptor_manifest
(target: Path)
src/skillevaluator/publication_identity.py:380
↓ 1 callersMethod_descriptors
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethod_destroy
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersFunction_detail_display_status
Recognize explicit producer evidence that a check was inapplicable.
src/skillevaluator/reporting/html.py:2159
↓ 1 callersFunction_detail_grid
Every finding with its fix, under a line naming the harness, its status and verified version.
src/skillevaluator/harness/report.py:124
↓ 1 callersMethod_detect_license
Attempt to detect license using multi-tier approach.
src/skillevaluator/validators/license.py:289
↓ 1 callersFunction_diagnostic_artifact_max_bytes
()
src/skillevaluator/tier3/harbor/collector.py:1232
↓ 1 callersFunction_dict_items
(value: object)
src/skillevaluator/reporting/markdown.py:141
↓ 1 callersFunction_digest_field
Append one unambiguous, length-delimited field to a target digest.
src/skillevaluator/publication_identity.py:79
↓ 1 callersFunction_dimension_boundaries
()
src/skillevaluator/reporting/benchmark.py:1253
↓ 1 callersFunction_dimension_gate_evidence
Describe, in one cell, what the gate read from one agent.
src/skillevaluator/reporting/benchmark.py:1260
↓ 1 callersFunction_dimension_score
Require every applicable source; only a legacy contract selects fallback sources.
src/skillevaluator/evaluation/tier3_report.py:4542
↓ 1 callersFunction_directory
(reports: Path, value: object)
ci/report_views.py:119
↓ 1 callersFunction_directory_key
A normalized unpack directory as a ``_directory_prefixes`` key (cut to ``_MAX_DIR_DEPTH`` deep).
src/skillevaluator/plugin_component_risk.py:2010
↓ 1 callersFunction_directory_prefixes
The unpack-directory keys a normalized run ``path`` is below. ``.`` for a relative path, ``/`` for an absolute one, then each leading directo
src/skillevaluator/plugin_component_risk.py:1991
↓ 1 callersFunction_disallows_all_mcp
Whether ``disallowedTools`` entries (whitespace removed, lower-cased) deny every one of the servers' tools.
src/skillevaluator/plugin_component_risk.py:786
↓ 1 callersFunction_discover_auto_trace_evidence
Select retained, meaningful evidence from a completed run scoped to this skill. Automatic selection must not treat an arbitrary same-ID trajector
src/skillevaluator/tier3/generate_dataset.py:1684
↓ 1 callersFunction_discover_custom_metric_scores
Discover at most ``limit`` custom names and aggregate reward scores once.
src/skillevaluator/evaluation/tier3_report.py:3183
↓ 1 callersFunction_discover_skill_link_targets
(skill_md: Path)
src/skillevaluator/tier3/harbor/adapter.py:1100
↓ 1 callersFunction_discover_skill_manifests
Return one securely discovered manifest identity per skill directory.
src/skillevaluator/plugin_member_paths.py:56
↓ 1 callersFunction_display
(value: object, *, signed: bool = False, integer: bool = False)
src/skillevaluator/reporting/telemetry_view.py:59
↓ 1 callersMethod_display
(self, path: Path)
src/skillevaluator/harness/overlay.py:630
↓ 1 callersFunction_display_metrics
(agent_with: dict[str, dict[str, float]])
src/skillevaluator/tier3/commands.py:1794
↓ 1 callersFunction_display_metrics
(result: Mapping[str, Any], agents: Mapping[str, Any])
src/skillevaluator/tier3/result_display.py:517
↓ 1 callersFunction_distinct_answer
Build non-repetitive text, so a cut middle cannot be matched elsewhere.
tests/tier3/test_judge_contracts.py:433
↓ 1 callersFunction_docker_daemon_error
Return why the Docker daemon Gym would use is unreachable, or None when it answers.
src/skillevaluator/tier3/commands.py:1059
↓ 1 callersFunction_docker_timeout_retry_and_scored_wrong_baseline
(tmp_path: Path)
tests/test_harbor_timeout_recovery_docker.py:56
↓ 1 callersFunction_dockerfile
(inputs: AuditInputs, source: str, text: str)
src/skillevaluator/plugin_dependency_audit.py:283
↓ 1 callersFunction_dockerfile_heredocs
Return heredoc delimiters introduced by one Dockerfile instruction.
src/skillevaluator/tier3/harbor/adapter.py:2532
↓ 1 callersFunction_dockerfile_main_mount_context_sources
Return source paths for BuildKit mounts from the primary context.
src/skillevaluator/tier3/harbor/adapter.py:3148
↓ 1 callersFunction_dockerfile_named_build_context_sources
Return statically named build-context sources from a Dockerfile.
src/skillevaluator/tier3/harbor/adapter.py:2771
↓ 1 callersFunction_dockerfile_named_context_sources
Return ``(--from context, source)`` pairs for one COPY/ADD.
src/skillevaluator/tier3/harbor/adapter.py:2723
↓ 1 callersFunction_dockerfile_named_mount_context_sources
Return source paths for BuildKit mounts from named contexts.
src/skillevaluator/tier3/harbor/adapter.py:3153
↓ 1 callersFunction_dockerignored
(path: str)
tests/ci/test_image_build.py:109
↓ 1 callersFunction_dollar_n
Count ``$<number>`` tokens: price-like ones ($4.00, $5, $4 / $20 per MTok) versus placeholders ($1, $1 /path).
src/skillevaluator/harness/overlay.py:352
↓ 1 callersFunction_double_parens_are_arithmetic
Whether ``((`` closed by ``))`` is an arithmetic command in this shell. bash, zsh, ksh and mksh have one (measured); dash has none and reads two
src/skillevaluator/tier3/eval_core/script_invocation.py:2713
↓ 1 callersFunction_download_directory
( environment: SkillEvaluatorLocalEnvironment, transfer: str, source: str, target: Path, )
tests/test_harbor_local_environment.py:674
↓ 1 callersFunction_download_sites
Files the commands save downloads to, and directories they unpack a download into (in order).
src/skillevaluator/plugin_component_risk.py:2526
↓ 1 callersMethod_drain
(self, *, final: bool)
src/skillevaluator/tier3/harbor/secure_docker_environment.py:472
↓ 1 callersMethod_draw
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethod_drawArgs
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethod_drawColorBox
(t,e,i,s,n)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethod_drawDataset
(t)
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethod_drawDatasets
()
src/skillevaluator/reporting/assets/chart.umd.min.js:13
↓ 1 callersMethod_drop_repeated_hook_reports
Drop the hook Criticals and gate failures of *enrichment* that the static stage's *result* already holds. Both stages run the same static ana
src/skillevaluator/validators/security.py:3569
↓ 1 callersFunction_drop_stale_evidence_digest
Remove a PII finding's ``evidence_sha256`` unless it is the digest of the value the finding shows. A finding carries the digest only while it rep
src/skillevaluator/reporting/finding_summary.py:262
↓ 1 callersFunction_drop_table_key
Remove a single-line ``key = value`` from one top-level task.toml table, checking nothing else changed.
src/skillevaluator/tier3/nemo_gym/runner.py:208
↓ 1 callersFunction_edge_reason
``""`` when the edge holds, else why not. The first use of ``before`` (any alternative) must come in an earlier step than the first use of so
src/skillevaluator/tier3/eval_core/plugin_signals.py:4250
↓ 1 callersFunction_edit
(path: str)
tests/tier3/test_security_home_paths.py:62
← previousnext →6,101–6,200 of 24,741, ranked by callers