MCPcopy Create free account

hub / github.com/NVIDIA/SkillEvaluator / functions

Functions24,741 in github.com/NVIDIA/SkillEvaluator

↓ 2 callersFunction_gitleaks_tarball
(content: bytes = b"#!/bin/sh\necho gitleaks\n")
tests/utils/test_scanner_install.py:31
↓ 2 callersFunction_goal_not_met
Passing attempts whose judge scored goal accuracy 0: other metrics carried the score, the task wasn't done.
src/skillevaluator/tier3/case_summary.py:1170
↓ 2 callersFunction_grade_selection
( calls: Sequence[_Call], spec: Mapping[str, Any], *, routing: bool, component_names: Sequ
src/skillevaluator/tier3/eval_core/plugin_signals.py:3660
↓ 2 callersFunction_grant_shell_tool
The shell tool a flagged shell grant names (``PowerShell`` for ``PowerShell(iex *)``).
src/skillevaluator/plugin_component_risk.py:624
↓ 2 callersFunction_grounded_or_positional_evidence
( item: dict[str, Any], existing: object, evidence_links: list[dict[str, Any]], index: int, )
src/skillevaluator/evaluation/tier3_report.py:4219
↓ 2 callersFunction_gym_interpreters
Return candidate interpreters for the Gym install: the script's shebang, then its sibling Python.
src/skillevaluator/tier3/nemo_gym/backend.py:67
↓ 2 callersFunction_gym_run_processes
(token: str, leader_group: int)
src/skillevaluator/tier3/nemo_gym/runner.py:507
↓ 2 callersFunction_handoff_overlap_results
Record two handoffs, then consume both after a barrier (overlap window).
tests/test_commands.py:2194
↓ 2 callersFunction_harbor_agent_kwargs
Return the Harbor agent kwargs SkillEvaluator pins for ``agent`` running ``model``.
src/skillevaluator/tier3/harbor/runner.py:1876
↓ 2 callersFunction_harbor_missing_dependency_summary
Keep Harbor's diagnosis, without its unpinned install commands or cloud-bundle hint.
src/skillevaluator/tier3/harbor/runner.py:2382
↓ 2 callersFunction_harbor_result_rewards
(result: dict[str, Any])
src/skillevaluator/tier3/harbor/collector.py:4061
↓ 2 callersFunction_harbor_style_exec
Open the exec stream the way Harbor does, reporting a failed handshake as an ExecResult.
tests/test_harbor_gke_environment.py:1030
↓ 2 callersFunction_harbor_viewer_from_engine_result
(engine_result: dict[str, Any] | None)
src/skillevaluator/evaluation/tier3_report.py:3850
↓ 2 callersFunction_has_metric_field
Return whether a reward claims a metric, independently of score validity.
src/skillevaluator/tier3/harbor/metrics.py:300
↓ 2 callersFunction_has_raster_signature
Return whether *path* starts with a PNG, JPEG, GIF, WebP, ICO, or AVIF signature.
src/skillevaluator/validators/skillspector_scope.py:846
↓ 2 callersFunction_has_substitution
(text: str)
src/skillevaluator/plugin_component_risk.py:2152
↓ 2 callersFunction_has_unknown_canary_outcomes
(summary: Mapping[str, Any])
src/skillevaluator/tier3/eval_core/runtime_evidence.py:393
↓ 2 callersFunction_hash
(value: object, label: str)
src/skillevaluator/tier3/decoys.py:273
↓ 2 callersFunction_hash_path_checked
(path: Path, before: os.stat_result, root_device: int)
src/skillevaluator/publication_identity.py:470
↓ 2 callersMethod_header
(self)
src/skillevaluator/reporting/console_ui.py:706
↓ 2 callersFunction_header_verdict
(html: str)
tests/reporting/test_report_redesign.py:268
↓ 2 callersFunction_headline_agents
Return the agents that set the run's best agent and verdict. An agent kept by --tolerate-baseline-timeouts is set aside whenever an agent wit
src/skillevaluator/evaluation/tier3_report.py:4808
↓ 2 callersFunction_heredoc
(script, marker)
tests/ci/test_all_tier_workflows.py:543
↓ 2 callersFunction_hero_command_status
(raw_html: str)
tests/reporting/test_tier3_completed_agent_docs.py:64
↓ 2 callersFunction_hero_reasons
(html)
tests/reporting/test_report_navigation.py:132
↓ 2 callersFunction_hidden_credential_spans
Return the text later rules mask for each credential that masking the values *value_spans* hides from them. A flag that takes no value ("--use_to
src/skillevaluator/tier3/eval_core/checks.py:4353
↓ 2 callersMethod_hidden_instruction
(snippet: str)
tests/validators/test_security.py:8456
↓ 2 callersFunction_hook_groups
``[event, group]`` pairs of one hook source, in staged order (a group belongs to its first id's source).
src/skillevaluator/tier3/loose_parts.py:1411
↓ 2 callersFunction_host_handoff_environment
Resolve private credential sentinels or refresh host ADC tokens without putting values in argv.
src/skillevaluator/tier3/harbor/secure_docker_environment.py:790
↓ 2 callersFunction_http_headers
Build an HTTP header Message for urllib.error.HTTPError tests.
tests/test_retry.py:31
↓ 2 callersFunction_https_url
Validate an unambiguous HTTPS URL before using it in generated workflows.
src/skillevaluator/_ci_onboarding_pages.py:24
↓ 2 callersFunction_human_agent_name
(name: str)
src/skillevaluator/reporting/benchmark.py:1509
↓ 2 callersFunction_id_shaped
True for case-id-like tokens: "positive-001", "syllable-count", "case_12", "python3".
src/skillevaluator/evaluation/dataset_case_removal.py:196
↓ 2 callersFunction_identical_client
()
tests/embedding/test_similarity_limits.py:221
↓ 2 callersMethod_identify_all_licenses_from_content
Return every configured license pattern that matches the file text.
src/skillevaluator/validators/license.py:391
↓ 2 callersFunction_identity
(text: str)
src/skillevaluator/tier3/decoys.py:63
↓ 2 callersFunction_identity_containers
Return all persisted identity containers owned by one result.
src/skillevaluator/publication_identity.py:722
↓ 2 callersFunction_identity_key
(value: object)
src/skillevaluator/publication_text.py:395
↓ 2 callersFunction_identity_of
``(slug, None, None)`` when ``clone_root`` is a git top-level with a hosted ``origin``. Otherwise ``(None, problem, remedy)``: the problem names
src/skillevaluator/plugin_dependencies.py:192
↓ 2 callersFunction_info
(*, checks=True)
tests/reporting/test_declarative_coverage.py:93
↓ 2 callersFunction_initialized_secure_kata_environment
(tmp_path: Path, **kwargs: object)
tests/test_harbor_secure_docker_environment.py:8648
↓ 2 callersFunction_input_schema
A tool's ``inputSchema`` cut to the subset argument checks run, or ``None`` when nothing is left to check. A schema that only says the arguments
src/skillevaluator/tier3/mcp_proof.py:223
↓ 2 callersFunction_inspect_posix_catalog_file
( parent_descriptor: int, name: str, catalog_path: Path, *, missing_ok: bool, )
src/skillevaluator/embedding/registry.py:1013
↓ 2 callersFunction_inspect_windows_catalog_file
( catalog_path: Path, *, missing_ok: bool, )
src/skillevaluator/embedding/registry.py:1130
↓ 2 callersFunction_install_fake_kubernetes
( monkeypatch: pytest.MonkeyPatch, *, kube_config_error: bool = False, pod_list_error: Excepti
tests/test_harbor_local_mode.py:5798
↓ 2 callersFunction_install_root
(skill_path: Path)
src/skillevaluator/harness/overlay.py:153
↓ 2 callersFunction_install_with_cli_output
(monkeypatch: pytest.MonkeyPatch, agent: object, stdout: str)
tests/tier3/test_harbor_local_agents.py:431
↓ 2 callersFunction_install_with_retries
( agent: BaseInstalledAgent, install: Callable[[BaseEnvironment], Awaitable[None]], environment: B
src/skillevaluator/tier3/harbor/installed_agents.py:57
↓ 2 callersFunction_int_at_least
(value: Any, minimum: int, config_path: Path, field: str)
src/skillevaluator/tier3/evals_config.py:396
↓ 2 callersFunction_interpreter_family
(name: str)
src/skillevaluator/plugin_component_risk.py:2241
↓ 2 callersFunction_interpreter_script_arg
Resolve which argument an interpreter runs as a script. Returns ``(_SCRIPT, arg)`` when one is named, ``(_NO_SCRIPT, None)`` when the interpr
src/skillevaluator/tier3/eval_core/script_invocation.py:2552
↓ 2 callersFunction_invalid_token_counters
Name the token counters a trajectory recorded with a value that is not a count. ``_trajectory_token_counter`` reads such a value as ``None``, as
src/skillevaluator/tier3/harbor/report_data.py:702
↓ 2 callersFunction_invoke_invalid_agent_progress_cli
(mode: str)
tests/test_tier3_progress.py:88
↓ 2 callersFunction_invoke_scan
A failed scanner leaves its unit incomplete while later units continue.
src/skillevaluator/tier1/plugin_checks.py:203
↓ 2 callersFunction_invoke_validate
Run ``validate`` on a skill with 13 invalid eval entries; return its plain output and report directory.
tests/reporting/test_tier3_source_validation_reporting.py:438
↓ 2 callersMethod_is_advisory_agent_eval_skip
Return whether an AGENT_EVAL result records a skipped live run.
src/skillevaluator/reporting/cli.py:968
↓ 2 callersFunction_is_aggregate_extra_token_key
Return true for final_metrics.extra token counters that should be summed.
src/skillevaluator/tier3/harbor/collector.py:161
↓ 2 callersFunction_is_apply_patch_action
(action_lower: str)
src/skillevaluator/tier3/eval_core/checks.py:1253
↓ 2 callersFunction_is_archive_text
(path: str)
scripts/check_oss_boundary.py:816
↓ 2 callersFunction_is_argv
(target: Any)
src/skillevaluator/tier3/eval_core/checks.py:8272
↓ 2 callersFunction_is_ascii_key_body
(character: str)
src/skillevaluator/tier3/harbor/stream_redaction.py:324
↓ 2 callersFunction_is_chat_tool_name
Return whether Build accepts ``name`` once ``_chat_tool_alias`` fits it into 64 characters.
src/skillevaluator/tier3/harbor/nvidia_build_bridge.py:1764
↓ 2 callersFunction_is_checkout_step
Whether ``step`` runs ``actions/checkout``, however GitHub spells it. An unpinned ``uses: actions/checkout`` counts too: the pin guard is what
tests/test_ci_workflows.py:106
↓ 2 callersFunction_is_contained_plugin_manifest
Return whether *path* is a contained-plugin manifest.
src/skillevaluator/cli_core.py:32
↓ 2 callersFunction_is_credential_flag_name
(name: str)
src/skillevaluator/tier3/eval_core/checks.py:4639
↓ 2 callersFunction_is_documentation
(path: bytes)
scripts/classify_ci_changes.py:50
↓ 2 callersFunction_is_file_read_action
(action: str)
src/skillevaluator/tier3/eval_core/checks.py:1229
↓ 2 callersMethod_is_file_reference
Check if license value references a file.
src/skillevaluator/validators/license.py:344
↓ 2 callersFunction_is_insecure_tls_env
Detect env pairs that disable TLS/certificate verification.
src/skillevaluator/validators/mcp_static.py:505
↓ 2 callersFunction_is_invalid_bedrock_ca_bundle
(session: object | None)
src/skillevaluator/tier3/harbor/runtime_preflight.py:358
↓ 2 callersFunction_is_json_string_prefix
Return whether an unfinished bounded string can be completed as JSON.
src/skillevaluator/tier3/eval_core/llm_judge.py:350
↓ 2 callersFunction_is_json_string_prefix
Return whether an unfinished bounded string can be completed as JSON.
src/skillevaluator/tier3/harbor/templates/eval.py:2645
↓ 2 callersFunction_is_junction
(path: Path)
src/skillevaluator/reporting/base.py:148
↓ 2 callersFunction_is_loopback
(host: Any)
tests/tier3/test_ragas_judge_evidence.py:65
↓ 2 callersFunction_is_loopback_host
(hostname: str)
src/skillevaluator/model_catalog.py:764
↓ 2 callersFunction_is_name_list
(value: Any)
src/skillevaluator/tier3/eval_core/plugin_signals.py:669
↓ 2 callersFunction_is_nonnegative_int
(value: object)
src/skillevaluator/tier3/results_location.py:491
↓ 2 callersFunction_is_operator_owned_runtime_name
(name: str, *, env_mode: str = DEFAULT_ENV_MODE)
src/skillevaluator/tier3/harbor/runner.py:2843
↓ 2 callersFunction_is_plain_markdown_heading
Return whether a heading contains only undecorated rendered text.
scripts/ci/check_public_benchmarks.py:1357
↓ 2 callersFunction_is_png
Whether *data* has the chunk structure of a PNG image. The chunk stream must be whole, with every CRC valid: IHDR first, with a nonzero size
src/skillevaluator/validators/security.py:1293
↓ 2 callersFunction_is_real_directory
(path: Path)
src/skillevaluator/tier3/plugin_trace_artifacts.py:61
↓ 2 callersMethod_is_relative_to
(path: Path, root: Path)
src/skillevaluator/tier3/harbor/local_environment.py:1826
↓ 2 callersFunction_is_runtime_evaluator_directory
Keep runtime eval helpers; omit evals and recognized legacy dataset roots.
src/skillevaluator/tier3/harbor/adapter.py:848
↓ 2 callersFunction_is_security_behavior
Whether a behavior is a security check, SECURITY_BEHAVIOR or one an LLM wrote in its place.
src/skillevaluator/tier3/generate_dataset.py:335
↓ 2 callersFunction_is_sensitive_environment_kwarg_name
Recognize secret-bearing names across snake, kebab, and camel case.
src/skillevaluator/tier3/evals_config.py:481
↓ 2 callersFunction_is_shared_strict_read_root
Return whether a strict exception is exactly one shared host tree.
src/skillevaluator/tier3/harbor/local_sandbox.py:365
↓ 2 callersFunction_is_single_link_regular
(path: Path, metadata: os.stat_result)
src/skillevaluator/tier3/results_location.py:173
↓ 2 callersFunction_is_skill_dir
(path: Path)
src/skillevaluator/tier3/harbor/runner.py:3399
↓ 2 callersFunction_is_skill_evals_path
Return whether *path* is under ``evals/`` owned by any nested skill package.
src/skillevaluator/tier3/harbor/adapter.py:829
↓ 2 callersMethod_is_spdx_only_hidden_instruction
Suppress only the exact public SPDX comment false positive.
src/skillevaluator/validators/security.py:5403
↓ 2 callersFunction_is_string_list
(value: object)
src/skillevaluator/tier3/results_location.py:286
↓ 2 callersFunction_is_target_path
(path: Path, target: Path)
src/skillevaluator/tier3/decoys.py:103
↓ 2 callersFunction_is_trial_identity
Whether ``value`` is a usable trial identity: a non-empty string of at most 512 characters.
src/skillevaluator/tier3/harbor/report_data.py:597
↓ 2 callersFunction_is_true
(value: Any)
src/skillevaluator/harness/overlay.py:259
↓ 2 callersMethod_is_trusted_compose_client_host_name
(cls, name: str)
src/skillevaluator/tier3/harbor/secure_docker_environment.py:3036
↓ 2 callersFunction_isolate_host_sensitive_environment
Keep the sidecar Compose check away from sensitive-named variables of the host shell.
tests/test_harbor_secure_docker_environment.py:101
↓ 2 callersFunction_issue_file
(issue: Mapping[str, object])
src/skillevaluator/validators/skillspector_scope.py:601
↓ 2 callersFunction_issue_for_result
Use an explicit failed gate before unrelated advisory findings.
ci/report_views.py:429
↓ 2 callersFunction_item_field
(item: Any)
src/skillevaluator/validators/claude_plugin_validate.py:242
↓ 2 callersFunction_iter_toml_constructs
Yield top-level table headers and key assignments (including inside inline tables).
src/skillevaluator/tier3/harbor/adapter.py:4829
← previousnext →4,001–4,100 of 24,741, ranked by callers