MCPcopy Create free account

hub / github.com/claw-bench/claw-bench / functions

Functions7,113 in github.com/claw-bench/claw-bench

↓ 6 callersFunction_extract_tables
Extract tables as list of list of rows, where each row is a list of cells.
tasks/document-editing/doc-009-markdown-table-formatter/verifier/test_output.py:28
↓ 6 callersFunction_find_by_commit
Find entries for a given commit.
tasks/security/sec-012-secrets-scanning-git-history/verifier/test_output.py:25
↓ 6 callersMethod_make_app
(self)
tests/unit/test_oracle_cli.py:180
↓ 6 callersMethod_make_task_env
(self, tmp_path, task_id="skill-001")
tests/unit/test_runner_edge_cases.py:407
↓ 6 callersMethod_make_valid_task
Helper: create a minimal valid task directory.
tests/unit/test_validate_cli.py:24
↓ 6 callersFunction_make_verbose
Add clarifications and hints to the instruction.
src/claw_bench/core/robustness.py:90
↓ 6 callersFunction_mean
Compute arithmetic mean of a sequence.
src/claw_bench/core/statistics.py:46
↓ 6 callersFunction_parse_row
Parse a table row into cells.
tasks/document-editing/doc-009-markdown-table-formatter/verifier/test_output.py:47
↓ 6 callersFunction_save_expert
(data: Dict)
src/claw_bench/server/admin.py:365
↓ 6 callersFunctiondetect_provider
Guess provider name from API base URL.
src/claw_bench/core/rate_limiter.py:110
↓ 6 callersFunctionexport_for_leaderboard
Format benchmark results for the leaderboard frontend. Returns a JSON-compatible dict matching the ``BenchResult`` interface used by the lead
src/claw_bench/submission/leaderboard_export.py:13
↓ 6 callersFunctionget_target_recipe
Extract recipe lines for a specific target.
tasks/real-tools/tool-004/verifier/test_output.py:40
↓ 6 callersFunctiongh_available
Check whether the ``gh`` CLI tool is installed.
src/claw_bench/submission/uploader.py:12
↓ 6 callersFunctionsafe
(v: number | undefined)
leaderboard/src/app/skills-gain/SkillsGainContent.tsx:19
↓ 6 callersMethodsetup
(self, config: dict)
src/claw_bench/adapters/openclaw.py:115
↓ 6 callersFunctionsubmit_dry_run
Validate the package and print what *submit_pr* would do.
src/claw_bench/submission/uploader.py:261
↓ 6 callersMethodtask_started
(self, user_id: str)
src/claw_bench/core/resource_monitor.py:94
↓ 5 callersFunction_check_docker_running
Check that the Docker daemon is running.
src/claw_bench/cli/doctor.py:57
↓ 5 callersFunction_extract_section_items
Extract bullet items from a named section.
tasks/memory/mem-005-long-document-summarization/verifier/test_output.py:89
↓ 5 callersFunction_find_result
Find a result entry by password string.
tasks/security/sec-002-validate-password-strength/verifier/test_output.py:80
↓ 5 callersFunction_generate_markdown
Generate a Markdown report.
src/claw_bench/cli/report.py:99
↓ 5 callersFunction_get_function_node
Find a FunctionDef node by name.
tasks/code-assistance/code-006-refactor-comprehensions/verifier/test_output.py:33
↓ 5 callersMethod_issues_text
(self, review)
tasks/cross-domain/xdom-015-automated-code-review-report/verifier/test_output.py:146
↓ 5 callersFunction_load_invites
()
src/claw_bench/server/admin.py:370
↓ 5 callersFunction_load_summaries
Recursively find and load all summary.json files.
src/claw_bench/cli/analyze.py:227
↓ 5 callersFunction_make_mock_response
Create a mock httpx response.
tests/unit/test_httpx_adapters.py:111
↓ 5 callersMethod_mock_sandbox
Create a mock Sandbox context manager.
tests/unit/test_sandbox_runner.py:272
↓ 5 callersFunction_seed_for
Deterministic seed from framework+model.
scripts/generate_sample_results.py:100
↓ 5 callersFunction_word_count
(text: str)
tasks/multi-agent/mag-002-research-debate/verifier/test_output.py:12
↓ 5 callersMethodcan_start_task
Check if user can start a new task. Returns (allowed, reason).
src/claw_bench/core/resource_monitor.py:66
↓ 5 callersFunctionclient_class
Get the ApiClient class.
tasks/code-assistance/code-010-rest-api-client/verifier/test_output.py:29
↓ 5 callersFunctiondecrypt_file
Decrypt *input_path* to *output_path* using an age private key. The private key is passed via a temporary identity file to avoid leaking it i
src/claw_bench/utils/crypto.py:89
↓ 5 callersMethoddivide
Return the quotient of *a* / *b*. Raises: ValueError: If *b* is zero.
tasks/code-assistance/code-001-write-unittest/environment/data/calculator.py:19
↓ 5 callersFunctionencrypt_file
Encrypt *input_path* to *output_path* using an age public key. Raises: RuntimeError: If ``age`` is not installed or encryption fails.
src/claw_bench/utils/crypto.py:69
↓ 5 callersMethodexec
Run *command* inside the container. Returns ``(stdout, stderr, exit_code)``.
src/claw_bench/core/sandbox.py:72
↓ 5 callersFunctionexport_model_matrix
Generate model x framework performance matrix for heatmap visualization. Parameters ---------- all_runs: Mapping from ``"framewor
src/claw_bench/submission/leaderboard_export.py:105
↓ 5 callersFunctiongenerate_all
Generate results for all framework-model combinations.
scripts/generate_sample_results.py:230
↓ 5 callersMethodget
(self, provider: str)
src/claw_bench/core/rate_limiter.py:91
↓ 5 callersFunctionloadResults
()
leaderboard/src/app/profiles/page.tsx:51
↓ 5 callersFunctionrequire_auth
Verify that a token is valid and return the associated user. Args: token: The session token to verify. Returns: The authenti
tasks/cross-domain/xdom-012-automated-docs-generator/environment/data/auth.py:56
↓ 5 callersMethodsave_encrypted
Write an age-encrypted trace file. The plaintext JSON-lines are encrypted with the given *public_key* using the ``age`` encryption to
src/claw_bench/core/trace.py:54
↓ 5 callersFunctionvalidate_skills_mode
Validate that a skills mode is recognized.
src/claw_bench/core/config_validator.py:144
↓ 4 callersFunction_check_adapters
Check that all adapters are importable. Returns (all_ok, failed_adapters).
src/claw_bench/cli/doctor.py:131
↓ 4 callersFunction_check_disk_space
Check that at least min_gb of disk space is available.
src/claw_bench/cli/doctor.py:70
↓ 4 callersFunction_check_docker_available
Check that Docker CLI is available.
src/claw_bench/cli/doctor.py:52
↓ 4 callersFunction_check_python_version
Check that Python >= 3.11.
src/claw_bench/cli/doctor.py:47
↓ 4 callersFunction_find_by_endpoint
Find entries matching an endpoint substring.
tasks/security/sec-009-api-security-audit/verifier/test_output.py:25
↓ 4 callersFunction_find_incident
Find an incident by type.
tasks/security/sec-007-log-forensics/verifier/test_output.py:25
↓ 4 callersFunction_find_main_script
(workspace)
tasks/multi-agent/mag-004-project-decomposition/verifier/test_output.py:83
↓ 4 callersFunction_find_result
Find a result by rule_id.
tasks/security/sec-014-compliance-audit/verifier/test_output.py:44
↓ 4 callersFunction_has_list_comprehension
Check if a function body contains a ListComp.
tasks/code-assistance/code-006-refactor-comprehensions/verifier/test_output.py:42
↓ 4 callersFunction_identities_dir
()
src/claw_bench/core/moltbook_registry.py:42
↓ 4 callersFunction_load_model_tiers
Load canonical model tier metadata.
src/claw_bench/cli/run.py:36
↓ 4 callersMethod_make_app
(self)
tests/unit/test_oracle_cli.py:108
↓ 4 callersFunction_make_entry_point
Create a mock entry point that loads the given class.
tests/unit/test_registry.py:34
↓ 4 callersFunction_moltbook_root
()
src/claw_bench/core/moltbook_registry.py:38
↓ 4 callersFunction_verify_proposal_owner
Ensure the proposal belongs to the requesting expert.
src/claw_bench/server/admin.py:417
↓ 4 callersFunctionage_available
Check whether the ``age`` CLI tool is installed and reachable.
src/claw_bench/utils/crypto.py:16
↓ 4 callersMethodcopy_in
Copy a local file or directory into the container at *container_path*.
src/claw_bench/core/sandbox.py:90
↓ 4 callersMethoddelete
(self, user_id: int)
tasks/multimodal/mm-007-architecture-doc/environment/data/project/repository.py:23
↓ 4 callersFunctiongenerate_keypair
Generate an age encryption keypair. Returns: A tuple of (public_key, private_key). Raises: RuntimeError: If ``age-keygen`` i
src/claw_bench/utils/crypto.py:29
↓ 4 callersFunctiongetPoint
(i: number, value: number)
leaderboard/src/app/compare/CompareContent.tsx:29
↓ 4 callersFunctionget_db
Get database connection.
tasks/security/sec-015-full-security-assessment/environment/data/app.py:15
↓ 4 callersFunctionget_history
Return all historical runs for *claw_id*, sorted by timestamp.
src/claw_bench/core/moltbook_registry.py:175
↓ 4 callersMethodget_metrics
(self)
src/claw_bench/adapters/openclaw.py:436
↓ 4 callersFunctionloadSkillsGain
()
leaderboard/src/app/skills-gain/page.tsx:15
↓ 4 callersFunctionload_grades
(workspace)
tasks/educational-assessment/edu-001-rubric-grading/verifier/test_output.py:14
↓ 4 callersFunctionload_tasks
Load minimal task info from task.toml files.
scripts/generate_sample_results.py:156
↓ 4 callersMethodrecord_call
Record one API round-trip.
src/claw_bench/core/metrics.py:37
↓ 4 callersFunctionrun_all
Execute all tasks, with repeated runs and optional parallelism. Parameters ---------- on_task_complete: Optional callback ``(Task
src/claw_bench/core/runner.py:329
↓ 4 callersMethodrun_started
(self, user_id: str)
src/claw_bench/core/resource_monitor.py:111
↓ 4 callersFunctionsave_results
Persist run results to JSON. When *tasks* is provided, also computes ``BenchmarkStatistics`` and writes a leaderboard-compatible ``leaderboar
src/claw_bench/core/runner.py:481
↓ 4 callersMethodteardown
(self)
tests/unit/test_registry.py:30
↓ 3 callersFunction_check_pyyaml
Check that pyyaml is installed.
src/claw_bench/cli/doctor.py:79
↓ 3 callersFunction_compute_content_hash
(data: dict)
src/claw_bench/server/submit_api.py:707
↓ 3 callersFunction_confidence_interval_95
Compute 95% confidence interval: mean +/- 1.96 * (std / sqrt(n)).
src/claw_bench/core/statistics.py:61
↓ 3 callersFunction_config
(**kwargs)
tests/unit/test_leaderboard_export.py:38
↓ 3 callersMethod_extract_workspace
Extract the absolute workspace path from the injected prompt.
src/claw_bench/adapters/dryrun.py:86
↓ 3 callersFunction_find_by_category
Find entries matching a category.
tasks/security/sec-009-api-security-audit/verifier/test_output.py:30
↓ 3 callersFunction_get_next_id
Generate the next auto-increment ID for an entity type. Args: entity: Entity type name ('user', 'product', or 'order'). Returns:
tasks/cross-domain/xdom-012-automated-docs-generator/environment/data/database.py:20
↓ 3 callersFunction_inject_curated_skills
Copy curated skills for the task's domain into the workspace. Returns a list of skill file names that were copied.
src/claw_bench/core/runner.py:93
↓ 3 callersMethod_make_app
(self)
tests/unit/test_skillsbench_cli.py:125
↓ 3 callersFunction_save_invites
(invites: List[Dict])
src/claw_bench/server/admin.py:379
↓ 3 callersFunction_std_dev
Compute population standard deviation.
src/claw_bench/core/statistics.py:53
↓ 3 callersFunction_validate_model_tier
Warn when a model tier is unknown or does not list the selected model.
src/claw_bench/cli/run.py:51
↓ 3 callersFunctioncapScore
(r: BenchResult, cap: string)
leaderboard/src/app/capabilities/CapabilitiesContent.tsx:31
↓ 3 callersFunctioncomputeOverall
( row: BenchResultData, _weights: Record<string, number> )
leaderboard/src/app/LeaderboardTable.tsx:85
↓ 3 callersFunctioncompute_total_cost
Sum the costs of multiple task results. Each result dict must have: 'model', 'tokens_input', 'tokens_output'.
tests/unit/test_cost.py:33
↓ 3 callersMethodcopy_out
Copy a file or directory from the container to the local filesystem.
src/claw_bench/core/sandbox.py:100
↓ 3 callersFunctiongenerate_id
Generate a unique integer ID. Uses a simple incrementing counter. Not suitable for distributed systems.
tasks/multimodal/mm-007-architecture-doc/environment/data/project/utils.py:10
↓ 3 callersFunctiongenerate_task_results
Generate simulated task results for a framework-model pair.
scripts/generate_sample_results.py:106
↓ 3 callersMethodget_metrics
(self)
tests/unit/test_registry.py:27
↓ 3 callersFunctionget_table_info
(table)
tasks/cs-engineering/cs-002-db-migration/verifier/test_output.py:50
↓ 3 callersFunctionlist_identities
Return all registered identities.
src/claw_bench/core/moltbook_registry.py:116
↓ 3 callersFunctionload_rubric
(workspace)
tasks/educational-assessment/edu-001-rubric-grading/verifier/test_output.py:22
↓ 3 callersFunctionlogin
()
leaderboard/src/app/admin/page.tsx:225
↓ 3 callersFunctionread_report
(path)
tasks/content-analysis/cont-003-readability-audit/verifier/test_output.py:13
↓ 3 callersMethodrecord_memory
Update peak memory if *memory_mb* exceeds the current peak.
src/claw_bench/core/metrics.py:50
↓ 3 callersMethodsave
Write all entries to *path* in JSON-lines format.
src/claw_bench/core/trace.py:47
↓ 3 callersFunctionscoreClass
(score: number)
leaderboard/src/app/skills-gain/SkillsGainContent.tsx:27
← previousnext →101–200 of 7,113, ranked by callers