MCPcopy Create free account

hub / github.com/claw-bench/claw-bench / functions

Functions7,113 in github.com/claw-bench/claw-bench

Methodsetup
(self, config: dict)
tests/integration/test_full_pipeline.py:33
Methodsetup
(self, config)
tests/unit/test_adapters.py:59
Methodsetup
(self, config)
tests/unit/test_runner_edge_cases.py:28
Functionshow
Show full details of a MoltBook identity.
src/claw_bench/cli/moltbook.py:182
Methodshutdown
Graceful shutdown — wait for running tasks to complete.
src/claw_bench/core/queue.py:227
Functionsignatures
Read and parse signatures.json.
tasks/email/eml-013-signature-extractor/verifier/test_output.py:16
Functionsitemap
(workspace)
tasks/web-browsing/web-012-sitemap-generator/verifier/test_output.py:15
Functionsitemap
(workspace)
tasks/web-browsing/web-008-site-structure/verifier/test_output.py:15
Functionskills
List curated skills organized by domain.
src/claw_bench/cli/list_cmd.py:283
Functionskills_gain_cmd
Compute SkillsBench 3-condition skills gain analysis. Compares vanilla (no skills) vs curated (standard skills) vs native (framework-specific
src/claw_bench/cli/analyze.py:170
Functionslack
(workspace)
tasks/communication/comm-001-format-message/verifier/test_output.py:27
Functionslow_module
(workspace)
tasks/debugging/debug-005/verifier/test_output.py:31
Functionslow_module
Import slow.py from the workspace.
tasks/code-assistance/code-015-performance-optimization/verifier/test_output.py:17
Functionslugify
Convert text to a URL-friendly slug. Args: text: The text to slugify. Returns: Lowercase, hyphen-separated string. Exam
tasks/cross-domain/xdom-012-automated-docs-generator/environment/data/utils.py:96
Functionslugify
Convert text to a URL-friendly slug. Lowercases the text, replaces spaces with hyphens, and removes non-alphanumeric characters.
tasks/multimodal/mm-007-architecture-doc/environment/data/project/utils.py:31
Functionsolution
(workspace)
tasks/math-reasoning/math-005/verifier/test_output.py:20
Functionsolution
(workspace)
tasks/math-reasoning/math-002/verifier/test_output.py:30
Functionsolution
(workspace)
tasks/math-reasoning/math-004/verifier/test_output.py:31
Functionsort_key
(x)
tasks/clinical-data/med-003-drug-interaction/verifier/test_output.py:82
Functionsorted_lines
Read and return the lines from sorted.txt.
tasks/file-operations/file-004-sort-lines/verifier/test_output.py:15
Functionsorting_module
Import sorting.py from the workspace.
tasks/code-assistance/code-008-implement-merge-sort/verifier/test_output.py:17
Functionsource_data
Load the original JSON data for comparison.
tasks/file-operations/file-007-json-to-yaml/verifier/test_output.py:17
Functionsource_json
(workspace)
tasks/multimodal/mm-001-json-to-yaml/verifier/test_output.py:16
Functionsource_txt
Read and return the original document.txt contents.
tasks/document-editing/doc-012-text-find-replace/verifier/test_output.py:23
Functionstartup
Initialize database on application startup.
tasks/multimodal/mm-007-architecture-doc/environment/data/project/app.py:28
Functionstats
(workspace)
tasks/data-analysis/data-001/verifier/test_output.py:14
Functionstats
(workspace)
tasks/calendar/cal-010-meeting-duration-stats/verifier/test_output.py:16
Functionstats
Read and parse the stats.json file.
tasks/file-operations/file-012-csv-stats/verifier/test_output.py:16
Functionstats
(workspace)
tasks/communication/comm-004-chat-analysis/verifier/test_output.py:15
Methodstats
(self)
src/claw_bench/core/cache.py:160
Methodstats
(self)
src/claw_bench/core/queue.py:213
Functionstep1_data
Load step 1 raw JSON.
tasks/workflow-automation/wfl-003-multi-step-data-pipeline/verifier/test_output.py:24
Functionstep2_data
Load step 2 filtered JSON.
tasks/workflow-automation/wfl-003-multi-step-data-pipeline/verifier/test_output.py:32
Functionstep3_data
Load step 3 stats JSON.
tasks/workflow-automation/wfl-003-multi-step-data-pipeline/verifier/test_output.py:40
Functionstep4_text
Load step 4 report text.
tasks/workflow-automation/wfl-003-multi-step-data-pipeline/verifier/test_output.py:48
Functionstep_by_id
Create a lookup dict by step ID.
tasks/workflow-automation/wfl-008-error-handling-workflow/verifier/test_output.py:24
Functionstrings
(workspace)
tasks/communication/comm-003-translation-prep/verifier/test_output.py:15
Functionstructured
(workspace)
tasks/document-editing/doc-008-document-restructuring/verifier/test_output.py:16
Functionsubmit_cmd
Package and submit benchmark results to the leaderboard.
src/claw_bench/cli/submit.py:19
Methodsubmit_event
Submit an analytics event.
tasks/security/sec-001-detect-hardcoded-credentials/environment/data/api_client.py:30
Functionsubmit_expert_proposal
Accept a proposal, save it, and auto-trigger LLM generation.
src/claw_bench/server/admin.py:652
Functionsubmit_results
Public endpoint for submitting benchmark results. Features: - Auto-detect region from IP (Taiwan/HK/Macau handled separately) - Same claw
src/claw_bench/server/submit_api.py:840
Functionsubmit_status
Check submission system status and limits.
src/claw_bench/server/submit_api.py:1141
Functionsubtract
(a, b)
tasks/multi-agent/mag-001-code-review-pipeline/environment/data/calculator.py:8
Methodsubtract
Return the difference of *a* and *b*.
tasks/code-assistance/code-001-write-unittest/environment/data/calculator.py:11
Functionsummary
Read and parse summary.csv.
tasks/data-analysis/data-015-multi-table-join/verifier/test_output.py:16
Functionsummary
Load and return the summary.json contents.
tasks/email/eml-006-generate-summary/verifier/test_output.py:16
Functionsummary
()
tasks/cross-domain/xdom-014-data-driven-email-campaign/verifier/test_output.py:29
Functionsummary
Read and parse the summary.json file.
tasks/file-operations/file-015-data-pipeline/verifier/test_output.py:29
Functionsummary
(workspace)
tasks/communication/comm-006-thread-summary/verifier/test_output.py:15
Functionsummary_rows
(workspace)
tasks/data-analysis/data-003/verifier/test_output.py:14
Methodsupports_skills
(self)
tests/integration/test_full_pipeline.py:91
Functionsvg_content
(workspace)
tasks/multimodal/mm-011-svg-chart-generator/verifier/test_output.py:15
Functiontable_data
(workspace)
tasks/web-browsing/web-002-parse-table/verifier/test_output.py:15
Functiontable_info
Get table_info for all tables as a dict.
tasks/database/db-003/verifier/test_output.py:32
Functiontasks
List available benchmark tasks.
src/claw_bench/cli/list_cmd.py:23
Functiontasks
(workspace)
tasks/workflow-automation/wfl-013-task-scheduler/verifier/test_output.py:22
Functiontasks_data
Read and return the tasks.json contents.
tasks/cross-domain/xdom-016-meeting-to-tasks/verifier/test_output.py:17
Functiontasks_input
Load original tasks.
tasks/workflow-automation/wfl-009-scheduled-workflow-plan/verifier/test_output.py:32
Functionteam_summary
Read and return the team_summary.json contents.
tasks/workflow-automation/wfl-017-standup-aggregator/verifier/test_output.py:16
Methodteardown
(self)
tests/integration/test_full_pipeline.py:88
Methodteardown
(self)
tests/unit/test_adapters.py:71
Methodteardown
(self)
tests/unit/test_runner_edge_cases.py:52
Functiontech_stack
(architecture)
tasks/planning/plan-005/verifier/test_output.py:40
Functiontelegram
(workspace)
tasks/communication/comm-001-format-message/verifier/test_output.py:20
Methodtest_14_domains
(self)
tests/unit/test_project_integrity.py:83
Methodtest_15_tasks_per_domain
(self)
tests/unit/test_project_integrity.py:125
Methodtest_210_total_tasks
(self)
tests/unit/test_project_integrity.py:121
Functiontest_777_files_detected
Files with 777 permissions must be detected.
tasks/security/sec-003-check-file-permissions/verifier/test_output.py:89
Methodtest_8_adapters_total
There should be exactly 8 adapters.
tests/unit/test_project_integrity.py:43
Functiontest_ab_results_content
(workspace)
tasks/data-science/ds-002-ab-testing/verifier/test_output.py:19
Functiontest_ab_results_exists
(workspace)
tasks/data-science/ds-002-ab-testing/verifier/test_output.py:14
Methodtest_ab_test_distribution_in_summary
(self, summary)
tasks/cross-domain/xdom-014-data-driven-email-campaign/verifier/test_output.py:179
Functiontest_about_links
(sitemap)
tasks/web-browsing/web-012-sitemap-generator/verifier/test_output.py:38
Functiontest_about_missing_canonical
(report)
tasks/web-browsing/web-007-seo-analysis/verifier/test_output.py:67
Functiontest_about_page_missing_h1
(report)
tasks/web-browsing/web-007-seo-analysis/verifier/test_output.py:50
Functiontest_about_page_missing_meta
(report)
tasks/web-browsing/web-007-seo-analysis/verifier/test_output.py:39
Functiontest_about_page_title_too_short
(report)
tasks/web-browsing/web-007-seo-analysis/verifier/test_output.py:45
Methodtest_accepts_summary_json_fallback
(self, cli_app, tmp_path)
tests/unit/test_submit_cli.py:100
Functiontest_account_setup_access_level
Access level should be 'developer' for Engineering department.
tasks/workflow-automation/wfl-016-onboarding-checklist/verifier/test_output.py:69
Functiontest_account_setup_email
Email should match the new hire email.
tasks/workflow-automation/wfl-016-onboarding-checklist/verifier/test_output.py:52
Functiontest_account_setup_exists
account_setup.json must exist in the workspace.
tasks/workflow-automation/wfl-016-onboarding-checklist/verifier/test_output.py:42
Functiontest_account_setup_groups_contains_all_staff
Groups should contain 'all-staff'.
tasks/workflow-automation/wfl-016-onboarding-checklist/verifier/test_output.py:63
Functiontest_account_setup_groups_contains_engineering
Groups should contain 'engineering' (lowercase department).
tasks/workflow-automation/wfl-016-onboarding-checklist/verifier/test_output.py:57
Functiontest_account_setup_username
Username should be derived from email prefix.
tasks/workflow-automation/wfl-016-onboarding-checklist/verifier/test_output.py:47
Functiontest_accuracy_threshold
Classification accuracy must be at least 80% (12 of 15 correct).
tasks/email/eml-004-classify-emails/verifier/test_output.py:70
Methodtest_acquire_exhausts_capacity
(self)
tests/unit/test_rate_limiter.py:18
Methodtest_acquire_within_capacity
(self)
tests/unit/test_rate_limiter.py:14
Functiontest_action_item_beta_plan
Priya Patel should own the beta testing plan by 2025-03-31.
tasks/communication/comm-009-meeting-notes/verifier/test_output.py:90
Functiontest_action_item_budget_breakdown
Lisa Yamamoto should own the budget breakdown by 2025-02-15.
tasks/communication/comm-009-meeting-notes/verifier/test_output.py:101
Functiontest_action_item_count
There should be exactly 4 action items.
tasks/communication/comm-011-meeting-notes-formatter/verifier/test_output.py:62
Functiontest_action_item_feature_spec
James O'Brien should own the feature spec by 2025-02-28.
tasks/communication/comm-009-meeting-notes/verifier/test_output.py:79
Functiontest_action_item_ux_mockups
James O'Brien should own the UX mockups by 2025-03-01.
tasks/communication/comm-009-meeting-notes/verifier/test_output.py:112
Functiontest_action_items_assignees_are_participants
(summary)
tasks/communication/comm-006-thread-summary/verifier/test_output.py:74
Functiontest_action_items_content
Action items must contain key phrases.
tasks/communication/comm-011-meeting-notes-formatter/verifier/test_output.py:69
Functiontest_action_items_file_exists
action_items.json must exist in the workspace.
tasks/email/eml-005-extract-action-items/verifier/test_output.py:24
Functiontest_action_items_have_assignee_and_task
(summary)
tasks/communication/comm-006-thread-summary/verifier/test_output.py:68
Functiontest_action_items_have_required_fields
(notes)
tasks/communication/comm-009-meeting-notes/verifier/test_output.py:72
Functiontest_action_items_is_list
(notes)
tasks/communication/comm-009-meeting-notes/verifier/test_output.py:67
Functiontest_action_items_not_empty
(summary)
tasks/communication/comm-006-thread-summary/verifier/test_output.py:64
← previousnext →1,101–1,200 of 7,113, ranked by callers