MCPcopy Create free account

hub / github.com/claw-bench/claw-bench / functions

Functions7,113 in github.com/claw-bench/claw-bench

↓ 1 callersFunction_get_task_stats
Return (total_count, {domain: count}) for all tasks.
src/claw_bench/cli/doctor.py:111
↓ 1 callersMethod_get_user_sem
(self, user_id: str)
src/claw_bench/core/queue.py:90
↓ 1 callersFunction_has_for_loop_with_append
Check if a function has a for-loop that appends to a list.
tasks/code-assistance/code-006-refactor-comprehensions/verifier/test_output.py:50
↓ 1 callersFunction_hash_password
(password: str)
src/claw_bench/server/admin.py:383
↓ 1 callersFunction_history_dir
(claw_id: str)
src/claw_bench/core/moltbook_registry.py:48
↓ 1 callersFunction_home
()
src/claw_bench/core/moltbook_registry.py:34
↓ 1 callersFunction_iter_task_dirs
(tasks_root: Path = _TASKS_ROOT)
src/claw_bench/cli/validate.py:60
↓ 1 callersFunction_level_breakdown
Compute mean score per difficulty level from task results.
scripts/generate_sample_results.py:206
↓ 1 callersFunction_load_checkpoint
Load previously completed results from a checkpoint file.
src/claw_bench/core/runner.py:284
↓ 1 callersFunction_load_curated_quick_tasks
Load curated quick-task IDs from config/quick_tasks.yaml if it exists.
src/claw_bench/core/test_tiers.py:53
↓ 1 callersFunction_load_experts
Load all expert accounts from disk.
src/claw_bench/server/admin.py:353
↓ 1 callersFunction_map_domain_label_to_key
Map a human-readable domain label to the domain key.
scripts/generate_task_from_proposal.py:132
↓ 1 callersFunction_parse_actions_list
Parse a free-text list of actions into standardized action keys.
scripts/generate_task_from_proposal.py:158
↓ 1 callersFunction_parse_llm_output
Parse LLM output into a dict of relative_path -> content.
src/claw_bench/server/task_generator.py:386
↓ 1 callersFunction_parse_llm_output
Parse the LLM's output into a dict of filepath -> content.
scripts/generate_task_from_proposal.py:416
↓ 1 callersFunction_parse_report_weighted
Parse JSON report with weight marker support.
src/claw_bench/core/verifier.py:79
↓ 1 callersFunction_print_results
(results)
src/claw_bench/cli/run.py:166
↓ 1 callersFunction_print_task_plan
(tasks: list[TaskConfig], max_rows: int = 24)
src/claw_bench/cli/run.py:152
↓ 1 callersMethod_promote_to_memory
(self, ks: str, result: Dict, created_at: float)
src/claw_bench/core/cache.py:170
↓ 1 callersFunction_resolve_claw_id
Derive a stable clawId from nickname + device fingerprint. Same nickname + same device → always the same clawId, regardless of model. If the
src/claw_bench/server/submit_api.py:779
↓ 1 callersFunction_result_filename
(r: dict)
src/claw_bench/server/admin.py:106
↓ 1 callersFunction_run_generation
Run LLM generation in background thread.
src/claw_bench/server/task_generator.py:496
↓ 1 callersFunction_select_tasks
Load tasks and apply CLI filters.
src/claw_bench/cli/run.py:104
↓ 1 callersMethod_send_cmdop
Call via CMDOP skill system.
src/claw_bench/adapters/openclaw.py:376
↓ 1 callersMethod_send_direct
Run a ReAct agent loop: Think → Act → Observe → repeat.
src/claw_bench/adapters/openclaw.py:266
↓ 1 callersFunction_set_active_model
(model_id: str)
src/claw_bench/server/task_generator.py:161
↓ 1 callersFunction_slugify
(text: str)
src/claw_bench/server/task_generator.py:233
↓ 1 callersFunction_sync_domains_json
Regenerate data/config/domains.json from TASK_ID_TO_DOMAIN.
src/claw_bench/server/submit_api.py:552
↓ 1 callersFunction_text_overlap
Jaccard similarity on 3-gram word shingles.
tasks/multi-agent/mag-002-research-debate/verifier/test_output.py:16
↓ 1 callersFunction_update_existing_claw
Update existing Claw record directly (best score kept, models tracked).
src/claw_bench/server/submit_api.py:1044
↓ 1 callersFunction_validate_score_consistency
Weighted overall should roughly match the reported overall.
src/claw_bench/server/submit_api.py:728
↓ 1 callersFunctionanalyze
Print comprehensive analysis.
scripts/run_benchmark_50.py:128
↓ 1 callersFunctionapprovePending
(fn: string)
leaderboard/src/app/admin/page.tsx:378
↓ 1 callersFunctionarchive_tasks
Move selected tasks to the archive directory.
scripts/rotate-tasks.py:81
↓ 1 callersFunctionassess_effectiveness
(freq, ctype)
tasks/regulatory-compliance/reg-002-sox-controls/verifier/test_output.py:72
↓ 1 callersMethodasync_acquire
Async version — yields to event loop while waiting.
src/claw_bench/core/rate_limiter.py:56
↓ 1 callersFunctionautocorr
(x, lag)
tasks/data-science/ds-004-time-series/verifier/test_output.py:84
↓ 1 callersFunctionbarWidth
(value: number)
leaderboard/src/app/skills-gain/SkillsGainContent.tsx:23
↓ 1 callersFunctionbestFramework
(cap: string)
leaderboard/src/app/capabilities/CapabilitiesContent.tsx:81
↓ 1 callersFunctionbleu_like_score
(source_text, translation_text)
tasks/content-analysis/cont-005-translation-qa/verifier/test_output.py:21
↓ 1 callersFunctioncalculate_sum
(values)
tasks/debugging/debug-001/environment/data/buggy.py:7
↓ 1 callersFunctioncall_llm
Call the LLM via the OpenAI-compatible API.
scripts/generate_task_from_proposal.py:255
↓ 1 callersFunctioncellColor
(score: number | null)
leaderboard/src/app/matrix/MatrixContent.tsx:12
↓ 1 callersFunctioncellOpacity
(score: number | null)
leaderboard/src/app/matrix/MatrixContent.tsx:19
↓ 1 callersFunctionchangeExpertRole
(un: string, role: string)
leaderboard/src/app/admin/page.tsx:322
↓ 1 callersFunctioncheck_compliance
(record)
tasks/regulatory-compliance/reg-001-gdpr-audit/verifier/test_output.py:56
↓ 1 callersFunctioncheck_criteria
(patient)
tasks/clinical-data/med-005-trial-eligibility/verifier/test_output.py:55
↓ 1 callersMethodclassify
(cls, error_str: str | None)
src/claw_bench/core/runner.py:48
↓ 1 callersFunctionclassify_control
(description, ctype)
tasks/regulatory-compliance/reg-002-sox-controls/verifier/test_output.py:63
↓ 1 callersFunctioncomputeDualTrackOverall
(row: BenchResultData, weights: Record<string, number>)
leaderboard/src/app/LeaderboardTable.tsx:92
↓ 1 callersFunctioncomputePareto
(points: ParetoPoint[])
leaderboard/src/app/pareto/page.tsx:25
↓ 1 callersFunctioncompute_gain
Compute progressive gain between current results and a vanilla baseline. Parameters ---------- current_results: The ``scores`` bl
src/claw_bench/core/baseline.py:53
↓ 1 callersFunctioncompute_subject_scores
Compute difficulty-weighted scores for each subject-matter domain. Parameters ---------- results: All task results (will be filte
src/claw_bench/core/scorer.py:359
↓ 1 callersMethodconfigure
Override rate limit for a provider.
src/claw_bench/core/rate_limiter.py:100
↓ 1 callersFunctioncreate_attestation
Build a signed attestation object for a result submission.
src/claw_bench/core/moltbook_registry.py:225
↓ 1 callersMethodcreate_comment
Create a new comment on a post.
tasks/multimodal/mm-007-architecture-doc/environment/data/project/services.py:92
↓ 1 callersMethodcreate_post
Create a new blog post.
tasks/multimodal/mm-007-architecture-doc/environment/data/project/services.py:55
↓ 1 callersMethodcreate_task
(self, data: Dict[str, Any])
tasks/multimodal/mm-007-architecture-doc/environment/data/project/api.py:34
↓ 1 callersMethodcreate_user
(self, data: Dict[str, Any])
tasks/multimodal/mm-007-architecture-doc/environment/data/project/api.py:22
↓ 1 callersMethodcreate_user
(self, username: str, email: str, display_name: str = "")
tasks/multimodal/mm-007-architecture-doc/environment/data/project/service.py:16
↓ 1 callersFunctiondedupByProfile
Dedup results by profileId — keep the entry with the highest overall score.
leaderboard/src/app/page.tsx:85
↓ 1 callersFunctiondeleteAgent
(id: string)
leaderboard/src/app/admin/page.tsx:375
↓ 1 callersFunctiondeleteExpert
(un: string)
leaderboard/src/app/admin/page.tsx:327
↓ 1 callersFunctiondeleteGeneratedTask
(genId: string)
leaderboard/src/app/admin/page.tsx:502
↓ 1 callersFunctiondeleteProposal
(proposalId: string)
leaderboard/src/app/admin/page.tsx:452
↓ 1 callersFunctiondeleteResult
(fn: string)
leaderboard/src/app/admin/page.tsx:350
↓ 1 callersFunctiondeleteSkillsGainEntry
(idx: number)
leaderboard/src/app/admin/page.tsx:361
↓ 1 callersFunctiondetect_output_files
Detect output files from instruction and verifier code.
scripts/enhance_verifiers.py:30
↓ 1 callersFunctiondiscover_tasks
Discover all tasks with their metadata.
scripts/rotate-tasks.py:28
↓ 1 callersFunctiondivide
(a, b)
tasks/debugging/debug-002/environment/data/calculator.py:12
↓ 1 callersFunctionenhance_verifier
Enhance a single task's verifier. Returns (added_count, summary).
scripts/enhance_verifiers.py:227
↓ 1 callersFunctionfactorial
(n)
tasks/debugging/debug-002/environment/data/calculator.py:1
↓ 1 callersFunctionfillTemplate
(template: string, vars: Record<string, string | number>)
leaderboard/src/app/HomeHeader.tsx:14
↓ 1 callersFunctionfind_baseline
Locate the vanilla baseline summary.json for a framework+model pair. Searches for ``results/{framework}-{model}-vanilla/summary.json`` relative
src/claw_bench/core/baseline.py:10
↓ 1 callersMethodfind_by_assignee
(self, user_id: int)
tasks/multimodal/mm-007-architecture-doc/environment/data/project/repository.py:45
↓ 1 callersFunctionfix_fin006_hardcoded
Fix fin-006 setup.sh that ignores $1 parameter.
scripts/fix_task_bugs.py:203
↓ 1 callersFunctionfix_heredoc_fstring
Fix Python f-strings in heredocs that reference undefined WORKSPACE variable.
scripts/fix_task_bugs.py:53
↓ 1 callersFunctionfix_missing_data_dir
Fix setup.sh that copies from non-existent data/ directory.
scripts/fix_task_bugs.py:25
↓ 1 callersFunctionfix_verifier_workspace
Fix verifiers that use CLAW_WORKSPACE/os.environ instead of --workspace.
scripts/fix_task_bugs.py:96
↓ 1 callersFunctionfix_workspace_export
Add 'export WORKSPACE' where it's used by embedded Python but not exported.
scripts/fix_task_bugs.py:174
↓ 1 callersFunctionformat_output
(values)
tasks/debugging/debug-001/environment/data/buggy.py:14
↓ 1 callersFunctionformat_output
(data)
tasks/debugging/debug-004/environment/data/utils.py:9
↓ 1 callersFunctiongenerate_quality_checks
Generate quality tier test functions.
scripts/enhance_verifiers.py:117
↓ 1 callersFunctiongenerate_robustness_checks
Generate robustness test functions.
scripts/enhance_verifiers.py:60
↓ 1 callersFunctiongenerate_strictness_checks
Generate strictness test functions.
scripts/enhance_verifiers.py:179
↓ 1 callersFunctiongenerate_task_files
Call LLM to generate all task files from a proposal. Returns a dict mapping relative file paths to their content.
scripts/generate_task_from_proposal.py:285
↓ 1 callersFunctiongenerate_task_id
Generate the next task ID for a domain (e.g., fin-001, cs-002).
scripts/generate_task_from_proposal.py:209
↓ 1 callersFunctionget_config_value
Get a configuration value by key.
tasks/debugging/debug-003/environment/data/processor.py:6
↓ 1 callersFunctionget_first_element
Get the first element from a list.
tasks/debugging/debug-003/environment/data/processor.py:11
↓ 1 callersFunctionget_flag
(code: str)
src/claw_bench/server/geoip.py:108
↓ 1 callersFunctionget_indexes
(table)
tasks/cs-engineering/cs-002-db-migration/verifier/test_output.py:55
↓ 1 callersMethodget_metrics
(self)
src/claw_bench/adapters/base.py:37
↓ 1 callersMethodget_system_status
(self)
src/claw_bench/core/resource_monitor.py:118
↓ 1 callersFunctionget_user_name
Extract the full name from a user dict.
tasks/debugging/debug-003/environment/data/processor.py:1
↓ 1 callersMethodget_workspace_state
(self)
src/claw_bench/adapters/openclaw.py:433
↓ 1 callersMethodget_workspace_state
(self)
tests/unit/test_registry.py:24
↓ 1 callersFunctiongreet
(name)
tasks/debugging/debug-001/environment/data/buggy.py:1
↓ 1 callersFunctionhash_password
Hash a plaintext password using bcrypt.
tasks/multimodal/mm-007-architecture-doc/environment/data/project/auth.py:21
↓ 1 callersFunctioninit_db
Initialize the database by creating all tables.
tasks/multimodal/mm-007-architecture-doc/environment/data/project/database.py:25
↓ 1 callersMethodis_available
Check if the product is in stock. Returns: True if stock > 0, False otherwise.
tasks/cross-domain/xdom-012-automated-docs-generator/environment/data/models.py:65
← previousnext →301–400 of 7,113, ranked by callers