Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/claw-bench/claw-bench
/ functions
Functions
7,113 in github.com/claw-bench/claw-bench
⨍
Functions
7,113
◇
Types & classes
369
↳
Endpoints
89
Function
test_action_items_table_format
Action items should be in a table with pipe delimiters.
tasks/document-editing/doc-016-meeting-minutes/verifier/test_output.py:110
Function
test_action_required_is_true
action_required should be true for this email.
tasks/email/eml-006-generate-summary/verifier/test_output.py:51
Function
test_actions_are_non_empty_strings
(user_stories)
tasks/planning/plan-001/verifier/test_output.py:68
Function
test_actions_log_exists
actions_log.json must exist.
tasks/workflow-automation/wfl-006-event-driven-workflow/verifier/test_output.py:36
Method
test_adapter_exception_captured_in_error
When the adapter raises, error is captured in the result.
tests/unit/test_runner_edge_cases.py:128
Method
test_adapters_partially_failed
(self)
tests/unit/test_doctor_cli.py:465
Function
test_add_avatar_url
users should get avatar_url column.
tasks/multimodal/mm-006-schema-migration/verifier/test_output.py:54
Function
test_add_is_edited_to_comments
comments should get is_edited column.
tasks/multimodal/mm-006-schema-migration/verifier/test_output.py:79
Function
test_add_is_verified
users should get is_verified column.
tasks/multimodal/mm-006-schema-migration/verifier/test_output.py:59
Function
test_add_parent_id_to_comments
comments should get parent_id column.
tasks/multimodal/mm-006-schema-migration/verifier/test_output.py:74
Function
test_add_published_at
posts should get published_at column.
tasks/multimodal/mm-006-schema-migration/verifier/test_output.py:69
Function
test_add_slug_to_posts
posts should get slug column.
tasks/multimodal/mm-006-schema-migration/verifier/test_output.py:64
Function
test_added_has_at_least_3_elements
There should be at least 3 added elements detected.
tasks/web-browsing/web-010-html-diff-report/verifier/test_output.py:195
Function
test_added_is_list
(changes)
tasks/document-editing/doc-005-document-comparison/verifier/test_output.py:30
Function
test_addition_database_ssl
(diff_report)
tasks/multimodal/mm-014-structured-diff-reporter/verifier/test_output.py:55
Function
test_addition_logging_format
(diff_report)
tasks/multimodal/mm-014-structured-diff-reporter/verifier/test_output.py:62
Function
test_additions_count
(diff_report)
tasks/multimodal/mm-014-structured-diff-reporter/verifier/test_output.py:50
Function
test_additions_sorted
(diff_report)
tasks/multimodal/mm-014-structured-diff-reporter/verifier/test_output.py:140
Function
test_address_cities
Each address must have the correct city.
tasks/database/db-004/verifier/test_output.py:145
Function
test_address_states
Each address must have the correct state.
tasks/database/db-004/verifier/test_output.py:156
Function
test_address_streets
Each address must have the correct street.
tasks/database/db-004/verifier/test_output.py:133
Function
test_address_zips
Each address must have the correct zip.
tasks/database/db-004/verifier/test_output.py:167
Function
test_addresses_count
addresses should have exactly 8 rows.
tasks/database/db-004/verifier/test_output.py:103
Function
test_addresses_foreign_key_valid
All address user_ids should reference existing users_new rows.
tasks/database/db-004/verifier/test_output.py:199
Function
test_addresses_performance_ambiguity
Analysis must address the vague performance requirements.
tasks/memory/mem-008-ambiguous-requirements/verifier/test_output.py:72
Function
test_addresses_table_exists
addresses table must exist after migration.
tasks/database/db-004/verifier/test_output.py:87
Function
test_addresses_timeline_ambiguity
Analysis must address the vague timeline.
tasks/memory/mem-008-ambiguous-requirements/verifier/test_output.py:80
Function
test_addresses_vague_quantities
Analysis must address at least one vague quantity like 'large number' or 'reasonable period'.
tasks/memory/mem-008-ambiguous-requirements/verifier/test_output.py:61
Method
test_adds_clarifications_after_requirements
(self)
tests/unit/test_robustness.py:155
Method
test_adds_hint_after_output_heading
(self)
tests/unit/test_robustness.py:165
Function
test_advanced_before_webhooks
(structured)
tasks/document-editing/doc-008-document-restructuring/verifier/test_output.py:53
Method
test_affected_systems_have_required_fields
(self, report)
tasks/cross-domain/xdom-013-incident-response-pipeline/verifier/test_output.py:158
Method
test_age_available_returns_bool
(self)
tests/unit/test_crypto.py:9
Function
test_age_has_min_max
(fields)
tasks/web-browsing/web-004-form-inventory/verifier/test_output.py:60
Method
test_age_not_found
(self)
tests/unit/test_doctor_cli.py:439
Function
test_age_threshold_applied
Files older than 7 days must be marked for rotation.
tasks/system-admin/sys-008-log-rotation-script/verifier/test_output.py:60
Function
test_agenda_section
Must contain an Agenda section with all 5 items.
tasks/calendar/cal-013-meeting-notes-generator/verifier/test_output.py:60
Function
test_agent_logs_exist
At least 2 rounds of developer + reviewer logs must exist.
tasks/multi-agent/mag-001-code-review-pipeline/verifier/test_output.py:87
Function
test_agent_logs_exist
(workspace)
tasks/multi-agent/mag-004-project-decomposition/verifier/test_output.py:30
Function
test_agent_logs_substantive
Review logs must contain substantive content, not just placeholders.
tasks/multi-agent/mag-001-code-review-pipeline/verifier/test_output.py:98
Function
test_aggregated_file_exists
aggregated_results.json must exist.
tasks/workflow-automation/wfl-005-parallel-task-fanout/verifier/test_output.py:23
Function
test_aggregation_categories
Aggregation must cover Electronics, Clothing, and Books.
tasks/cross-domain/xdom-006-csv-data-pipeline/verifier/test_output.py:87
Function
test_aggregation_exists
aggregation.json must exist.
tasks/cross-domain/xdom-006-csv-data-pipeline/verifier/test_output.py:45
Function
test_aggregation_has_groups
Aggregation must have groups.
tasks/cross-domain/xdom-006-csv-data-pipeline/verifier/test_output.py:81
Function
test_aggregation_revenue_values
Aggregation revenue values must be approximately correct.
tasks/cross-domain/xdom-006-csv-data-pipeline/verifier/test_output.py:95
Function
test_alert_required_fields
Each alert must have required fields.
tasks/cross-domain/xdom-004-log-to-alert/verifier/test_output.py:46
Function
test_alert_severities_valid
All alert severities must be valid values.
tasks/cross-domain/xdom-004-log-to-alert/verifier/test_output.py:105
Function
test_alerts_correctness
(workspace)
tasks/clinical-data/med-002-lab-abnormality/verifier/test_output.py:26
Function
test_alerts_file_exists
alerts.json must exist.
tasks/cross-domain/xdom-004-log-to-alert/verifier/test_output.py:31
Function
test_algorithm_file_exists
(workspace)
tasks/math-reasoning/math-005/verifier/test_output.py:59
Function
test_algorithm_is_string
(solution)
tasks/math-reasoning/math-002/verifier/test_output.py:124
Function
test_algorithm_non_empty
(solution)
tasks/math-reasoning/math-002/verifier/test_output.py:129
Function
test_algorithm_not_brute_force
(algorithm_path)
tasks/math-reasoning/math-005/verifier/test_output.py:188
Function
test_algorithm_py_has_function
(algorithm_path)
tasks/math-reasoning/math-005/verifier/test_output.py:174
Function
test_algorithm_py_no_hardcoded_answer
(algorithm_path)
tasks/math-reasoning/math-005/verifier/test_output.py:216
Function
test_algorithm_py_output_correct
(workspace, algorithm_path)
tasks/math-reasoning/math-005/verifier/test_output.py:144
Function
test_algorithm_py_reads_input
(algorithm_path)
tasks/math-reasoning/math-005/verifier/test_output.py:200
Function
test_algorithm_py_runs
(workspace, algorithm_path)
tasks/math-reasoning/math-005/verifier/test_output.py:126
Function
test_algorithm_py_writes_output
(algorithm_path)
tasks/math-reasoning/math-005/verifier/test_output.py:208
Function
test_algorithm_reasonable_complexity
Check that algorithm doesn't have obvious exponential patterns.
tasks/math-reasoning/math-005/verifier/test_output.py:236
Function
test_alice_address_complete
Spot-check: Alice Chen's address should be fully parsed.
tasks/database/db-004/verifier/test_output.py:218
Function
test_alice_alert_channels
(routed)
tasks/communication/comm-005-notification-routing/verifier/test_output.py:38
Function
test_alice_blocked
Alice should be blocked.
tasks/workflow-automation/wfl-017-standup-aggregator/verifier/test_output.py:70
Function
test_alice_completed_count
Alice should have 2 completed items.
tasks/workflow-automation/wfl-017-standup-aggregator/verifier/test_output.py:88
Function
test_alice_electronics_revenue
Alice Zhang Electronics revenue should be ~89.97 (3 * 29.99).
tasks/data-analysis/data-015-multi-table-join/verifier/test_output.py:46
Function
test_alice_email_updated
Alice's email must be updated to alice@newmail.com.
tasks/memory/mem-012-fact-extraction-and-update/verifier/test_output.py:69
Function
test_alice_late_dates
Alice should be late on 2026-03-10 and 2026-03-12.
tasks/data-analysis/data-017-employee-attendance-report/verifier/test_output.py:74
Function
test_alice_late_days
Alice should have 2 late days.
tasks/data-analysis/data-017-employee-attendance-report/verifier/test_output.py:68
Function
test_alice_latest_signature
Alice appears 3 times; latest signature should contain 'Security Team Lead'.
tasks/email/eml-013-signature-extractor/verifier/test_output.py:56
Function
test_alice_phone_updated
Alice's phone must be updated to 555-0101.
tasks/memory/mem-012-fact-extraction-and-update/verifier/test_output.py:60
Function
test_alice_punctuality
Alice punctuality_rate should be 0.60.
tasks/data-analysis/data-017-employee-attendance-report/verifier/test_output.py:81
Function
test_alice_total_hours
Alice total_hours should be approximately 41.75.
tasks/data-analysis/data-017-employee-attendance-report/verifier/test_output.py:60
Function
test_alignment_identity_similarity_values
(workspace)
tasks/bioinformatics/bio-002-protein-alignment/verifier/test_output.py:35
Function
test_alignment_matrix
(workspace)
tasks/educational-assessment/edu-004-curriculum-mapping/verifier/test_output.py:12
Function
test_alignment_results_file_exists
(workspace)
tasks/bioinformatics/bio-002-protein-alignment/verifier/test_output.py:14
Function
test_alignment_results_format
(workspace)
tasks/bioinformatics/bio-002-protein-alignment/verifier/test_output.py:19
Function
test_alignment_summary
(workspace)
tasks/educational-assessment/edu-004-curriculum-mapping/verifier/test_output.py:33
Function
test_all_20_rules_checked
All 20 rules must be checked.
tasks/security/sec-014-compliance-audit/verifier/test_output.py:57
Function
test_all_above_salary_threshold
All returned salaries must be greater than 80000.
tasks/database/db-001/verifier/test_output.py:104
Method
test_all_adapters_are_importable
(self)
tests/unit/test_doctor_cli.py:380
Method
test_all_adapters_importable
(self)
tests/unit/test_doctor_cli.py:259
Function
test_all_ages_above_25
(filtered_rows)
tasks/data-analysis/data-002/verifier/test_output.py:30
Function
test_all_amounts_are_numeric
All expense amounts must be numbers, not strings.
tasks/email/eml-018-expense-receipt-emails/verifier/test_output.py:87
Function
test_all_applications_processed
All 8 applications must be in the output.
tasks/workflow-automation/wfl-007-branching-workflow/verifier/test_output.py:34
Function
test_all_arrays
(diff_report)
tasks/multimodal/mm-014-structured-diff-reporter/verifier/test_output.py:39
Function
test_all_channels_covered
(metrics)
tasks/communication/comm-008-communication-audit/verifier/test_output.py:48
Function
test_all_chapters_present
(book)
tasks/document-editing/doc-007-multi-doc-merge/verifier/test_output.py:33
Method
test_all_checks_failed_exit_code
(self)
tests/unit/test_doctor_cli.py:475
Function
test_all_content_preserved
(formatted)
tasks/document-editing/doc-001-text-formatting/verifier/test_output.py:30
Function
test_all_criteria_present
(workspace)
tasks/educational-assessment/edu-001-rubric-grading/verifier/test_output.py:51
Function
test_all_csv_rows_present
All 7 team members from CSV must be in the report.
tasks/cross-domain/xdom-007-multi-format-conversion/verifier/test_output.py:57
Function
test_all_dangerous_files_flagged
All 6 dangerous files must be flagged.
tasks/security/sec-003-check-file-permissions/verifier/test_output.py:50
Function
test_all_data_present
All original data values must be present.
tasks/document-editing/doc-009-markdown-table-formatter/verifier/test_output.py:148
Function
test_all_data_present
All 12 data entries must be present.
tasks/file-operations/file-005-merge-files/verifier/test_output.py:45
Function
test_all_dates_converted
(result)
tasks/document-editing/doc-004-find-replace/verifier/test_output.py:29
Function
test_all_deadlines_valid_march_2026
All deadlines should be valid dates in March 2026.
tasks/cross-domain/xdom-016-meeting-to-tasks/verifier/test_output.py:89
Function
test_all_depends_on_install_and_test
(makefile_content)
tasks/real-tools/tool-004/verifier/test_output.py:160
Method
test_all_diff_files_present
(self, review)
tasks/cross-domain/xdom-015-automated-code-review-report/verifier/test_output.py:77
Function
test_all_directories_listed
All directories must appear in the tree.
tasks/file-operations/file-010-directory-tree/verifier/test_output.py:33
Method
test_all_domains_have_curated_skills
(self)
tests/unit/test_runner_skills.py:102
← previous
next →
1,201–1,300 of 7,113, ranked by callers