Functions — github.com/IBM/AssetOpsBench

hub / github.com/IBM/AssetOpsBench / functions

Functions947 in github.com/IBM/AssetOpsBench

⨍ Functions 947◇ Types & classes 171↳ Endpoints 13

Methodtest_get_unknown_raises

(self)

src/evaluation/tests/test_scorers.py:56

Methodtest_group_param

(self)

src/servers/vibration/tests/test_tools.py:122

Methodtest_handles_markdown_fenced_response

(self, make_scenario)

src/evaluation/tests/test_scorers.py:97

Methodtest_handles_none_trajectory

(self, make_persisted_record)

src/evaluation/tests/test_metrics.py:42

Methodtest_handles_unparseable_response

(self, make_scenario)

src/evaluation/tests/test_scorers.py:91

Functiontest_init_tracing_enables_with_file_only

OTEL_TRACES_FILE alone is enough to activate tracing.

src/observability/tests/test_tracing.py:55

Functiontest_init_tracing_noop_without_env

(monkeypatch)

src/observability/tests/test_tracing.py:39

Functiontest_init_tracing_skips_when_disabled

(monkeypatch)

src/observability/tests/test_tracing.py:47

Methodtest_install_registers_under_default_name

(self, make_scenario)

src/evaluation/tests/test_scorers.py:110

Methodtest_integrated_tsad_returns_csv

Smoke test: run integrated TSAD on a small synthetic dataset.

src/servers/tsfm/tests/test_tools.py:279

Methodtest_integration

(self)

src/servers/fmsr/tests/test_tools.py:136

Methodtest_invalid_date_range

(self)

src/servers/iot/tests/test_tools.py:127

Methodtest_invalid_json_content

(self)

src/servers/utilities/tests/test_utilities.py:97

Methodtest_invalid_site

(self)

src/servers/iot/tests/test_tools.py:31

Methodtest_invalid_site

(self)

src/servers/iot/tests/test_tools.py:70

Methodtest_invalid_task_returns_error

(self)

src/servers/tsfm/tests/test_tools.py:178

Functiontest_is_openai_compat

()

src/llm/tests/test_routers.py:48

Functiontest_is_openai_compat

()

src/llm/tests/test_backends.py:38

Methodtest_iso_format

(self)

src/servers/utilities/tests/test_utilities.py:32

Functiontest_join_drops_orphans

(make_persisted_record)

src/evaluation/tests/test_loader.py:59

Functiontest_json_events_parses_ndjson_and_plain_lines

()

src/agent/opencode_agent/tests/test_runner.py:141

Methodtest_keeps_short_numeric_suffix

(self)

src/evaluation/tests/test_metrics.py:145

Methodtest_known_bearing

(self)

src/servers/vibration/tests/test_dsp.py:167

Functiontest_lifecycle

()

src/servers/wo/tests/test_workorders.py:191

Methodtest_linear_chain

(self)

src/agent/tests/test_models.py:23

Methodtest_list_integration

(self)

src/servers/vibration/tests/test_tools.py:296

Methodtest_llm_unavailable_returns_error

(self, no_llm)

src/servers/fmsr/tests/test_tools.py:122

Functiontest_load_scenario_ids_ignores_blank_lines_and_comments

(tmp_path: Path)

src/benchmark/tests/test_scenario_suite_runner.py:11

Functiontest_load_scenario_ids_raises_for_missing_file

(tmp_path: Path)

src/benchmark/tests/test_scenario_suite_runner.py:30

Functiontest_load_scenarios_from_groundtruth_folders

(tmp_path)

src/evaluation/tests/test_loader.py:98

Functiontest_load_scenarios_json_list

(tmp_path: Path)

src/evaluation/tests/test_loader.py:30

Functiontest_load_scenarios_jsonl

(tmp_path: Path)

src/evaluation/tests/test_loader.py:42

Functiontest_load_scenarios_single_object

(tmp_path: Path)

src/evaluation/tests/test_loader.py:52

Functiontest_load_trajectories_from_dir

(trajectory_dir: Path)

src/evaluation/tests/test_loader.py:16

Functiontest_load_trajectories_skips_unparseable

(tmp_path: Path, make_persisted_record)

src/evaluation/tests/test_loader.py:23

Functiontest_load_trajectory_uses_filename_as_scenario_id_when_missing

(tmp_path)

src/evaluation/tests/test_loader.py:75

Functiontest_make_backend_dispatch

()

src/llm/tests/test_backends.py:44

Methodtest_malformed_date

(self)

src/servers/iot/tests/test_tools.py:142

Functiontest_method_output_paths_nest_by_agent_and_model

(tmp_path: Path)

src/benchmark/tests/test_scenario_suite_runner.py:121

Functiontest_missing_and_extra_keys_are_reported

()

src/evaluation/tests/test_static_json_scorer.py:74

Methodtest_missing_characteristic_short_circuits

(self, make_scenario)

src/evaluation/tests/test_scorers.py:103

Methodtest_missing_data_id

(self)

src/servers/vibration/tests/test_tools.py:64

Methodtest_missing_data_id

(self)

src/servers/vibration/tests/test_tools.py:96

Methodtest_missing_data_id

(self)

src/servers/vibration/tests/test_tools.py:260

Methodtest_missing_deps_returns_error

(self)

src/servers/tsfm/tests/test_tools.py:97

Functiontest_model_dir_name_normalizes_router_model_ids

()

src/benchmark/tests/test_scenario_suite_runner.py:112

Functiontest_model_id_property_keeps_full_string

()

src/llm/tests/test_backends.py:70

Methodtest_multiple_dependencies

(self)

src/agent/tests/test_planner.py:100

Methodtest_no_dependencies_preserves_order

(self)

src/agent/tests/test_models.py:19

Methodtest_no_dependency

(self)

src/agent/tests/test_planner.py:92

Methodtest_no_matching_blocks_yields_empty_plan

(self)

src/agent/tests/test_planner.py:116

Methodtest_no_rpm

Without RPM we expect a partial result with a warning.

src/servers/vibration/tests/test_tools.py:196

Methodtest_nonexistent_file

(self)

src/servers/utilities/tests/test_utilities.py:90

Methodtest_not_found_returns_none

(self)

src/agent/tests/test_models.py:69

Methodtest_numeric_match_not_implemented

(self, make_scenario)

src/evaluation/tests/test_scorers.py:31

Functiontest_numeric_partial_similarity

()

src/evaluation/tests/test_static_json_scorer.py:99

Methodtest_open_ended_integration

(self)

src/servers/iot/tests/test_tools.py:188

Functiontest_orchestrator_accumulates_token_usage_across_llm_calls

Plan + 2 arg-resolution + summarise → summed input/output tokens.

src/agent/tests/test_runner.py:164

Functiontest_orchestrator_all_steps_succeed

(sequential_llm)

src/agent/tests/test_runner.py:122

Functiontest_orchestrator_no_tool_returns_expected_output

A step with tool=none returns expected_output without any MCP or LLM call.

src/agent/tests/test_runner.py:183

Functiontest_orchestrator_run_returns_result

(sequential_llm)

src/agent/tests/test_runner.py:103

Functiontest_orchestrator_unknown_server_recorded_as_error

(sequential_llm)

src/agent/tests/test_runner.py:131

Methodtest_parallel_independent_steps

(self)

src/agent/tests/test_models.py:41

Functiontest_parallel_tool_calls_keep_their_own_outputs

Two tool calls emitted before their outputs must not be mismatched.

src/agent/opencode_agent/tests/test_runner.py:300

Functiontest_parse_count_only_answer

()

src/evaluation/tests/test_static_json_scorer.py:29

Functiontest_parse_json_embedded

()

src/agent/tests/test_runner.py:583

Functiontest_parse_json_empty_object_returns_empty_dict

()

src/agent/tests/test_runner.py:591

Functiontest_parse_json_markdown_fence

()

src/agent/tests/test_runner.py:579

Functiontest_parse_json_object_from_noisy_markdown_answer

()

src/evaluation/tests/test_static_json_scorer.py:8

Functiontest_parse_json_plain

()

src/agent/tests/test_runner.py:575

Functiontest_parse_json_unrecoverable_returns_none

()

src/agent/tests/test_runner.py:587

Functiontest_parse_noisy_count_answer

()

src/evaluation/tests/test_static_json_scorer.py:33

Functiontest_parse_python_style_dict

()

src/evaluation/tests/test_static_json_scorer.py:14

Functiontest_parse_python_style_list_of_tuples

()

src/evaluation/tests/test_static_json_scorer.py:20

Functiontest_parse_tool_call_embedded_json

()

src/agent/tests/test_runner.py:619

Functiontest_parse_tool_call_null_tool

()

src/agent/tests/test_runner.py:612

Functiontest_parse_tool_call_plain_json

()

src/agent/tests/test_runner.py:598

Functiontest_parse_tool_call_unrecoverable_returns_direct_answer

()

src/agent/tests/test_runner.py:625

Functiontest_parse_tool_call_with_markdown_fence

()

src/agent/tests/test_runner.py:605

Methodtest_passes_when_all_criteria_true

(self, make_scenario)

src/evaluation/tests/test_scorers.py:74

Functiontest_persist_creates_nested_dir

(monkeypatch, tmp_path: Path)

src/observability/tests/test_persistence.py:137

Functiontest_persist_disabled_without_env

(monkeypatch, tmp_path: Path)

src/observability/tests/test_persistence.py:45

Functiontest_persist_serializes_list_trajectory

plan-execute trajectories are list[StepResult] (dataclasses).

src/observability/tests/test_persistence.py:96

Functiontest_persist_skips_when_no_run_id

Env set but run_id missing → warn + skip (don't lose data silently).

src/observability/tests/test_persistence.py:121

Functiontest_persist_writes_file

(monkeypatch, tmp_path: Path)

src/observability/tests/test_persistence.py:59

Functiontest_persisted_trajectory_allows_none_scenario_id

()

src/evaluation/tests/test_models.py:33

Functiontest_persisted_trajectory_coerces_scenario_id

()

src/evaluation/tests/test_models.py:18

Functiontest_pipeline_uses_llm_args_for_each_step

End-to-end: executor generates args via LLM for every tool step.

src/agent/tests/test_runner.py:423

Methodtest_plan_execute_list_trajectory

(self, make_persisted_record)

src/evaluation/tests/test_metrics.py:92

Functiontest_prefix_constants

()

src/llm/tests/test_routers.py:17

Methodtest_pure_sine

(self)

src/servers/vibration/tests/test_dsp.py:51

Methodtest_raw_preserved

(self)

src/agent/tests/test_planner.py:104

Functiontest_read_question_raises_when_missing

(tmp_path: Path)

src/benchmark/tests/test_scenario_suite_runner.py:50

Functiontest_read_question_reads_question_txt

(tmp_path: Path)

src/benchmark/tests/test_scenario_suite_runner.py:42

Methodtest_reads_nested_json

(self)

src/servers/utilities/tests/test_utilities.py:77

Methodtest_reads_valid_json

(self)

src/servers/utilities/tests/test_utilities.py:65

Functiontest_render_summary_includes_headlines

()

src/evaluation/tests/test_report.py:99

Methodtest_renders_markdown

(self)

src/servers/vibration/tests/test_dsp.py:242

Functiontest_resolve_args_missing_step_keeps_placeholder

()

src/agent/tests/test_runner.py:562

Functiontest_resolve_args_no_placeholders

()

src/agent/tests/test_runner.py:551

← previous next →701–800 of 947, ranked by callers