MCPcopy Create free account

hub / github.com/JingbiaoMei/ATM-Bench / functions

Functions815 in github.com/JingbiaoMei/ATM-Bench

⨍ Functions 815◇ Types & classes 49
↓ 2 callersFunctionbuild_text_configs
( args: argparse.Namespace, )
memqa/qa_agent_baselines/Mempalace/mempalace_baseline.py:233
↓ 2 callersFunctionbuild_text_evidence_block
(evidence_chunks: List[str])
memqa/qa_agent_baselines/oracle/oracle_baseline.py:544
↓ 2 callersFunctionbuild_text_messages
( question: str, evidence_chunks: List[str] )
memqa/qa_agent_baselines/oracle/oracle_baseline.py:551
↓ 2 callersFunctioncoerce_float
(value: Any)
scripts/QA_Agent/NIAH/summarize_niah_results.py:78
↓ 2 callersFunctioncompute_recall
(gt_ids: List[str], retrieved_ids: List[str])
memqa/qa_agent_baselines/mem0/mem0_baseline.py:484
↓ 2 callersFunctioncompute_recall
(gt_ids: List[str], retrieved_ids: List[str])
memqa/qa_agent_baselines/MMRag/mmrag_retrieve_answer.py:320
↓ 2 callersFunctioncompute_recall
(gt_ids: List[str], retrieved_ids: List[str])
memqa/qa_agent_baselines/HippoRag2/hipporag2_baseline.py:250
↓ 2 callersFunctioncreate_summary_stats
Create summary statistics for processed images.
memqa/mem_processor/image/utils.py:226
↓ 2 callersFunctioncreate_summary_stats
Create summary statistics for processed videos.
memqa/mem_processor/video/utils.py:528
↓ 2 callersFunctiondedupe_retrieved_ids
(retrieved_ids: List[str])
memqa/qa_agent_baselines/SimpleMem/simplemem_baseline.py:562
↓ 2 callersFunctiondescriptive_entries
(records: list[dict[str, Any]], path_key: str)
agent_systems/memory_variants.py:72
↓ 2 callersFunctionencode_image_to_base64
(path: Path)
memqa/qa_agent_baselines/oracle/oracle_baseline.py:494
↓ 2 callersFunctionencode_image_to_base64
(path: Path)
memqa/qa_agent_baselines/MMRag/mmrag_utils.py:19
↓ 2 callersMethodencode_items
(self, items: List[RetrievalItem])
memqa/retrieve/retrievers.py:152
↓ 2 callersMethodencode_query
(self, query: str)
memqa/retrieve/retrievers.py:155
↓ 2 callersFunctionensure_memoryos_importable
()
memqa/qa_agent_baselines/MemoryOS/memoryos_baseline.py:72
↓ 2 callersFunctionextract_balanced_json_value
(text: str, start_idx: int)
memqa/qa_agent_baselines/SimpleMem/simplemem_baseline.py:789
↓ 2 callersFunctionextract_email_metadata_from_html
Extract email metadata from HTML structure.
memqa/mem_processor/email/utils.py:104
↓ 2 callersFunctionextract_evidence_ids
(qa: Dict[str, Any])
memqa/qa_agent_baselines/oracle/oracle_baseline.py:413
↓ 2 callersFunctionextract_first_frame
( video_path: Path, output_dir: Optional[Path] = None )
memqa/retrieve/utils.py:406
↓ 2 callersFunctionextract_item_id_from_text
(text: Optional[str])
memqa/qa_agent_baselines/mem0/mem0_baseline.py:905
↓ 2 callersFunctionextract_json
(payload: str)
memqa/qa_agent_baselines/A-Mem/memory_layer.py:25
↓ 2 callersFunctionextract_retrieval_ids
( memoryos_instance: Any, max_items: Optional[int] )
memqa/qa_agent_baselines/MemoryOS/memoryos_baseline.py:650
↓ 2 callersFunctionextract_text_from_html
Extract clean text from HTML email content. Returns: Tuple of (clean_text, metadata)
memqa/mem_processor/email/utils.py:49
↓ 2 callersFunctionextract_token_usage
(metadata: Any)
memqa/qa_agent_baselines/HippoRag2/hipporag2_baseline.py:192
↓ 2 callersMethodfind_related_memories
( self, query: str, k: int, follow_links: Optional[bool] = None )
memqa/qa_agent_baselines/A-Mem/memory_layer.py:588
↓ 2 callersFunctionflush_batch
()
memqa/qa_agent_baselines/Mempalace/data_adapter.py:67
↓ 2 callersFunctionformat_contexts_for_atm
( contexts: List[Any], args: argparse.Namespace, )
memqa/qa_agent_baselines/SimpleMem/simplemem_baseline.py:1453
↓ 2 callersFunctionformat_duration
(seconds: float)
memqa/qa_agent_baselines/SimpleMem/simplemem_baseline.py:1017
↓ 2 callersFunctionformat_duration
Format duration in human-readable format.
memqa/mem_processor/video/utils.py:440
↓ 2 callersFunctionformat_email_evidence
(item: Dict[str, Any], evidence_id: str)
memqa/qa_agent_baselines/oracle/oracle_baseline.py:532
↓ 2 callersFunctionformat_media_text
( item: Dict[str, Any], evidence_id: str, evidence_type: str, config: MediaTextConfig, )
memqa/retrieve/utils.py:207
↓ 2 callersMethodget_cache_key
Generate a cache key for this corpus configuration. The key is based on: - Data source file paths/mtimes - Augmentati
memqa/qa_agent_baselines/HippoRag2/data_adapter.py:391
↓ 2 callersMethodget_completion
( self, prompt: str, response_format: Optional[Dict[str, Any]] = None, tempera
memqa/qa_agent_baselines/A-Mem/memory_layer.py:73
↓ 2 callersFunctionget_llm
()
memqa/qa_agent_baselines/A-Mem/amem_baseline.py:935
↓ 2 callersMethodget_progress
Get current progress information.
memqa/mem_processor/image/utils.py:298
↓ 2 callersMethodget_progress
Get current progress information.
memqa/mem_processor/video/utils.py:605
↓ 2 callersFunctionget_rotation_from_stream
Extract rotation angle from video stream metadata.
memqa/mem_processor/video/utils.py:103
↓ 2 callersFunctionhardlink_media_files
( records: list[dict[str, Any]], path_key: str, source_dir: Path, dst_dir: Path, )
agent_systems/memory_variants.py:82
↓ 2 callersFunctionindex_memories
( system: Any, items: List[RetrievalItem], args: argparse.Namespace, resume_from_dialogue: int
memqa/qa_agent_baselines/SimpleMem/simplemem_baseline.py:1487
↓ 2 callersFunctionindex_metadata_matches
(args: argparse.Namespace, cache_key: str)
memqa/qa_agent_baselines/SimpleMem/simplemem_baseline.py:1195
↓ 2 callersFunctionitem_id
(item: dict[str, Any], path_key: str)
agent_systems/memory_variants.py:48
↓ 2 callersFunctionlist_media_candidates
( root: Path, evidence_id: str, extensions: Tuple[str, ...] )
memqa/qa_agent_baselines/oracle/oracle_baseline.py:458
↓ 2 callersFunctionload_json
(path: Path)
memqa/utils/evaluator/evaluate_qa.py:80
↓ 2 callersFunctionload_json
(path: Path)
memqa/utils/evaluator/evaluate_retrieval/joint_accuracy.py:12
↓ 2 callersFunctionload_json
(path: Path)
agent_systems/extract_answer.py:18
↓ 2 callersFunctionload_json_file
Safely load JSON file.
memqa/mem_processor/image/utils.py:166
↓ 2 callersFunctionload_json_file
Safely load JSON file.
memqa/mem_processor/video/utils.py:468
↓ 2 callersFunctionload_json_list
(path: Path)
agent_systems/memory_variants.py:34
↓ 2 callersFunctionload_jsonl
(path: Path)
memqa/qa_agent_baselines/mem0/mem0_baseline.py:47
↓ 2 callersFunctionload_jsonl
(path: Path)
memqa/qa_agent_baselines/MMRag/mmrag_utils.py:129
↓ 2 callersFunctionload_qwen3_vl_embedder
(model_id: str, **kwargs: Any)
memqa/retrieve/retrievers.py:39
↓ 2 callersFunctionload_resume_map
( output_file: Path, checkpoint_file: Path )
memqa/qa_agent_baselines/MMRag/mmrag_utils.py:151
↓ 2 callersFunctionmaybe_claude_result_text
(event: Any)
agent_systems/extract_answer.py:187
↓ 2 callersFunctionmedia_name
(item: dict[str, Any], path_key: str)
agent_systems/memory_variants.py:55
↓ 2 callersFunctionmerge_token_usage
( base: Optional[TokenUsage], extra: Optional[TokenUsage] )
memqa/qa_agent_baselines/MMRag/mmrag_utils.py:182
↓ 2 callersFunctionmessages_to_text_prompt
(messages: List[Dict[str, Any]])
memqa/qa_agent_baselines/oracle/oracle_baseline.py:349
↓ 2 callersFunctionmessages_to_text_prompt
(messages: List[Dict[str, Any]])
memqa/qa_agent_baselines/MMRag/llm_utils.py:31
↓ 2 callersFunctionnormalize_currency_codes
(currencies: List[str])
memqa/utils/evaluator/normalizer.py:571
↓ 2 callersFunctionnormalize_embedding_model
Normalize embedding model name and determine the embedding mode. Args: embedding_model: Model name (e.g., "Qwen/Qwen3-Embedding-0.6B
memqa/qa_agent_baselines/HippoRag2/hipporag2_baseline.py:72
↓ 2 callersFunctionnormalize_llm_base_url
(endpoint: Optional[str])
memqa/qa_agent_baselines/HippoRag2/hipporag2_baseline.py:132
↓ 2 callersFunctionnormalize_memory_mode
(mode: str)
agent_systems/memory_variants.py:17
↓ 2 callersFunctionparse_agentic_critic_response
(text: str)
memqa/qa_agent_baselines/MMRag/mmrag_utils.py:264
↓ 2 callersFunctionparse_gps_location
Parse GPS location from video metadata. Format is typically: +52.2006+000.1184/ or +52.2006-000.1184/
memqa/mem_processor/video/utils.py:189
↓ 2 callersFunctionprefill_page_keywords
(self, pages: List[Dict[str, Any]])
memqa/qa_agent_baselines/MemoryOS/memoryos_baseline.py:1245
↓ 2 callersFunctionprepare_memory_storage
( storage_root: Path, checkpoint_dir: Path, reuse_checkpoint: bool, force_rebuild: bool, )
memqa/qa_agent_baselines/MemoryOS/memoryos_baseline.py:940
↓ 2 callersFunctionprint_eval_command
( *, ground_truth: Path, predictions: Path, eval_dir: Path, judge_provider: str, judge
agent_systems/collect_results.py:47
↓ 2 callersMethodprocess_email
Process a single email file and return comprehensive metadata.
memqa/mem_processor/email/email_processor.py:370
↓ 2 callersMethodprocess_single_image
Process a single image and extract all metadata.
memqa/mem_processor/image/image_processor.py:543
↓ 2 callersFunctionprocess_single_qa
Process a single QA with isolated instance.
memqa/qa_agent_baselines/MemoryOS/memoryos_baseline.py:1650
↓ 2 callersMethodprocess_single_video
Process a single video and extract all metadata.
memqa/mem_processor/video/video_processor.py:551
↓ 2 callersFunctionprogress_line
(self: Any, label: str, window_len: int)
memqa/qa_agent_baselines/SimpleMem/simplemem_baseline.py:1107
↓ 2 callersFunctionraw_entries
(records: list[dict[str, Any]], path_key: str, media_dir_name: str)
agent_systems/memory_variants.py:62
↓ 2 callersFunctionresolve_api_settings
(args: argparse.Namespace, for_build: bool = False)
memqa/qa_agent_baselines/SimpleMem/simplemem_baseline.py:357
↓ 2 callersFunctionresolve_media_evidence
( evidence_id: str, image_root: Path, video_root: Path, )
memqa/qa_agent_baselines/oracle/oracle_baseline.py:467
↓ 2 callersFunctionresolve_media_file
( root: Path, evidence_id: str, extensions: Tuple[str, ...] )
memqa/qa_agent_baselines/oracle/oracle_baseline.py:444
↓ 2 callersFunctionresolve_media_path
( batch_item: Dict[str, Any], path_key: str, root: Path, extensions: Tuple[str, ...], )
memqa/retrieve/utils.py:179
↓ 2 callersFunctionresolve_relative_dates
(text: str, reference: Optional[date])
memqa/utils/evaluator/normalizer.py:641
↓ 2 callersFunctionretrieve_memories
( mem0_instance, query: str, user_id: str, top_k: int )
memqa/qa_agent_baselines/mem0/mem0_baseline.py:914
↓ 2 callersFunctionrewrite_index_progress
(progress_path: Path, item_ids: Set[str])
memqa/qa_agent_baselines/MemoryOS/memoryos_baseline.py:784
↓ 2 callersFunctionrun_llm_judge
( qas: List[Dict[str, Any]], predictions: Dict[str, str], provider: str, config: Dict[str, Any
memqa/utils/evaluator/evaluate_qa.py:636
↓ 2 callersFunctionruntime_eval_value
(value: str, fallback: str, legacy_values: tuple[str, ...] = ())
agent_systems/collect_results.py:75
↓ 2 callersFunctionselect_evidence_items
( items: List[RetrievalItem], max_items: Optional[int] )
memqa/qa_agent_baselines/MMRag/mmrag_retrieve_rerank_answer.py:399
↓ 2 callersFunctionselect_evidence_items
( items: List[RetrievalItem], max_items: Optional[int] )
memqa/qa_agent_baselines/MMRag/mmrag_retrieve_answer.py:348
↓ 2 callersFunctionstrip_context_phrases
Remove common contextual phrases that don't change the core answer.
memqa/utils/evaluator/normalizer.py:310
↓ 2 callersFunctionstrip_leading_articles
Pattern 7: Strip leading articles (A, An, The). Examples: - "A Star Wars-themed event" -> "Star Wars-themed event"
memqa/utils/evaluator/normalizer.py:300
↓ 2 callersFunctionsubmit_one
( idx: int, messages: List[Dict[str, str]] )
memqa/qa_agent_baselines/HippoRag2/hipporag2_baseline.py:690
↓ 2 callersMethodto_dict
(self)
memqa/retrieve/utils.py:72
↓ 2 callersMethodto_dict
(self)
memqa/qa_agent_baselines/MMRag/llm_utils.py:22
↓ 2 callersFunctiontoken_subset_match
Check if all non-stopword GT tokens appear in prediction. Returns True if GT is empty/all-stopwords (vacuous truth).
memqa/utils/evaluator/normalizer.py:599
↓ 2 callersFunctionvalidate_pool
(qa_id: str, gt_ids: List[str], pool: List[str], pool_size: int)
scripts/QA_Agent/NIAH/build_niah_pools.py:85
↓ 1 callersFunction_aggregate
( records: List[UsageRecord], )
agent_systems/extract_usage.py:641
↓ 1 callersFunction_atm_attribute_entry
Return the item_ids this memory entry should be attributed to. Strategy: substring-match the entry's text/keywords/entities against the item_
memqa/qa_agent_baselines/SimpleMem/simplemem_baseline.py:875
↓ 1 callersMethod_build_causal_prompts
(self, queries: List[str], docs: List[str])
memqa/retrieve/rerankers.py:113
↓ 1 callersMethod_build_image_payload
Payload for visual-content encoding (image/video or black image).
memqa/retrieve/retrievers.py:387
↓ 1 callersMethod_build_input
(self, item: RetrievalItem)
memqa/retrieve/retrievers.py:309
↓ 1 callersMethod_build_text_payload
Payload for text-metadata encoding (always uses black image).
memqa/retrieve/retrievers.py:403
↓ 1 callersFunction_canonical_tokens
(d: Dict[str, Any])
agent_systems/extract_usage.py:145
↓ 1 callersMethod_chat_openai
(self, messages: List[Dict[str, Any]])
memqa/qa_agent_baselines/oracle/oracle_baseline.py:95
↓ 1 callersMethod_chat_openai
(self, messages: List[Dict[str, Any]])
memqa/qa_agent_baselines/MMRag/llm_utils.py:206
← previousnext →201–300 of 815, ranked by callers