MCPcopy Create free account

hub / github.com/JingbiaoMei/ATM-Bench / functions

Functions815 in github.com/JingbiaoMei/ATM-Bench

⨍ Functions 815◇ Types & classes 49
↓ 1 callersFunctionanswer_single
(qa: Dict[str, Any])
memqa/qa_agent_baselines/mem0/mem0_baseline.py:1238
↓ 1 callersFunctionanswer_single
(qa: Dict[str, Any])
memqa/qa_agent_baselines/SimpleMem/simplemem_baseline.py:1856
↓ 1 callersFunctionanswer_single
(entry: Dict[str, Any])
memqa/qa_agent_baselines/MMRag/mmrag_retrieve_rerank_answer.py:1118
↓ 1 callersFunctionanswer_single
(entry: Dict[str, Any])
memqa/qa_agent_baselines/MMRag/mmrag_retrieve_answer.py:747
↓ 1 callersFunctionanswer_single
(qa: Dict[str, Any])
memqa/qa_agent_baselines/A-Mem/amem_baseline.py:940
↓ 1 callersFunctionanswer_single
(qa: Dict[str, Any])
memqa/qa_agent_baselines/Mempalace/mempalace_baseline.py:484
↓ 1 callersFunctionappend_index_progress
(handle, item_id: str, payload: Dict[str, Any])
memqa/qa_agent_baselines/mem0/mem0_baseline.py:589
↓ 1 callersFunctionapply_full_history_mode
(args: argparse.Namespace)
memqa/qa_agent_baselines/MemoryOS/memoryos_baseline.py:512
↓ 1 callersFunctionapply_niah_pools
( qas: List[Dict[str, Any]], niah_field: str, strict: bool = False, )
memqa/qa_agent_baselines/oracle/oracle_baseline.py:376
↓ 1 callersFunctionarchive_existing_eval_root
Move the current eval_root aside under a timestamped archive directory.
agent_systems/prepare_sandbox.py:69
↓ 1 callersMethodas_env
(self)
agent_systems/config.py:155
↓ 1 callersFunctionbuild_cache_config
( args: argparse.Namespace, retriever_name: str, media_config: MediaTextConfig, email_config:
memqa/qa_agent_baselines/MMRag/mmrag_retrieve_answer.py:290
↓ 1 callersFunctionbuild_cache_key
(values: Dict[str, Any])
memqa/qa_agent_baselines/HippoRag2/hipporag2_baseline.py:140
↓ 1 callersFunctionbuild_checkpoint_key
( args: argparse.Namespace, media_text_config: MediaTextConfig, email_text_config: EmailTextConfig
memqa/qa_agent_baselines/MemoryOS/memoryos_baseline.py:898
↓ 1 callersFunctionbuild_conversational_payloads
( image_entries: List[Dict[str, Any]], video_entries: List[Dict[str, Any]], email_entries: List[Di
memqa/qa_agent_baselines/mem0/mem0_baseline.py:734
↓ 1 callersFunctionbuild_index
( args: argparse.Namespace, hipporag: Any, corpus: Any, )
memqa/qa_agent_baselines/HippoRag2/hipporag2_baseline.py:646
↓ 1 callersFunctionbuild_judge_config
(args: argparse.Namespace)
memqa/utils/evaluator/evaluate_qa.py:1261
↓ 1 callersFunctionbuild_judge_prompt
(question: str, answer: str, prediction: str)
memqa/utils/evaluator/evaluate_qa.py:549
↓ 1 callersFunctionbuild_llm_messages
( question: str, items: List[RetrievalItem], args: argparse.Namespace )
memqa/qa_agent_baselines/MMRag/mmrag_retrieve_rerank_answer.py:407
↓ 1 callersFunctionbuild_llm_messages
( question: str, items: List[RetrievalItem], args: argparse.Namespace )
memqa/qa_agent_baselines/MMRag/mmrag_retrieve_answer.py:356
↓ 1 callersFunctionbuild_local_embedder
(args: argparse.Namespace)
memqa/qa_agent_baselines/mem0/mem0_baseline.py:127
↓ 1 callersFunctionbuild_local_retriever
(args: argparse.Namespace)
memqa/qa_agent_baselines/mem0/mem0_baseline.py:599
↓ 1 callersFunctionbuild_mem0_config
(args: argparse.Namespace)
memqa/qa_agent_baselines/mem0/mem0_baseline.py:666
↓ 1 callersFunctionbuild_memory_payloads
(items: List[RetrievalItem])
memqa/qa_agent_baselines/mem0/mem0_baseline.py:714
↓ 1 callersFunctionbuild_messages
(question: str, memories: List[str])
memqa/qa_agent_baselines/mem0/mem0_baseline.py:955
↓ 1 callersFunctionbuild_model_config
( provider: str, has_multimodal: bool, args: argparse.Namespace )
memqa/qa_agent_baselines/oracle/oracle_baseline.py:623
↓ 1 callersFunctionbuild_model_config
(provider: str, args: argparse.Namespace)
memqa/qa_agent_baselines/SimpleMem/simplemem_baseline.py:1687
↓ 1 callersFunctionbuild_model_config
( provider: str, has_multimodal: bool, args: argparse.Namespace )
memqa/qa_agent_baselines/MMRag/mmrag_retrieve_rerank_answer.py:267
↓ 1 callersFunctionbuild_model_config
( provider: str, has_multimodal: bool, args: argparse.Namespace )
memqa/qa_agent_baselines/MMRag/mmrag_retrieve_answer.py:241
↓ 1 callersFunctionbuild_model_config
(provider: str, args: argparse.Namespace)
memqa/qa_agent_baselines/Mempalace/mempalace_baseline.py:210
↓ 1 callersFunctionbuild_multimodal_messages
( question: str, evidence_items: List[Dict[str, Any]], text_chunks: Optional[List[str]] = None, )
memqa/qa_agent_baselines/oracle/oracle_baseline.py:566
↓ 1 callersFunctionbuild_palace_from_items
Ingest all RetrievalItems into a MemPalace palace using batched upserts. Uses _build_drawer_metadata + batched collection.upsert (aligned with
memqa/qa_agent_baselines/Mempalace/data_adapter.py:20
↓ 1 callersFunctionbuild_pool
Build a pool of exactly pool_size items containing all GT items.
scripts/QA_Agent/NIAH/build_niah_pools.py:43
↓ 1 callersFunctionbuild_prediction_map
(predictions: List[Dict[str, Any]])
memqa/utils/evaluator/evaluate_qa.py:905
↓ 1 callersFunctionbuild_qa_messages
( hipporag: Any, query_solution: Any, qa_top_k: int, )
memqa/qa_agent_baselines/HippoRag2/hipporag2_baseline.py:658
↓ 1 callersFunctionbuild_text_configs
( args: argparse.Namespace, )
memqa/qa_agent_baselines/mem0/mem0_baseline.py:462
↓ 1 callersFunctionbuild_text_configs
( args: argparse.Namespace, )
memqa/qa_agent_baselines/SimpleMem/simplemem_baseline.py:378
↓ 1 callersFunctionbuild_text_configs
( args: argparse.Namespace, )
memqa/qa_agent_baselines/MMRag/mmrag_retrieve_rerank_answer.py:294
↓ 1 callersFunctionbuild_text_configs
( args: argparse.Namespace, )
memqa/qa_agent_baselines/MMRag/mmrag_retrieve_answer.py:268
↓ 1 callersFunctionbuild_text_configs
( args: argparse.Namespace, )
memqa/qa_agent_baselines/A-Mem/amem_baseline.py:297
↓ 1 callersFunctionbuild_text_to_id_map
(passages: Iterable[Any])
memqa/qa_agent_baselines/HippoRag2/hipporag2_baseline.py:153
↓ 1 callersMethodchat
(self, messages: List[Dict[str, Any]])
memqa/utils/evaluator/evaluate_qa.py:462
↓ 1 callersMethodchat_with_usage
( self, messages: List[Dict[str, Any]] )
memqa/qa_agent_baselines/oracle/oracle_baseline.py:84
↓ 1 callersFunctioncheck_gps_in_video
Check if a video file contains GPS metadata. Returns: Dict with 'has_gps' bool and 'location' if found
memqa/mem_processor/video/utils.py:628
↓ 1 callersMethodcheck_gps_metadata
Check if video has GPS metadata.
memqa/mem_processor/video/video_processor.py:547
↓ 1 callersFunctionclean_text
Clean and normalize text.
memqa/mem_processor/image/utils.py:81
↓ 1 callersFunctionclean_text
Clean and normalize text.
memqa/mem_processor/video/utils.py:390
↓ 1 callersFunctioncollect_agent
(agent: str, run_tag: str, model_tag: str)
agent_systems/collect_usage.py:43
↓ 1 callersFunctioncollect_agent
Collect answers for a single agent. Returns stats dict.
agent_systems/collect_results.py:81
↓ 1 callersFunctioncollect_multimodal_evidence
( evidence_ids: List[str], email_index: Dict[str, Dict[str, Any]], image_root: Path, video_roo
memqa/qa_agent_baselines/oracle/oracle_baseline.py:692
↓ 1 callersFunctioncollect_text_evidence
( evidence_ids: List[str], email_index: Dict[str, Dict[str, Any]], image_batch_index: Dict[str, Di
memqa/qa_agent_baselines/oracle/oracle_baseline.py:656
↓ 1 callersFunctioncompute_joint_accuracy
( retrieval_details: List[Dict[str, Any]], atm_results: Dict[str, Dict[str, Any]], k_values: List[
memqa/utils/evaluator/evaluate_retrieval/joint_accuracy.py:32
↓ 1 callersFunctioncompute_metrics
(details: List[Dict[str, Any]], k_values: List[int])
memqa/utils/evaluator/evaluate_retrieval/comprehensive_eval.py:23
↓ 1 callersFunctioncompute_recall
(gt_ids: List[str], retrieved_ids: List[str])
memqa/qa_agent_baselines/MemoryOS/memoryos_baseline.py:861
↓ 1 callersFunctioncompute_recall
(gt_ids: List[str], retrieved_ids: List[str])
memqa/qa_agent_baselines/SimpleMem/simplemem_baseline.py:573
↓ 1 callersFunctioncompute_recall
(gt_ids: List[str], retrieved_ids: List[str])
memqa/qa_agent_baselines/A-Mem/amem_baseline.py:722
↓ 1 callersFunctioncompute_recall
(gt_ids: List[str], retrieved_ids: List[str])
memqa/qa_agent_baselines/Mempalace/mempalace_baseline.py:255
↓ 1 callersFunctionconfigure_answerer_llm
(args: argparse.Namespace, hipporag: Any)
memqa/qa_agent_baselines/HippoRag2/hipporag2_baseline.py:624
↓ 1 callersFunctionconvert_qa_to_hipporag_format
Convert ATM-Bench format to HippoRAG 2 query format. ATM-Bench format: { "id": "...", "question": "...", "answer"
memqa/qa_agent_baselines/HippoRag2/data_adapter.py:414
↓ 1 callersFunctioncopy_gps_cache_files
(source_dir: str, target_dir: str)
memqa/utils/copy_gps_info.py:25
↓ 1 callersFunctioncreate_eval_root
Build the eval_root directory tree.
agent_systems/prepare_sandbox.py:84
↓ 1 callersMethodcreate_html_report
Create an HTML report of processing results.
memqa/mem_processor/image/batch_processor.py:361
↓ 1 callersMethodcreate_html_report
Create an HTML report of processing results.
memqa/mem_processor/video/batch_processor.py:333
↓ 1 callersFunctioncreate_local_embedder
Factory function to create a local embedder for HippoRAG. Args: model_name: HuggingFace model name (e.g., "Qwen/Qwen3-Embedding-0.6B
memqa/qa_agent_baselines/HippoRag2/local_embeddings.py:308
↓ 1 callersFunctioncreate_mem0_instance
(mem0_config: Dict[str, Any])
memqa/qa_agent_baselines/mem0/mem0_baseline.py:646
↓ 1 callersFunctioncreate_summary_stats
Create summary statistics from processing results.
memqa/mem_processor/email/utils.py:363
↓ 1 callersFunctiondate_token_match
(gt_token: str, pred_token: str)
memqa/utils/evaluator/evaluate_qa.py:151
↓ 1 callersFunctiondates_match
(gt_tokens: List[str], pred_tokens: List[str])
memqa/utils/evaluator/evaluate_qa.py:163
↓ 1 callersFunctiondedupe_preserve
(values: Sequence[str])
memqa/retrieve/utils.py:129
↓ 1 callersFunctiondedupe_preserve
(items: List[str])
memqa/qa_agent_baselines/oracle/oracle_baseline.py:402
↓ 1 callersFunctiondetect_qtype
(answer: str)
memqa/utils/evaluator/qtype_utils.py:176
↓ 1 callersFunctiondeterministic_accuracy
( ground_truth: str, prediction: str, question: Optional[str] = None )
memqa/utils/evaluator/evaluate_qa.py:304
↓ 1 callersMethodembed
Embed texts and return numpy array. Args: texts: Single text or list of texts to embed show_progress: Whethe
memqa/qa_agent_baselines/HippoRag2/local_embeddings.py:140
↓ 1 callersMethodembed_query
(self, text: str)
memqa/qa_agent_baselines/mem0/mem0_baseline.py:139
↓ 1 callersFunctionensure_directories
Create all necessary directories if they don't exist.
memqa/global_config.py:317
↓ 1 callersFunctionestimate_simplemem_windows
(num_dialogues: int, window_size: int, overlap_size: int)
memqa/qa_agent_baselines/SimpleMem/simplemem_baseline.py:1028
↓ 1 callersFunctionextract_attachments_info
Extract information about email attachments from HTML.
memqa/mem_processor/email/utils.py:263
↓ 1 callersFunctionextract_by_qtype
(summary: Dict[str, Any])
scripts/QA_Agent/NIAH/summarize_niah_results.py:85
↓ 1 callersMethodextract_city_from_address
Extract city and country from the geocoded address using LLM.
memqa/mem_processor/image/image_processor.py:445
↓ 1 callersMethodextract_city_from_address
Extract city and country from the geocoded address using LLM.
memqa/mem_processor/video/video_processor.py:440
↓ 1 callersFunctionextract_claude_code
Claude Code may emit either a single JSON object or a stream-json JSONL trace. Prefer the final structured_output payload when present; other
agent_systems/extract_answer.py:174
↓ 1 callersFunctionextract_codes
(text: str)
memqa/utils/evaluator/normalizer.py:557
↓ 1 callersMethodextract_email_metadata
Extract basic metadata from email file.
memqa/mem_processor/email/email_processor.py:161
↓ 1 callersFunctionextract_email_subject
(detail: str)
memqa/retrieve/utils.py:253
↓ 1 callersMethodextract_entities
Extract named entities from the image.
memqa/mem_processor/image/image_processor.py:489
↓ 1 callersMethodextract_entities
Extract named entities from the video.
memqa/mem_processor/video/video_processor.py:486
↓ 1 callersMethodextract_exif_metadata
Extract EXIF metadata from image.
memqa/mem_processor/image/image_processor.py:126
↓ 1 callersFunctionextract_json_blob
(text: str)
agent_systems/extract_answer.py:43
↓ 1 callersFunctionextract_keyframes
Extract keyframes (I-frames) from video.
memqa/mem_processor/video/utils.py:288
↓ 1 callersMethodextract_metadata
Extract metadata from video file.
memqa/mem_processor/video/video_processor.py:137
↓ 1 callersMethodextract_ocr_text
Extract text from image using the vision model.
memqa/mem_processor/image/image_processor.py:228
↓ 1 callersMethodextract_ocr_text
Extract text from video frames using the vision model.
memqa/mem_processor/video/video_processor.py:213
↓ 1 callersFunctionextract_openclaw
(trace: Path)
agent_systems/extract_answer.py:130
↓ 1 callersFunctionextract_opencode
(trace: Path)
agent_systems/extract_answer.py:419
↓ 1 callersFunctionextract_pi
Extract the final assistant text from a `pi -p --mode json` JSONL trace. pi emits events: session, agent_start, turn_start, message_start, m
agent_systems/extract_answer.py:457
↓ 1 callersFunctionextract_reference_date
(text: str)
memqa/utils/evaluator/normalizer.py:629
↓ 1 callersMethodextract_safety_content
Analyze image for sensitive content.
memqa/mem_processor/image/image_processor.py:524
↓ 1 callersMethodextract_safety_content
Analyze video for sensitive content.
memqa/mem_processor/video/video_processor.py:525
↓ 1 callersMethodextract_tags
Extract relevant tags and keywords from the image.
memqa/mem_processor/image/image_processor.py:467
↓ 1 callersMethodextract_tags
Extract relevant tags and keywords from the video.
memqa/mem_processor/video/video_processor.py:460
← previousnext →401–500 of 815, ranked by callers