Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/FastMAS/KVCOMM
/ functions
Functions
446 in github.com/FastMAS/KVCOMM
⨍
Functions
446
◇
Types & classes
71
↓ 1 callers
Function
get_output
(func: str, assert_statement: str, timeout: int = 5)
KVCOMM/tools/coding/python_executor.py:21
↓ 1 callers
Function
get_pred_value
(pred_str)
datasets/gsm8k_dataset.py:72
↓ 1 callers
Function
gsm_data_process
(dataset)
datasets/gsm8k_dataset.py:9
↓ 1 callers
Method
has_active_anchor
Determine whether an anchor should trigger dense prefill.
KVCOMM/llm/gpt_chat.py:557
↓ 1 callers
Method
init_nodes
Creates and adds new nodes to the graph.
KVCOMM/graph/graph.py:136
↓ 1 callers
Method
init_potential_edges
Creates and potential edges to the graph.
KVCOMM/graph/graph.py:147
↓ 1 callers
Method
keys
(cls)
KVCOMM/prompt/prompt_set_registry.py:14
↓ 1 callers
Function
load_result
(result_file: Path)
experiments/run_humaneval.py:33
↓ 1 callers
Function
load_result
(result_file: Path)
experiments/run_gsm8k.py:36
↓ 1 callers
Method
locate_placeholder
Locate placeholder token spans in a templated prompt. Args: original_text: Templated prompt with placeholders such as
KVCOMM/llm/gpt_chat.py:945
↓ 1 callers
Function
main
()
KVCOMM/utils/log.py:76
↓ 1 callers
Function
main
()
experiments/run_humaneval.py:94
↓ 1 callers
Function
main
()
experiments/run_mmlu.py:78
↓ 1 callers
Function
main
()
experiments/benchmark_TTFT.py:144
↓ 1 callers
Function
main
()
experiments/run_gsm8k.py:102
↓ 1 callers
Method
offset_kv_cache_pair
Blend base caches with anchor deltas weighted by similarity.
KVCOMM/llm/kvcomm_engine.py:868
↓ 1 callers
Function
parse_args
()
experiments/run_humaneval.py:46
↓ 1 callers
Function
parse_args
()
experiments/run_mmlu.py:31
↓ 1 callers
Function
parse_args
()
experiments/benchmark_TTFT.py:31
↓ 1 callers
Function
parse_args
()
experiments/run_gsm8k.py:49
↓ 1 callers
Method
postprocess_answer
Normalise the model output into a plain string answer.
datasets/mmlu_dataset.py:71
↓ 1 callers
Function
process_tasks
(prompts, api_key)
KVCOMM/tools/vgen/dalle3.py:8
↓ 1 callers
Method
record_to_target_answer
(record: pd.DataFrame)
datasets/mmlu_dataset.py:84
↓ 1 callers
Function
replace
Returns a new TokenInput where the slice [start, end) is replaced by `real`.
KVCOMM/llm/token_ops.py:157
↓ 1 callers
Method
rotate_tensor
Apply RoPE rotation using provided cos/sin tables.
KVCOMM/llm/kvcomm_engine.py:1178
↓ 1 callers
Method
search
(self, query: str, item_num: int = 3)
KVCOMM/tools/search/search.py:26
↓ 1 callers
Function
search_wiki_api
(query, session)
KVCOMM/tools/search/wiki.py:65
↓ 1 callers
Method
set_anchor
Populate or update anchor store with per-placeholder deltas for a message.
KVCOMM/llm/kvcomm_engine.py:1082
↓ 1 callers
Method
set_reader
(self, suffix)
KVCOMM/tools/reader/readers.py:307
↓ 1 callers
Function
swarmlog
Custom log function for swarm operations. Includes dynamic global variables. Args: sender (str): The name of the sender. tex
KVCOMM/utils/log.py:49
↓ 1 callers
Method
update_anchor
Update the anchor list by filtering out the least frequent anchors in the oldest anchor set.
KVCOMM/llm/kvcomm_engine.py:1062
↓ 1 callers
Method
update_memory_multirequest
Update per-message memories when running in multi-request mode.
KVCOMM/graph/node.py:117
Function
Youtube
(url, has_subtitles)
KVCOMM/tools/web/youtube.py:5
Method
__call__
(self, input_ids: torch.LongTensor, scores: torch.FloatTensor, **kwargs: Any)
KVCOMM/llm/gpt_chat.py:98
Method
__contains__
(self, key: object)
KVCOMM/llm/kvcomm_engine.py:629
Method
__deepcopy__
(self, memo)
KVCOMM/llm/gpt_chat.py:1813
Method
__deepcopy__
(self, memo)
KVCOMM/graph/graph.py:455
Method
__delitem__
(self, key: str)
KVCOMM/llm/kvcomm_engine.py:568
Method
__getitem__
(self, key: str)
KVCOMM/llm/kvcomm_engine.py:551
Method
__getitem__
(self, index: int)
datasets/mmlu_dataset.py:54
Method
__init__
(self)
KVCOMM/tools/search/wiki.py:8
Method
__init__
(self)
KVCOMM/tools/search/arXiv.py:4
Method
__init__
(self)
KVCOMM/tools/search/search.py:10
Method
__init__
(self)
KVCOMM/tools/reader/readers.py:323
Method
__init__
(self)
KVCOMM/utils/metrics.py:25
Method
__init__
(self)
KVCOMM/utils/globals.py:14
Method
__init__
(self)
KVCOMM/utils/globals.py:18
Method
__init__
(self)
KVCOMM/utils/globals.py:22
Method
__init__
(self)
KVCOMM/utils/globals.py:26
Method
__init__
(self)
KVCOMM/utils/globals.py:30
Method
__init__
(self, base: Dict[str, Any])
KVCOMM/llm/kvcomm_engine.py:541
Method
__init__
( self, request_uid: str, anchor_dict: Dict[str, Any], anchor_len_dict: Dict[s
KVCOMM/llm/kvcomm_engine.py:648
Method
__init__
(self, llm: "LLMChat")
KVCOMM/llm/kvcomm_engine.py:690
Method
__init__
(self, prompt_length: int)
KVCOMM/llm/gpt_chat.py:88
Method
__init__
(self, model_name: str)
KVCOMM/llm/gpt_chat.py:129
Method
__init__
Create a chat model instance and initialize shared resources. Args: model_name: HF model identifier. prefix: Optional
KVCOMM/llm/gpt_chat.py:206
Method
__init__
Initializes a new Node instance.
KVCOMM/graph/node.py:44
Method
__init__
(self, domain: str, llm_name: Optional[str], agent_names: List
KVCOMM/graph/graph.py:45
Method
__init__
( self, id: str | None = None, role: str = None, domain: str = "", llm
KVCOMM/agents/copy_machine.py:22
Method
__init__
( self, id: str | None = None, domain: str = "", llm_name: str = "", l
KVCOMM/agents/final_decision.py:15
Method
__init__
Used for Directed IO
KVCOMM/agents/final_decision.py:612
Method
__init__
Used for Directed IO
KVCOMM/agents/final_decision.py:649
Method
__init__
( self, id: str | None = None, role: str = None, domain: str = "", llm
KVCOMM/agents/code_writing.py:15
Method
__init__
( self, id: str | None = None, role: str = None, domain: str = "", llm
KVCOMM/agents/analyze_agent.py:23
Method
__init__
( self, id: str | None = None, role: str = None, domain: str = "", llm
KVCOMM/agents/math_solver.py:14
Method
__init__
(self)
experiments/accuracy.py:4
Method
__init__
(self, split: Union[Literal['dev'], Literal['val'], Literal['test']], )
datasets/mmlu_dataset.py:10
Method
__iter__
(self)
KVCOMM/llm/kvcomm_engine.py:571
Method
__len__
(self)
KVCOMM/llm/kvcomm_engine.py:574
Method
__len__
(self)
datasets/mmlu_dataset.py:51
Method
__setitem__
(self, key: str, value: Any)
KVCOMM/llm/kvcomm_engine.py:565
Method
_async_execute
Handle asynchronous execution across different KV cache modes.
KVCOMM/agents/copy_machine.py:137
Method
_async_execute
To be overriden by the descendant class
KVCOMM/agents/final_decision.py:289
Method
_async_execute
Handle asynchronous execution across different KV cache strategies.
KVCOMM/agents/final_decision.py:558
Method
_async_execute
To be overriden by the descendant class
KVCOMM/agents/final_decision.py:633
Method
_async_execute
To be overriden by the descendant class
KVCOMM/agents/final_decision.py:676
Method
_async_execute
To be overriden by the descendant class
KVCOMM/agents/code_writing.py:190
Method
_async_execute
Handle asynchronous execution across different KV cache modes.
KVCOMM/agents/analyze_agent.py:182
Method
_async_execute
To be overriden by the descendant class
KVCOMM/agents/math_solver.py:142
Method
_execute
To be overriden by the descendant class
KVCOMM/agents/copy_machine.py:118
Method
_execute
To be overriden by the descendant class
KVCOMM/agents/final_decision.py:270
Method
_execute
To be overriden by the descendant class
KVCOMM/agents/final_decision.py:541
Method
_execute
To be overriden by the descendant class
KVCOMM/agents/final_decision.py:622
Method
_execute
To be overriden by the descendant class
KVCOMM/agents/final_decision.py:659
Method
_execute
To be overriden by the descendant class
KVCOMM/agents/code_writing.py:171
Method
_execute
To be overriden by the descendant class
KVCOMM/agents/analyze_agent.py:163
Method
_execute
To be overriden by the descendant class
KVCOMM/agents/math_solver.py:124
Method
_get_slot
(bucket_key: str)
KVCOMM/llm/kvcomm_engine.py:1238
Method
_make_anchor
(i, ph_id, real_ph, base_ph, real_pf, base_pf)
KVCOMM/llm/kvcomm_engine.py:1109
Method
_process_inputs
To be overriden by the descendant class
KVCOMM/agents/final_decision.py:617
Method
_process_inputs
To be overriden by the descendant class
KVCOMM/agents/final_decision.py:654
Function
_runner
(q)
KVCOMM/tools/coding/python_executor.py:45
Method
_should_materialise
(ph_id: str)
KVCOMM/llm/kvcomm_engine.py:1106
Method
_summarize_agent_outputs
Summarize peer outputs, running tests on code blocks when present.
KVCOMM/agents/final_decision.py:66
Method
add_predecessor
(self, operation: 'Node', st='spatial')
KVCOMM/graph/node.py:73
Method
agen
Asynchronously generate a response via hosted chat API.
KVCOMM/llm/gpt_chat.py:132
Method
agen
( self, messages: List[Message] = None, max_tokens: Optional[int] = None, temp
KVCOMM/llm/gpt_chat.py:1019
Method
begin_of_text
(self)
KVCOMM/llm/gpt_chat.py:309
Method
build_prompt
Create model inputs from system/user prompts and optional assistant suffix.
KVCOMM/llm/gpt_chat.py:499
Function
bytes_to_data_url
(image_bytes: bytes, mime_type: str)
KVCOMM/tools/web/screenshot.py:11
← previous
next →
201–300 of 446, ranked by callers