Functions — github.com/Zefan-Cai/KVCache-Factory

CodeHub MCPcopy Create free account

hub / github.com/Zefan-Cai/KVCache-Factory / functions

Functions410 in github.com/Zefan-Cai/KVCache-Factory

⨍ Functions 410◇ Types & classes 47

Updates the cache with the new `key_states` and `value_states` for the layer `layer_idx`. It is VERY important to index using a tenso

pyramidkv/cache_utils_think.py:1082

( self, key_states: torch.Tensor, value_states: torch.Tensor, layer_idx: int,

pyramidkv/cache_utils_think.py:1210

( self, key_states: torch.Tensor, value_states: torch.Tensor, layer_idx: int,

pyramidkv/cache_utils_think.py:1552

( self, key_states: torch.Tensor, value_states: torch.Tensor, layer_idx: int,

pyramidkv/quantcache.py:59

Methodupdate_conv_state

( self, layer_idx: int, new_conv_state: torch.Tensor, cache_position: torch.LongTensor )

pyramidkv/cache_utils_think.py:1675

Methodupdate_kv

(self, key_states, query_states, value_states, attention_mask, num_key_value_groups)

pyramidkv/pyramidkv_utils.py:618

Methodupdate_kv

(self, key_states, query_states, value_states, attention_mask, num_key_value_groups)

pyramidkv/pyramidkv_utils.py:815

Methodupdate_kv

(self, key_states, query_states, value_states, attention_mask, num_key_value_groups)

pyramidkv/pyramidkv_utils.py:911

Methodupdate_ssm_state

(self, layer_idx: int, new_ssm_state: torch.Tensor)

pyramidkv/cache_utils_think.py:1687

Validates if the arguments passed are correct

pyramidkv/cache_utils_think.py:243

← previous401–410 of 410, ranked by callers