MCPcopy Create free account
hub / github.com/PaddlePaddle/FastDeploy / MockCacheConfig

Class MockCacheConfig

tests/distributed/chunked_moe.py:64–68  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

62
63
64class MockCacheConfig:
65 block_size = 64
66 total_block_num = 256
67 kv_cache_ratio = 0.9
68 enc_dec_block_num = 2
69
70
71class MockSpecaulativeConfig:

Callers 2

MockFDConfigClass · 0.85
setup_model_runnerMethod · 0.85

Calls

no outgoing calls

Tested by

no test coverage detected