Types & classes — github.com/EverMind-AI/MSA

CodeHub MCPcopy Create free account

hub / github.com/EverMind-AI/MSA / types & classes

Types & classes54 in github.com/EverMind-AI/MSA

⨍ Functions 265◇ Types & classes 54

↓ 4 callersClassCustomDynamicCache

自定义动态缓存类扩展标准的DynamicCache，添加额外的元数据存储和查询功能

src/utils/cache.py:14

↓ 4 callersClassCustomQuantizeDynamicCache

自定义量化动态缓存类扩展标准的QuantoQuantizedCache，添加额外的元数据存储和查询功能

src/utils/cache.py:174

↓ 3 callersClassBenchmarkSpec

Immutable specification for a single benchmark's file layout.

src/benchmarks.py:25

↓ 3 callersClassDotDict

支持点号访问的字典类

src/msa/configuration_msa.py:6

↓ 3 callersClassGPUMemoryMonitor

src/utils/gpu_monitor.py:8

↓ 2 callersClassBlockData

本 GPU 上的文档 kvcache：[1, num_head, num_chunks, head_dim]

src/msa_service.py:234

↓ 2 callersClassBlockDesc

一个 block 的描述数据

src/msa_service.py:191

↓ 2 callersClassDictWithDotAccess

src/utils/misc.py:9

↓ 1 callersClassBenchMarks

Resolve benchmark name to query / memory file paths. Usage: bench = BenchMarks("hotpotqa") query_file, memory_file = bench.get_be

src/benchmarks.py:94

↓ 1 callersClassBlockModelInput

src/prefill.py:23

↓ 1 callersClassCustomDynamicCacheOnCPU

src/utils/cache.py:139

↓ 1 callersClassDocument

src/msa_service.py:176

↓ 1 callersClassGenerateConfig

src/config/memory_config.py:7

↓ 1 callersClassGenerateRequest

src/msa_service.py:118

↓ 1 callersClassGenerateResponse

src/msa_service.py:134

↓ 1 callersClassGenerateStub

src/msa_service.py:146

↓ 1 callersClassMSACausalLMOutputWithPast

src/msa/model.py:38

↓ 1 callersClassMSADeocoderLayer

src/msa/model.py:51

↓ 1 callersClassMSAEngine

src/msa_service.py:1368

↓ 1 callersClassMSALayerModelOutputWithPast

src/msa/model.py:30

↓ 1 callersClassMSAModel

src/msa/model.py:137

↓ 1 callersClassMSAService

src/msa_service.py:1013

↓ 1 callersClassMemoryConfig

src/config/memory_config.py:49

↓ 1 callersClassMemorySparseAttention

src/msa/memory_sparse_attention.py:20

↓ 1 callersClassModelConfig

src/config/memory_config.py:29

↓ 1 callersClassMultiGPUMonitor

多GPU监控器

src/utils/gpu_monitor.py:251

↓ 1 callersClassPrefillStage1Worker

Memory工作进程

src/prefill.py:37

↓ 1 callersClassReportDocID

src/msa_service.py:85

↓ 1 callersClassRequestLimiter

src/utils/tools.py:58

↓ 1 callersClassSliceDesc

block分片信息，每一个分片包含了一部分文档信息

src/msa_service.py:246

ClassBlockModelInput

src/msa_service.py:182

Benchmark categories with associated root directories and path patterns.

src/benchmarks.py:9

src/msa_service.py:33

ClassCustomDynamicCacheOnCPU

src/msa_service.py:91

ClassDSEmptyCacheCallback

src/utils/callbacks.py:155

src/utils/gpu_worker.py:4

MSA 模型的配置类，继承自 Qwen3Config。主要功能：确保 msa_config 在加载时自动转换为 DotDict，支持使用点号访问属性（如 config.msa_config.pad_free）

src/msa/configuration_msa.py:19

ClassMSAForCausalLM

src/msa/model.py:277

ClassMSAGenerationMixin

src/msa/generate.py:22

Memory工作进程

src/msa_service.py:269

ClassMemoryClientBase

被模型调用的接口

src/msa_service.py:259

ClassModelEvalCallback

src/utils/callbacks.py:99

ClassModeltimeCallback

src/utils/callbacks.py:20

ClassPrefillStage2Cmd

src/msa_service.py:57

ClassPrefillStage2Result

src/msa_service.py:67

ClassProfCallback

src/utils/callbacks.py:167

ClassProtocolConstants

src/types.py:11

ClassQueryTemplateKVPrefixCmd

src/msa_service.py:43

ClassQueryTemplateKVPrefixResult

src/msa_service.py:50

ClassResultBase

src/msa_service.py:37

ClassSacredCallback

src/utils/callbacks.py:51

ClassSetDocIDCmd

src/msa_service.py:78

src/utils/tools.py:101