MCPcopy Create free account

hub / github.com/crabml/crabml / types & classes

Types & classes96 in github.com/crabml/crabml

⨍ Functions 598◇ Types & classes 96
EnumActivation
crabml-llama2/src/llama2.rs:21
ClassArithmeticPushConstants
crabml-vulkan/src/push_constants.rs:5
ClassBatchMatmuPushConstants
crabml-vulkan/src/push_constants.rs:70
ClassBatchMatmulMeta
crabml-wgpu/src/meta.rs:23
ClassBlockQ2K
crabml-core/src/cpu/buf/buf_q2_k.rs:19
ClassBlockQ3K
crabml-core/src/cpu/buf/buf_q3_k.rs:21
ClassBlockQ4K
crabml-core/src/cpu/buf/buf_q4_k.rs:16
ClassBlockQ4_0
crabml-core/src/cpu/buf/buf_q4_0.rs:12
ClassBlockQ4_1
crabml-core/src/cpu/buf/buf_q4_1.rs:12
ClassBlockQ5K
crabml-core/src/cpu/buf/buf_q5_k.rs:15
ClassBlockQ5_0
crabml-core/src/cpu/buf/buf_q5_0.rs:15
ClassBlockQ5_1
crabml-core/src/cpu/buf/buf_q5_1.rs:12
ClassBlockQ6K
crabml-core/src/cpu/buf/buf_q6_k.rs:13
ClassBlockQ8K
crabml-core/src/cpu/buf/buf_q8_k.rs:8
ClassBlockQ8_0
crabml-core/src/cpu/buf/buf_q8_0.rs:10
ClassBlockQ8_1
crabml-core/src/cpu/buf/buf_q8_1.rs:75
EnumChatTemplate
crabml-llama2/src/chat.rs:191
ClassCommandArgs
crabml-cli/src/main.rs:30
ClassConcatenateMeta
crabml-wgpu/src/meta.rs:45
ClassConcatenatePushConstants
crabml-vulkan/src/push_constants.rs:48
ClassContiguousMeta
crabml-wgpu/src/meta.rs:57
ClassContiguousPushConstants
crabml-vulkan/src/push_constants.rs:39
ClassCpuLlamaModel
crabml-llama2/src/model.rs:102
ClassCpuLlamaModelLoader
crabml-llama2/src/model.rs:139
ClassCpuTensor
crabml-core/src/cpu/cpu_tensor.rs:16
EnumCpuTensorBuf
crabml-core/src/cpu/buf/api.rs:32
ClassCpuTensorDevice
crabml-core/src/cpu/cpu_device.rs:51
ClassCpuTensorDeviceOptions
crabml-core/src/cpu/cpu_device.rs:13
EnumDeviceType
crabml-cli/src/main.rs:67
ClassError
crabml-core/src/error.rs:36
EnumErrorKind
crabml-core/src/error.rs:6
EnumGGMLType
crabml-core/src/gguf.rs:86
ClassGGUFBufReader
crabml-core/src/gguf.rs:247
ClassGGUFFile
crabml-core/src/gguf.rs:689
ClassGGUFFileLoader
crabml-core/src/gguf.rs:789
ClassGGUFHeader
crabml-core/src/gguf.rs:492
ClassGGUFMetadata
crabml-core/src/gguf.rs:427
EnumGGUFMetadataArray
crabml-core/src/gguf.rs:231
ClassGGUFMetadataReader
crabml-core/src/gguf.rs:284
EnumGGUFMetadataValue
crabml-core/src/gguf.rs:194
EnumGGUFMetadataValueType
crabml-core/src/gguf.rs:149
ClassGGUFOnDiskTensorInfo
crabml-core/src/gguf.rs:613
ClassGGUFTensorInfo
crabml-core/src/gguf.rs:649
EnumGGUFVersion
crabml-core/src/gguf.rs:68
ClassGpt2Tokenizer
crabml-core/src/tokenizer/tokenizer_gpt2.rs:8
ClassGpuLlamaModel
crabml-llama2/src/model.rs:637
ClassLlama2Chat
crabml-llama2/src/chat.rs:7
ClassLlama2ChatReplyIterator
each dialog has a start mark and an end mark. The chat iterator will take the generation result from the model and concatenate them until got the end
crabml-llama2/src/chat.rs:73
ClassLlama2ChatReplyIteratorStats
crabml-llama2/src/chat.rs:64
ClassLlama2Runner
crabml-llama2/src/llama2.rs:26
ClassLlama2Sampler
crabml-llama2/src/sampler.rs:10
ClassLlamaConfig
crabml-llama2/src/model.rs:30
InterfaceLlamaModel
crabml-llama2/src/model.rs:86
ClassLlamaTokenizer
crabml-core/src/tokenizer/tokenizer_llama.rs:6
ClassLlamaWeights
crabml-llama2/src/model.rs:55
EnumMarkMatchState
crabml-llama2/src/chat.rs:133
ClassMarkMatcher
the model response might ends with stop mark like "<end_of_turn>", please note these stop mark are NOT a single token. we'd use a simple state machine
crabml-llama2/src/chat.rs:127
ClassMatmulMeta
crabml-wgpu/src/meta.rs:13
ClassMatmulPushConstants
crabml-vulkan/src/push_constants.rs:61
EnumModelArchitecture
crabml-llama2/src/model.rs:22
ClassQuantBufQ2K
crabml-core/src/cpu/buf/buf_q2_k.rs:84
ClassQuantBufQ3K
crabml-core/src/cpu/buf/buf_q3_k.rs:99
ClassQuantBufQ4K
crabml-core/src/cpu/buf/buf_q4_k.rs:51
ClassQuantBufQ4_0
crabml-core/src/cpu/buf/buf_q4_0.rs:31
ClassQuantBufQ4_1
crabml-core/src/cpu/buf/buf_q4_1.rs:34
ClassQuantBufQ5K
crabml-core/src/cpu/buf/buf_q5_k.rs:64
ClassQuantBufQ5_0
crabml-core/src/cpu/buf/buf_q5_0.rs:40
ClassQuantBufQ5_1
crabml-core/src/cpu/buf/buf_q5_1.rs:39
ClassQuantBufQ6K
crabml-core/src/cpu/buf/buf_q6_k.rs:51
ClassQuantBufQ8K
crabml-core/src/cpu/buf/buf_q8_k.rs:24
ClassQuantBufQ8_0
crabml-core/src/cpu/buf/buf_q8_0.rs:27
ClassQuantBufQ8_1
crabml-core/src/cpu/buf/buf_q8_1.rs:16
ClassRmsNormMeta
crabml-wgpu/src/meta.rs:3
ClassRmsNormPushConstants
crabml-vulkan/src/push_constants.rs:21
ClassRopeMeta
crabml-wgpu/src/meta.rs:34
EnumRopeMode
crabml-core/src/tensor/api.rs:6
ClassRopePushConstants
crabml-vulkan/src/push_constants.rs:29
ClassScope
crabml-core/src/cpu/thread_pool.rs:73
ClassSoftmaxPushConstants
crabml-vulkan/src/push_constants.rs:14
InterfaceTensor
crabml-core/src/tensor/api.rs:11
ClassTensorMetrics
crabml-core/src/tensor/metrics.rs:6
ClassTensorStrider
crabml-core/src/tensor/strider.rs:6
ClassThreadPool
crabml-core/src/cpu/thread_pool.rs:13
ClassTimeMetric
crabml-core/src/tensor/metrics.rs:146
ClassTimeMetricGuard
crabml-core/src/tensor/metrics.rs:150
ClassTokenizer
crabml-core/src/tokenizer/mod.rs:13
EnumTokenizerInner
crabml-core/src/tokenizer/mod.rs:19
EnumTokenizerKind
crabml-core/src/tokenizer/mod.rs:25
ClassUtf8Buf
crabml-core/src/tokenizer/mod.rs:114
ClassVulkanTensor
crabml-vulkan/src/vulkan_tensor.rs:22
ClassVulkanTensorDevice
crabml-vulkan/src/vulkan_device.rs:76
ClassVulkanTensorDeviceInner
Vulkan has a lot of boilerplate code, put it them a stand-alone struct to deal with it. I believe the complexity of Vulkan mostly comes from the fact
crabml-vulkan/src/vulkan_device.rs:210
ClassVulkanTensorDeviceOptions
crabml-vulkan/src/vulkan_device.rs:45
ClassWgpuTensor
crabml-wgpu/src/wgpu_tensor.rs:21
ClassWgpuTensorDevice
crabml-wgpu/src/wgpu_device.rs:40
ClassWgpuTensorDeviceOptions
crabml-wgpu/src/wgpu_device.rs:9