Types & classes — github.com/OpenBMB/CPM-Bee

CodeHub MCPcopy Create free account

hub / github.com/OpenBMB/CPM-Bee / types & classes

Types & classes69 in github.com/OpenBMB/CPM-Bee

⨍ Functions 302◇ Types & classes 69

↓ 7 callersClassLinear

src/cpm_live/layers/linear.py:22

↓ 7 callersClassLinear

src/cpm_live/native_layers/linear.py:21

↓ 6 callersClassEmbedding

src/cpm_live/layers/embedding.py:24

↓ 5 callersClassFileInfo

src/cpm_live/dataset/distributed_dataset.py:37

↓ 5 callersClassToken

src/cpm_live/tokenizers/bee.py:35

↓ 4 callersClassEncoder

Layers of encoder transformer blocks plus an final layernorm. Args: num_layers (int): number of layers. dim_model (int): main dim

src/cpm_live/layers/transformer.py:24

↓ 3 callersClassCPMBeeTokenizer

src/cpm_live/tokenizers/bee.py:51

↓ 3 callersClassLayerNorm

src/cpm_live/layers/layernorm.py:13

↓ 3 callersClassLayerNorm

src/cpm_live/native_layers/layernorm.py:12

↓ 3 callersClassPickleSerializer

src/cpm_live/dataset/serializer.py:31

↓ 2 callersClassBeamHypotheses

src/cpm_live/generation/generation_utils.py:69

↓ 2 callersClassBucketPositionBias

src/cpm_live/layers/position_embedding.py:131

↓ 2 callersClassCPMBee

src/cpm_live/models/bee.py:72

↓ 2 callersClassDistributedDataset

Open dataset in readonly mode. `DistributeDataset` is used to read datasets in a distributed manner. Data in this dataset will be distributed

src/cpm_live/dataset/distributed_dataset.py:203

↓ 2 callersClassEmbeddingExt

src/cpm_live/layers/embedding.py:67

↓ 2 callersClassFinetuneDataset

src/cpm_live/training_tasks/bee/finetune.py:7

↓ 2 callersClassRawSerializer

src/cpm_live/dataset/serializer.py:53

↓ 2 callersClassSegmentPositionEmbedding

src/cpm_live/layers/position_embedding.py:22

↓ 2 callersClassSimpleDataset

src/cpm_live/dataset/distributed_dataset.py:588

↓ 2 callersClass_MixedDatasetBatchPacker

src/cpm_live/training_tasks/bee/pretrain.py:252

↓ 1 callersClassAttention

src/cpm_live/layers/attention.py:23

↓ 1 callersClassAttention

src/cpm_live/native_layers/attention.py:22

↓ 1 callersClassCPMBeeBeamSearch

src/cpm_live/generation/bee.py:254

↓ 1 callersClassCPMBeeTorch

src/cpm_live/models/bee_torch.py:23

↓ 1 callersClassDatasetBuilder

src/cpm_live/dataset/distributed_dataset.py:679

↓ 1 callersClassDatasetWriter

src/cpm_live/dataset/distributed_dataset.py:617

↓ 1 callersClassDenseGatedACT

src/cpm_live/layers/feedforward.py:22

↓ 1 callersClassDenseGatedACT

src/cpm_live/native_layers/feedforward.py:21

↓ 1 callersClassFFNBlock

The whole feed-forward block. A sequence of operation. Consists of layernorm, feed-forward and residual connection. Args: dim_model (int)

src/cpm_live/layers/blocks.py:102

↓ 1 callersClassFFNBlock

The whole feed-forward block. A sequence of operation. Consists of layernorm, feed-forward and residual connection. Args: dim_model (int)

src/cpm_live/native_layers/blocks.py:101

↓ 1 callersClassFeedForward

r"""FeedForward module Args: dim_in (int): input dimension. dim_ff (int): middle dimension. dim_out (int, optional): outp

src/cpm_live/layers/feedforward.py:64

↓ 1 callersClassFeedForward

r"""FeedForward module Args: dim_in (int): input dimension. dim_ff (int): middle dimension. dim_out (int, optional): outp

src/cpm_live/native_layers/feedforward.py:62

↓ 1 callersClassLogManager

src/cpm_live/utils/log.py:30

↓ 1 callersClassLossSpikeDetector

src/pretrain_cpm_bee.py:116

↓ 1 callersClassMixedDataset

src/cpm_live/training_tasks/bee/pretrain.py:943

↓ 1 callersClassRotaryEmbedding

src/cpm_live/layers/position_embedding.py:219

↓ 1 callersClassRotaryEmbedding

src/cpm_live/native_layers/position_embedding.py:212

↓ 1 callersClassSafeFile

src/cpm_live/dataset/distributed_dataset.py:135

↓ 1 callersClassSelfAttentionBlock

The whole cross-attention block. A sequence of operation. Consists of layernorm, self-attention and residual connection. Args: dim_model

src/cpm_live/layers/blocks.py:24

↓ 1 callersClassSelfAttentionBlock

The whole cross-attention block. A sequence of operation. Consists of layernorm, self-attention and residual connection. Args: dim_model

src/cpm_live/native_layers/blocks.py:23

↓ 1 callersClassTransformerBlock

The whole transformer block. A sequence of operation. Consists of self-attention block[, cross-attention block] and feed-forward block. Args:

src/cpm_live/layers/blocks.py:161

↓ 1 callersClassTransformerBlock

The whole transformer block. A sequence of operation. Consists of self-attention block[, cross-attention block] and feed-forward block. Args:

src/cpm_live/native_layers/blocks.py:160

↓ 1 callersClassWordpieceTokenizer

src/cpm_live/tokenizers/ant.py:35

↓ 1 callersClass_MixedDatasetConfigMananger

src/cpm_live/training_tasks/bee/pretrain.py:700

ClassBucketPositionBias

src/cpm_live/native_layers/position_embedding.py:127

src/cpm_live/models/ant.py:65

ClassCPMAntBeamSearch

src/cpm_live/generation/ant.py:51

ClassCPMAntConfig

src/cpm_live/models/ant.py:23

ClassCPMAntGeneration

src/cpm_live/generation/ant.py:7

ClassCPMAntPretrainDataset

src/cpm_live/training_tasks/ant/pretrain.py:21

ClassCPMAntRandomSampling

src/cpm_live/generation/ant.py:278

ClassCPMAntTokenizer

src/cpm_live/tokenizers/ant.py:67

ClassCPMAntTorch

src/cpm_live/models/ant_torch.py:20

ClassCPMBeeBatch

src/cpm_live/training_tasks/bee/pretrain.py:73

ClassCPMBeeConfig

src/cpm_live/models/bee.py:35

ClassCPMBeeGeneration

src/cpm_live/generation/bee.py:12

ClassCPMBeeInferenceState

src/cpm_live/models/bee.py:26

model configuration

src/cpm_live/utils/config.py:47

src/cpm_live/native_layers/embedding.py:23

ClassEmbeddingExt

src/cpm_live/native_layers/embedding.py:63

Layers of encoder transformer blocks plus an final layernorm. Args: num_layers (int): number of layers. dim_model (int): main dim

src/cpm_live/native_layers/transformer.py:23

ClassJsonSerializer

src/cpm_live/dataset/serializer.py:42

ClassOpGradientShrink

src/cpm_live/utils/gradient_shrink.py:4

ClassSegmentPositionEmbedding

src/cpm_live/native_layers/position_embedding.py:21

ClassSerializer

src/cpm_live/dataset/serializer.py:20

src/cpm_live/training_tasks/bee/pretrain.py:51

Class_MixedDatasetConfig

src/cpm_live/training_tasks/bee/pretrain.py:36

Class_PrevExtTableStates

src/cpm_live/training_tasks/bee/pretrain.py:59

Class_TransformFuncDict

src/cpm_live/training_tasks/bee/pretrain.py:64