Functions — github.com/Om-Alve/smolGPT

CodeHub MCPcopy Create free account

hub / github.com/Om-Alve/smolGPT / functions

Functions32 in github.com/Om-Alve/smolGPT

⨍ Functions 32 ◇ Types & classes 10

↓ 4 callersMethod__init__

↓ 3 callersMethodencode

(self, s: str, bos: bool, eos: bool)

tokenizer.py:18

↓ 2 callersMethodapply_rotary_emb

(self, x, cos, sin)

↓ 2 callersMethoddecode

(self, tokens: List[int])

tokenizer.py:26

↓ 2 callersFunctiondownload

preprocess.py:35

↓ 2 callersMethodgenerate

( self, idx, max_new_tokens, temperature=1.0, top_k=None, top_p=None, min_p=None )

↓ 2 callersFunctionpretokenize

(vocab_size: int)

preprocess.py:101

↓ 2 callersFunctiontrain_vocab

(vocab_size: int)

preprocess.py:50

↓ 1 callersMethodconfigure_optimizers

(self, weight_decay, learning_rate, betas, device_type)

↓ 1 callersFunctiondownload_file

(url: str, filename: str, chunk_size: int = 1024)

preprocess.py:19

↓ 1 callersFunctionestimate_loss

↓ 1 callersFunctionget_lr

↓ 1 callersFunctionload_model

↓ 1 callersFunctionmain

↓ 1 callersFunctionparse_args

↓ 1 callersFunctionprepare_dataset

(vocab_size: int)

preprocess.py:110

↓ 1 callersFunctionsetup_device

(self, tokenizer_model)

(self, split: str, max_seq_len: int)

(self, dim, base=10_000)

(self, config: GPTConfig)

Method_init_weights

(self, idx, targets=None)

Methoditer_batches

( batch_size: int, device: str, num_workers: int = 0, **dataset_kwargs )

Functionprocess_shard

(args: tuple, vocab_size: int)

preprocess.py:80