Functions — github.com/BlinkDL/LinearAttentionArena

CodeHub MCPcopy Create free account

hub / github.com/BlinkDL/LinearAttentionArena / functions

Functions86 in github.com/BlinkDL/LinearAttentionArena

⨍ Functions 86 ◇ Types & classes 15

↓ 7 callersFunctionprint_rank_0

src/binidx.py:10

↓ 6 callersMethodwrite

(self, sizes, doc_idx)

src/binidx.py:80

↓ 5 callersMethod__init__

src/model.py:442

↓ 3 callersFunctiondata_file_path

src/binidx.py:45

↓ 3 callersMethodget

Retrieves a single item from the dataset with the option to only return a portion of the item. get(idx) is the same as [idx] but get(

src/binidx.py:232

↓ 3 callersFunctionmy_save

(args, trainer, dd, ff)

src/trainer.py:7

↓ 2 callersMethod_do_init

(self, path, skip_warmup)

src/binidx.py:187

↓ 2 callersFunction_warmup_mmap_file

src/binidx.py:19

↓ 2 callersMethodforward

src/model.py:547

↓ 2 callersFunctionindex_file_path

src/binidx.py:42

↓ 1 callersFunctionFermatPrimalityTest

src/utils.py:91

↓ 1 callersFunctionMaybeIsPrime

src/utils.py:84

↓ 1 callersFunctionMillerRabinPrimalityTest

src/utils.py:102

↓ 1 callersFunctionRUN_CUDA_RWKV5

(B, T, C, H, r, k, v, w, u)

src/model.py:142

↓ 1 callersFunctionRUN_CUDA_RWKV6

(B, T, C, H, r, k, v, w, u)

src/model.py:89

↓ 1 callersMethod_get_pointers

src/binidx.py:69

↓ 1 callersMethodbackward

src/model.py:71

↓ 1 callersFunctioncode

src/binidx.py:36

↓ 1 callersMethoddtype

src/binidx.py:154

↓ 1 callersMethodexists

src/binidx.py:266

↓ 1 callersFunctiongenerate_init_weight

(model, init_weight_name)

src/trainer.py:188

↓ 1 callersMethodgenerate_init_weight

src/model.py:579

↓ 1 callersMethodjit_func

src/model.py:199

↓ 1 callersMethodjit_func

src/model.py:277

↓ 1 callersMethodjit_func_2

src/model.py:214

↓ 1 callersMethodjit_func_2

src/model.py:299

FunctionPYBIND11_MODULE

cuda/wkv6_op.cpp:14

FunctionPYBIND11_MODULE

cuda/wkv5_op.cpp:14

FunctionTORCH_LIBRARY

cuda/wkv6_op.cpp:19

FunctionTORCH_LIBRARY

cuda/wkv5_op.cpp:19

src/binidx.py:149

src/binidx.py:201

Method__enter__

src/binidx.py:55

(self, exc_type, exc_val, exc_tb)

src/binidx.py:99

Method__getitem__

src/dataset.py:37

Method__getitem__

src/binidx.py:166

Method__getitem__

src/binidx.py:210

Method__getstate__

src/binidx.py:181

(self, WORD_NAME, UNKNOWN_CHAR='\ue083')

src/utils.py:17

src/dataset.py:15

(self, path, skip_warmup=False)

src/binidx.py:104

(self, path, skip_warmup=False)

src/binidx.py:172

src/trainer.py:14

(self, args, layer_id)

src/model.py:151

(self, args, layer_id)

src/model.py:229

(self, args, layer_id)

src/model.py:316

(self, args, layer_id)

src/model.py:345

(self, args, layer_id)

src/model.py:379

src/dataset.py:34

src/binidx.py:169

src/binidx.py:206

src/model.py:23

Method__setstate__

src/binidx.py:184

Functionbackward

cuda/wkv6_op.cpp:11

Functionbackward

cuda/wkv5_op.cpp:11

src/model.py:123

(ctx, grad_output)

src/model.py:431

Methodconfigure_optimizers

src/model.py:463

Methoddeepspeed_offload

src/model.py:540

src/binidx.py:162

src/binidx.py:252

Functionforward

cuda/wkv6_op.cpp:8

Functionforward

cuda/wkv5_op.cpp:8

(ctx, B, T, C, H, r, k, v, w, u)

src/model.py:48

(ctx, B, T, C, H, r, k, v, w, u)

src/model.py:98

src/model.py:221

src/model.py:304

src/model.py:335

src/model.py:364

(self, x, x_emb=None)

src/model.py:408

src/model.py:426

Methodget_doc_idx

src/binidx.py:255

Methodon_train_batch_end

(self, trainer, pl_module, outputs, batch, batch_idx)

src/trainer.py:104

Methodon_train_batch_start

(self, trainer, pl_module, batch, batch_idx)

src/trainer.py:18

Methodon_train_epoch_end

(self, trainer, pl_module)

src/trainer.py:159

Methodon_train_epoch_start

(self, trainer, pl_module)

src/trainer.py:147

Functionrecord_time

Methodrefine_context

(self, context)

src/utils.py:39

Methodsample_logits

(self, out, x, ctx_len, temperature=1.0, top_p_usual=None, top_p_newline=None)

src/utils.py:49

Methodset_doc_idx

(self, doc_idx_)

src/binidx.py:258

src/binidx.py:158

src/binidx.py:248

Methodsupports_prefetch

src/binidx.py:262

Methodtraining_step

(self, batch, batch_idx)

src/model.py:566

Methodtraining_step_end

(self, batch_parts)

src/model.py:573

(cls, path, dtype)

src/binidx.py:53