MCPcopy Create free account

hub / github.com/KellerJordan/modded-nanogpt / functions

Functions2,320 in github.com/KellerJordan/modded-nanogpt

Methodenter
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/utils/tests/shampoo_utils_test.py:263
Functionevaluate
Calculates and prints accuracy of `model` on 10042 HellaSwag validation tasks. This function takes: - very first run on 8 x H100 machine:
evals/hellaswag.py:171
Methodexpected_key_criterion
(key: str)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fully_shard_distributor_test.py:235
Methodexpected_key_criterion
(key: str)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_hybrid_shard_lossless_distributor_test.py:344
Methodexpected_key_criterion
(key: str)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_hybrid_shard_distributor_test.py:416
Methodexpected_key_criterion
(key: str)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fsdp_distributor_test.py:197
Methodexpected_key_criterion
(key: str)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fully_shard_lossless_distributor_test.py:282
Methodexpected_key_criterion
(key: str)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_hsdp_distributor_test.py:216
Methodforward
(self, x: Tensor)
train_gpt_medium.py:854
Methodforward
(self, x: Tensor, attn_args: AttnArgs)
train_gpt_medium.py:958
Methodforward
(self, x: Tensor)
train_gpt_medium.py:1008
Methodforward
(self, x: Tensor, attn_args: AttnArgs)
train_gpt_medium.py:1020
Methodforward
(self, input_seq: Tensor, target_seq: Tensor, seqlens: Tensor, schedule_cfg: ForwardScheduleConfig)
train_gpt_medium.py:1115
Methodforward
(self, x: Tensor)
train_gpt.py:970
Methodforward
(self, x: Tensor, attn_args: AttnArgs, qkvo_w: Tensor)
train_gpt.py:1075
Methodforward
(self, input_seq: Tensor, target_seq: Tensor, seqlens: Tensor, bigram_input_seq: Tensor, schedule_cfg: Forward
train_gpt.py:1345
Methodforward
(ctx, x, W1, W2, W1_f8=None, dequant_scale=None, x_f8=None)
triton_kernels.py:545
Methodforward
(ctx, x, targets, mtp_weights, lm_head_weight, x_s, w_s, grad_s, grad_scale, A=23.0, B=5.0, C=7.5)
triton_kernels.py:962
Methodforward
(self, x)
records/track_2_medium/2024-12-31_Target350M/train_gpt.py:139
Methodforward
(self, x)
records/track_2_medium/2024-12-31_Target350M/train_gpt.py:153
Methodforward
(self, x, ve, block_mask)
records/track_2_medium/2024-12-31_Target350M/train_gpt.py:174
Methodforward
(self, x)
records/track_2_medium/2024-12-31_Target350M/train_gpt.py:199
Methodforward
(self, x, ve, x0, block_mask)
records/track_2_medium/2024-12-31_Target350M/train_gpt.py:213
Methodforward
(self, inputs)
records/track_2_medium/2024-12-31_Target350M/train_gpt.py:225
Methodforward
(self, inputs, targets, sliding_window_num_blocks)
records/track_2_medium/2024-12-31_Target350M/train_gpt.py:251
Methodforward
(self, x_BTHD: Tensor)
records/track_2_medium/2025-11-12_BlockMaskRedundantOp/train_gpt_medium.py:139
Methodforward
(self, x: Tensor, ve: Tensor | None, block_mask: BlockMask, lambdas: Tensor)
records/track_2_medium/2025-11-12_BlockMaskRedundantOp/train_gpt_medium.py:162
Methodforward
(self, x: Tensor)
records/track_2_medium/2025-11-12_BlockMaskRedundantOp/train_gpt_medium.py:187
Methodforward
(self, x: Tensor, ve: Tensor | None, x0: Tensor, block_mask: BlockMask, lambdas: Tensor, sa_lambdas: Tensor)
records/track_2_medium/2025-11-12_BlockMaskRedundantOp/train_gpt_medium.py:200
Methodforward
(self, input_seq: Tensor, target_seq: Tensor, sliding_window_num_blocks: Tensor)
records/track_2_medium/2025-11-12_BlockMaskRedundantOp/train_gpt_medium.py:273
Methodforward
(self, x)
records/track_1_short/2024-10-09_SOAP/train_gpt2.py:452
Methodforward
(self, x)
records/track_1_short/2024-10-09_SOAP/train_gpt2.py:491
Methodforward
(self, x)
records/track_1_short/2024-10-09_SOAP/train_gpt2.py:513
Methodforward
(self, x)
records/track_1_short/2024-10-09_SOAP/train_gpt2.py:527
Methodforward
(self, idx, targets=None, return_logits=True)
records/track_1_short/2024-10-09_SOAP/train_gpt2.py:555
Methodforward
(self, x)
records/track_1_short/2024-12-04_ValueEmbed/train_gpt2.py:136
Methodforward
(self, x)
records/track_1_short/2024-12-04_ValueEmbed/train_gpt2.py:148
Methodforward
(self, x, vi, block_mask)
records/track_1_short/2024-12-04_ValueEmbed/train_gpt2.py:180
Methodforward
(self, x)
records/track_1_short/2024-12-04_ValueEmbed/train_gpt2.py:202
Methodforward
(self, x, vi, x0, block_mask)
records/track_1_short/2024-12-04_ValueEmbed/train_gpt2.py:216
Methodforward
(self, idx, target, attn_blocksize)
records/track_1_short/2024-12-04_ValueEmbed/train_gpt2.py:252
Methodforward
(self, x: Tensor)
records/track_1_short/2025-12-11_NorMuonOptimsAndFixes/profiler-example-traces/train_gpt-profiler-example.py:838
Methodforward
(self, x: Tensor, attn_args: AttnArgs)
records/track_1_short/2025-12-11_NorMuonOptimsAndFixes/profiler-example-traces/train_gpt-profiler-example.py:933
Methodforward
(self, x: Tensor)
records/track_1_short/2025-12-11_NorMuonOptimsAndFixes/profiler-example-traces/train_gpt-profiler-example.py:979
Methodforward
(self, x: Tensor, x0: Tensor, lambdas: Tensor, attn_args: AttnArgs)
records/track_1_short/2025-12-11_NorMuonOptimsAndFixes/profiler-example-traces/train_gpt-profiler-example.py:993
Methodforward
(self, input_seq: Tensor, target_seq: Tensor, seqlens: Tensor, ws_short: int, ws_long: int)
records/track_1_short/2025-12-11_NorMuonOptimsAndFixes/profiler-example-traces/train_gpt-profiler-example.py:1064
Methodforward
(self, x)
records/track_1_short/2024-10-14_ModernArch/train_gpt2.py:117
Methodforward
(self, x)
records/track_1_short/2024-10-14_ModernArch/train_gpt2.py:152
Methodforward
(self, x)
records/track_1_short/2024-10-14_ModernArch/train_gpt2.py:173
Methodforward
(self, x)
records/track_1_short/2024-10-14_ModernArch/train_gpt2.py:186
Methodforward
(self, idx, targets=None, return_logits=True)
records/track_1_short/2024-10-14_ModernArch/train_gpt2.py:214
Methodforward
(self, x)
records/track_1_short/2024-10-10_Muon/train_gpt2.py:117
Methodforward
(self, x)
records/track_1_short/2024-10-10_Muon/train_gpt2.py:155
Methodforward
(self, x)
records/track_1_short/2024-10-10_Muon/train_gpt2.py:179
Methodforward
(self, x)
records/track_1_short/2024-10-10_Muon/train_gpt2.py:193
Methodforward
(self, idx, targets=None, return_logits=True)
records/track_1_short/2024-10-10_Muon/train_gpt2.py:221
Methodforward
(self, x)
records/track_3_optimization/train_gpt_simple.py:64
Methodforward
(self, x)
records/track_3_optimization/train_gpt_simple.py:71
Methodforward
(self, x_BTHD: Tensor)
records/track_3_optimization/train_gpt_simple.py:81
Methodforward
(self, x: Tensor)
records/track_3_optimization/train_gpt_simple.py:102
Methodforward
(self, x: Tensor)
records/track_3_optimization/train_gpt_simple.py:122
Methodforward
(self, x: Tensor)
records/track_3_optimization/train_gpt_simple.py:136
Methodforward
(self, inputs: Tensor, targets: Tensor)
records/track_3_optimization/train_gpt_simple.py:150
Methodforward
(self, x)
records/track_3_optimization/results/20260520_rre_extrapolation_pr300_2925/train_gpt_simple_rre_pr300_2925.py:194
Methodforward
(self, x)
records/track_3_optimization/results/20260520_rre_extrapolation_pr300_2925/train_gpt_simple_rre_pr300_2925.py:201
Methodforward
(self, x_BTHD: Tensor)
records/track_3_optimization/results/20260520_rre_extrapolation_pr300_2925/train_gpt_simple_rre_pr300_2925.py:211
Methodforward
(self, x: Tensor)
records/track_3_optimization/results/20260520_rre_extrapolation_pr300_2925/train_gpt_simple_rre_pr300_2925.py:232
Methodforward
(self, x: Tensor)
records/track_3_optimization/results/20260520_rre_extrapolation_pr300_2925/train_gpt_simple_rre_pr300_2925.py:252
Methodforward
(self, x: Tensor)
records/track_3_optimization/results/20260520_rre_extrapolation_pr300_2925/train_gpt_simple_rre_pr300_2925.py:266
Methodforward
(self, inputs: Tensor, targets: Tensor)
records/track_3_optimization/results/20260520_rre_extrapolation_pr300_2925/train_gpt_simple_rre_pr300_2925.py:280
Methodforward
(self, x)
records/track_3_optimization/results/20260611_tailema_2720_submission/train_gpt_tailema_2720.py:227
Methodforward
(self, x)
records/track_3_optimization/results/20260611_tailema_2720_submission/train_gpt_tailema_2720.py:234
Methodforward
(self, x_BTHD: Tensor)
records/track_3_optimization/results/20260611_tailema_2720_submission/train_gpt_tailema_2720.py:244
Methodforward
(self, x: Tensor)
records/track_3_optimization/results/20260611_tailema_2720_submission/train_gpt_tailema_2720.py:265
Methodforward
(self, x: Tensor)
records/track_3_optimization/results/20260611_tailema_2720_submission/train_gpt_tailema_2720.py:285
Methodforward
(self, x: Tensor)
records/track_3_optimization/results/20260611_tailema_2720_submission/train_gpt_tailema_2720.py:299
Methodforward
(self, inputs: Tensor, targets: Tensor)
records/track_3_optimization/results/20260611_tailema_2720_submission/train_gpt_tailema_2720.py:313
Methodforward
(self, x)
records/track_3_optimization/results/20260519_dynmuon/train_gpt_simple_dynmuon.py:79
Methodforward
(self, x)
records/track_3_optimization/results/20260519_dynmuon/train_gpt_simple_dynmuon.py:88
Methodforward
(self, x_BTHD: Tensor)
records/track_3_optimization/results/20260519_dynmuon/train_gpt_simple_dynmuon.py:100
Methodforward
(self, x: Tensor)
records/track_3_optimization/results/20260519_dynmuon/train_gpt_simple_dynmuon.py:123
Methodforward
(self, x: Tensor)
records/track_3_optimization/results/20260519_dynmuon/train_gpt_simple_dynmuon.py:145
Methodforward
(self, x: Tensor)
records/track_3_optimization/results/20260519_dynmuon/train_gpt_simple_dynmuon.py:161
Methodforward
(self, inputs: Tensor, targets: Tensor)
records/track_3_optimization/results/20260519_dynmuon/train_gpt_simple_dynmuon.py:177
Methodforward
(self, x)
records/track_3_optimization/results/20260501_muonsq/train_gpt_simple_muonsq.py:72
Methodforward
(self, x)
records/track_3_optimization/results/20260501_muonsq/train_gpt_simple_muonsq.py:79
Methodforward
(self, x_BTHD: Tensor)
records/track_3_optimization/results/20260501_muonsq/train_gpt_simple_muonsq.py:89
Methodforward
(self, x: Tensor)
records/track_3_optimization/results/20260501_muonsq/train_gpt_simple_muonsq.py:110
Methodforward
(self, x: Tensor)
records/track_3_optimization/results/20260501_muonsq/train_gpt_simple_muonsq.py:130
Methodforward
(self, x: Tensor)
records/track_3_optimization/results/20260501_muonsq/train_gpt_simple_muonsq.py:144
Methodforward
(self, inputs: Tensor, targets: Tensor)
records/track_3_optimization/results/20260501_muonsq/train_gpt_simple_muonsq.py:158
Methodforward
(self, x)
records/track_3_optimization/results/20260506_trustlight/train_gpt_simple_trustlight.py:130
Methodforward
(self, x)
records/track_3_optimization/results/20260506_trustlight/train_gpt_simple_trustlight.py:137
Methodforward
(self, x_BTHD: Tensor)
records/track_3_optimization/results/20260506_trustlight/train_gpt_simple_trustlight.py:147
Methodforward
(self, x: Tensor)
records/track_3_optimization/results/20260506_trustlight/train_gpt_simple_trustlight.py:168
Methodforward
(self, x: Tensor)
records/track_3_optimization/results/20260506_trustlight/train_gpt_simple_trustlight.py:188
Methodforward
(self, x: Tensor)
records/track_3_optimization/results/20260506_trustlight/train_gpt_simple_trustlight.py:202
Methodforward
(self, inputs: Tensor, targets: Tensor)
records/track_3_optimization/results/20260506_trustlight/train_gpt_simple_trustlight.py:216
Methodforward
(self, x)
records/track_3_optimization/results/20260609_soap_f1_auxb2_clean/train_gpt_clean_SOTA.py:135
Methodforward
(self, x)
records/track_3_optimization/results/20260609_soap_f1_auxb2_clean/train_gpt_clean_SOTA.py:142
← previousnext →1,601–1,700 of 2,320, ranked by callers