MCPcopy Create free account

hub / github.com/KellerJordan/modded-nanogpt / functions

Functions2,320 in github.com/KellerJordan/modded-nanogpt

Method_compute_preconditioned_gradient
( self, grad: Tensor, preconditioned_dims_selector: tuple[bool, ...], kronecke
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/shampoo_preconditioner_list.py:1739
Method_construct_local_block_info_list
Construct the local block info list. This method creates a list of BlockInfo objects for DTensor parameters, which contain information
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/shampoo_fully_shard_distributor.py:62
Method_construct_local_block_info_list
Construct the local block info list.
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/_shampoo_hybrid_shard_lossless_distributor.py:217
Method_construct_local_block_info_list
Construct local block info list from param_group.
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/_shampoo_fully_shard_lossless_distributor.py:220
Method_construct_local_block_info_list
Construct the local block info list with rank information. This method overrides the parent class to include rank information in the block ID
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/shampoo_fsdp_distributor.py:394
Method_construct_model
( post_model_decoration: Callable[[nn.Module], nn.Module] = lambda x: x, )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fully_shard_distributor_test.py:67
Method_construct_model
( model_linear_layers_dims: tuple[int, ...], model_dead_layers_dims: tuple[int, ...],
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_hybrid_shard_lossless_distributor_test.py:86
Method_construct_model
( model_linear_layers_dims: tuple[int, ...], model_dead_layers_dims: tuple[int, ...],
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fully_shard_lossless_distributor_test.py:84
Method_construct_model_and_distributor
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_ddp_distributor_test.py:764
Method_construct_model_and_distributor
( self, )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fully_shard_distributor_test.py:265
Method_construct_model_and_distributor
( self, )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_hybrid_shard_lossless_distributor_test.py:374
Method_construct_model_and_distributor
( self, )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_hybrid_shard_distributor_test.py:533
Method_construct_model_and_distributor
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fsdp_distributor_test.py:264
Method_construct_model_and_distributor
( self, )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fully_shard_lossless_distributor_test.py:312
Method_construct_model_and_distributor
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_hsdp_distributor_test.py:365
Method_convert_float_to_float
( src_list: tuple[Tensor, ...], target_dtype: torch.dtype, dest_list: tuple[Tensor, ..
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/utils/shampoo_quantization.py:258
Method_convert_state_key_from_str_to_int
Convert new_state dictionary keys to integers to match old_state collection indices. When optimizer state dictionaries are f
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/utils/optimizer_modules.py:142
Method_create_preconditioned_dims_selector
( self, dims: torch.Size )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/shampoo_preconditioner_list.py:1574
Method_create_preconditioned_dims_selector
( self, dims: torch.Size )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/shampoo_preconditioner_list.py:1668
Method_default_orthogonalization_config
()
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/shampoo_types.py:647
Method_default_preconditioner_config
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/shampoo_preconditioner_list_test.py:127
Method_default_preconditioner_config
( self, )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/shampoo_preconditioner_list_test.py:623
Method_default_preconditioner_config
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/shampoo_preconditioner_list_test.py:1099
Method_default_preconditioner_config
( # type: ignore[override] self, )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/shampoo_preconditioner_list_test.py:1124
Method_default_preconditioner_config
( self, )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/shampoo_preconditioner_list_test.py:1147
Method_default_preconditioner_config
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/shampoo_preconditioner_list_test.py:1413
Method_default_preconditioner_config
( # type: ignore[override] self, )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/shampoo_preconditioner_list_test.py:1433
Method_default_scale_by_dims_fn
Default scaling function that returns 1.0 (no scaling).
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/matrix_functions_types.py:260
Method_default_scale_fn
Default scale function that returns 1.0. Implemented as staticmethod for pickleable concerns.
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/shampoo_types.py:680
Method_device
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_ddp_distributor_test.py:71
Method_device
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_ddp_distributor_test.py:744
Method_device
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_ddp_distributor_test.py:900
Method_device
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_ddp_distributor_test.py:917
Method_device
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_ddp_distributor_test.py:925
Method_device
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_ddp_distributor_test.py:934
Method_expected_compress_list_call_count
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/sgd_preconditioner_list_test.py:66
Method_expected_compress_list_call_count
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/preconditioner_list_test_utils.py:111
Method_expected_compress_list_call_count
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/shampoo_preconditioner_list_test.py:617
Method_expected_compress_list_call_count
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/spectral_descent_preconditioner_list_test.py:125
Method_expected_compress_list_call_count
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/adagrad_preconditioner_list_test.py:138
Method_expected_compress_list_call_count
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/sign_descent_preconditioner_list_test.py:101
Method_expected_dims_list
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/sgd_preconditioner_list_test.py:50
Method_expected_dims_list
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/preconditioner_list_test_utils.py:77
Method_expected_dims_list
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/shampoo_preconditioner_list_test.py:596
Method_expected_dims_list
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/spectral_descent_preconditioner_list_test.py:109
Method_expected_dims_list
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/adagrad_preconditioner_list_test.py:122
Method_expected_dims_list
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/sign_descent_preconditioner_list_test.py:85
Method_expected_local_block_info_list
( self, model: nn.Module )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_ddp_distributor_test.py:852
Method_expected_local_block_info_list
( self, model: nn.Module )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fully_shard_distributor_test.py:350
Method_expected_local_block_info_list
( self, model: nn.Module )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_hybrid_shard_lossless_distributor_test.py:472
Method_expected_local_block_info_list
( self, model: nn.Module )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_hybrid_shard_distributor_test.py:623
Method_expected_local_block_info_list
( self, model: nn.Module )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fsdp_distributor_test.py:341
Method_expected_local_block_info_list
( self, model: nn.Module )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fully_shard_lossless_distributor_test.py:394
Method_expected_local_block_info_list
( self, model: nn.Module )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_hsdp_distributor_test.py:463
Method_expected_local_blocked_params
Returns expected local blocked parameters used in test_local_blocked_params
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/distributor_test_utils.py:110
Method_expected_local_blocked_params
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_ddp_distributor_test.py:824
Method_expected_local_blocked_params
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fully_shard_distributor_test.py:331
Method_expected_local_blocked_params
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_hybrid_shard_lossless_distributor_test.py:448
Method_expected_local_blocked_params
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_hybrid_shard_distributor_test.py:604
Method_expected_local_blocked_params
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fsdp_distributor_test.py:324
Method_expected_local_blocked_params
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fully_shard_lossless_distributor_test.py:380
Method_expected_local_blocked_params
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_hsdp_distributor_test.py:434
Method_expected_local_grad_selector
Returns expected gradient selector values used in test_local_grad_selector
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/distributor_test_utils.py:94
Method_expected_local_grad_selector
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_ddp_distributor_test.py:816
Method_expected_local_grad_selector
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fully_shard_distributor_test.py:323
Method_expected_local_grad_selector
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_hybrid_shard_lossless_distributor_test.py:440
Method_expected_local_grad_selector
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_hybrid_shard_distributor_test.py:596
Method_expected_local_grad_selector
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fsdp_distributor_test.py:320
Method_expected_local_grad_selector
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fully_shard_lossless_distributor_test.py:372
Method_expected_local_grad_selector
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_hsdp_distributor_test.py:430
Method_expected_local_masked_block_grads
Returns expected local masked block gradients used in test_merge_and_block_gradients
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/distributor_test_utils.py:157
Method_expected_local_masked_block_grads
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_ddp_distributor_test.py:890
Method_expected_local_masked_block_grads
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fully_shard_distributor_test.py:376
Method_expected_local_masked_block_grads
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_hybrid_shard_lossless_distributor_test.py:497
Method_expected_local_masked_block_grads
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_hybrid_shard_distributor_test.py:681
Method_expected_local_masked_block_grads
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fsdp_distributor_test.py:363
Method_expected_local_masked_block_grads
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fully_shard_lossless_distributor_test.py:419
Method_expected_local_masked_block_grads
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_hsdp_distributor_test.py:517
Method_expected_num_bytes
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/sgd_preconditioner_list_test.py:62
Method_expected_num_bytes
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/preconditioner_list_test_utils.py:102
Method_expected_num_bytes
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/shampoo_preconditioner_list_test.py:613
Method_expected_num_bytes
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/spectral_descent_preconditioner_list_test.py:121
Method_expected_num_bytes
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/adagrad_preconditioner_list_test.py:134
Method_expected_num_bytes
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/sign_descent_preconditioner_list_test.py:97
Method_expected_num_bytes_list
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/sgd_preconditioner_list_test.py:54
Method_expected_num_bytes_list
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/preconditioner_list_test_utils.py:86
Method_expected_num_bytes_list
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/shampoo_preconditioner_list_test.py:605
Method_expected_num_bytes_list
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/spectral_descent_preconditioner_list_test.py:113
Method_expected_num_bytes_list
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/adagrad_preconditioner_list_test.py:126
Method_expected_num_bytes_list
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/sign_descent_preconditioner_list_test.py:89
Method_expected_numel
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/sgd_preconditioner_list_test.py:58
Method_expected_numel
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/preconditioner_list_test_utils.py:95
Method_expected_numel
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/shampoo_preconditioner_list_test.py:609
Method_expected_numel
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/spectral_descent_preconditioner_list_test.py:117
Method_expected_numel
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/adagrad_preconditioner_list_test.py:130
Method_expected_numel
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/sign_descent_preconditioner_list_test.py:93
Method_expected_numel_list
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/sgd_preconditioner_list_test.py:46
Method_expected_numel_list
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/preconditioner_list_test_utils.py:68
Method_expected_numel_list
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/shampoo_preconditioner_list_test.py:592
Method_expected_numel_list
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/spectral_descent_preconditioner_list_test.py:105
← previousnext →1,401–1,500 of 2,320, ranked by callers