MCPcopy Create free account

hub / github.com/KellerJordan/modded-nanogpt / functions

Functions2,320 in github.com/KellerJordan/modded-nanogpt

Methodtest_local_blocked_params
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_ddp_distributor_test.py:848
Methodtest_local_blocked_params
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fully_shard_distributor_test.py:347
Methodtest_local_blocked_params
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_hybrid_shard_lossless_distributor_test.py:469
Methodtest_local_blocked_params
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_hybrid_shard_distributor_test.py:620
Methodtest_local_blocked_params
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fully_shard_lossless_distributor_test.py:391
Methodtest_local_grad_selector
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/tests/shampoo_distributor_test.py:81
Methodtest_local_grad_selector
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/tests/shampoo_distributor_test.py:260
Methodtest_local_grad_selector
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/distributor_test_utils.py:97
Methodtest_local_grad_selector
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_ddp_distributor_test.py:819
Methodtest_local_grad_selector
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fully_shard_distributor_test.py:327
Methodtest_local_grad_selector
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_hybrid_shard_lossless_distributor_test.py:444
Methodtest_local_grad_selector
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_hybrid_shard_distributor_test.py:600
Methodtest_local_grad_selector
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fully_shard_lossless_distributor_test.py:376
Methodtest_losses
( self, num_trainers_per_group: int, communication_dtype: torch.dtype,
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_ddp_distributor_test.py:152
Methodtest_matrix_eigendecomposition_with_eigh
( self, A: Tensor, expected_eigenvalues: Tensor, expected_eigenvectors: Tensor
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/matrix_functions_test.py:733
Methodtest_matrix_eigendecomposition_with_eigh_and_eigenvectors_estimate
( self, )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/matrix_functions_test.py:759
Methodtest_matrix_eigendecomposition_with_qr
( self, A: Tensor, expected_eigenvalues: Tensor, expected_eigenvectors: Tensor
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/matrix_functions_test.py:814
Methodtest_matrix_inverse_root
( self, A: Tensor, expected_root: Tensor, exp: int, root_inv_config: RootInvConfig )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/matrix_functions_test.py:260
Methodtest_matrix_inverse_root_higher_order_blowup
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/matrix_functions_test.py:277
Methodtest_matrix_inverse_root_higher_order_error_blowup_before_powering
( self, )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/matrix_functions_test.py:354
Methodtest_matrix_inverse_root_higher_order_tf32_preservation
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/matrix_functions_test.py:339
Methodtest_matrix_inverse_root_reach_max_iterations
( self, root_inv_config: RootInvConfig, msg: str )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/matrix_functions_test.py:314
Methodtest_matrix_inverse_root_with_invalid_root_inv_config
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/matrix_functions_test.py:372
Methodtest_matrix_inverse_root_with_no_effect_exponent_multiplier
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/matrix_functions_test.py:290
Methodtest_matrix_perturbation_is_eigenvalues
(self, A: Tensor)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/matrix_functions_test.py:110
Methodtest_matrix_perturbation_not_is_eigenvalues
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/matrix_functions_test.py:103
Methodtest_matrix_root_eigen_nonpositive_root
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/matrix_functions_test.py:493
Methodtest_merge_all_small_dims
( self, threshold: int, expected_new_tensor_shape: tuple[int, ...] )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/utils/tests/shampoo_utils_test.py:40
Methodtest_merge_and_block_gradients
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/tests/shampoo_distributor_test.py:145
Methodtest_merge_and_block_gradients
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/tests/shampoo_distributor_test.py:328
Methodtest_merge_and_block_gradients
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/distributor_test_utils.py:160
Methodtest_merge_and_block_gradients
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_ddp_distributor_test.py:893
Methodtest_merge_and_block_gradients
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fully_shard_distributor_test.py:380
Methodtest_merge_and_block_gradients
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_hybrid_shard_lossless_distributor_test.py:501
Methodtest_merge_and_block_gradients
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_hybrid_shard_distributor_test.py:685
Methodtest_merge_and_block_gradients
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fully_shard_lossless_distributor_test.py:423
Methodtest_merge_small_dims_all_ones
(self, threshold: int)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/utils/tests/shampoo_utils_test.py:64
Methodtest_merge_small_dims_empty
(self, tensor_shape: tuple[int, ...])
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/utils/tests/shampoo_utils_test.py:78
Methodtest_merge_small_dims_for_single_dim
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/utils/tests/shampoo_utils_test.py:52
Methodtest_model_on_correct_device
Test that the model is placed on the correct device.
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/examples/tests/utils_test.py:108
Methodtest_model_parameters
Test that model parameters can be accessed and have correct shapes.
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/examples/tests/convnet_test.py:77
Methodtest_model_with_custom_out_channels
Test that get_model_and_loss_fn accepts custom out_channels.
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/examples/tests/utils_test.py:116
Methodtest_model_with_disable_linear_bias
Test that get_model_and_loss_fn accepts disable_linear_bias.
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/examples/tests/utils_test.py:123
Methodtest_model_with_edge_case_dimensions
Test model with edge case dimensions.
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/examples/tests/convnet_test.py:106
Methodtest_multi_dim_split_for_one_dim
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/utils/tests/shampoo_utils_test.py:147
Methodtest_multi_dim_split_for_two_dim
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/utils/tests/shampoo_utils_test.py:157
Methodtest_multi_dim_split_without_spliting
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/utils/tests/shampoo_utils_test.py:171
Methodtest_multiple_updates_logging
Test logging behavior with multiple updates.
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/examples/tests/loss_metrics_test.py:29
Methodtest_newton_root_inverse_identity
(self, n: int, root: int)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/matrix_functions_test.py:603
Methodtest_newton_root_inverse_tridiagonal
( self, n: int, root: int, alpha: float, beta: float )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/matrix_functions_test.py:619
Methodtest_no_retry_double_precision_raise_exception
( self, mock_eigh: mock.Mock )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/matrix_functions_test.py:509
Methodtest_non_2d_parameters_error
(self, block_list: tuple[Tensor, ...])
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/spectral_descent_preconditioner_list_test.py:92
Methodtest_non_zero_tolerance_eigh_without_eigenvectors_estimate
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/matrix_functions_test.py:860
Methodtest_noop_hyperparameter_setting_warnings
( self, noop_hyperparameter_setting: dict[str, Any], expected_warning_msgs: list[str],
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/tests/distributed_shampoo_test.py:215
Methodtest_normal_batching
Test batching an iterable with size divisible by batch size.
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/utils/tests/commons_test.py:25
Methodtest_num_bytes
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/preconditioner_list_test_utils.py:104
Methodtest_num_bytes_list
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/preconditioner_list_test_utils.py:88
Methodtest_number_of_trainers_per_group_out_of_range
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_hybrid_shard_distributor_test.py:438
Methodtest_number_of_trainers_per_group_out_of_range
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_hsdp_distributor_test.py:270
Methodtest_numel
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/preconditioner_list_test_utils.py:97
Methodtest_numel_list
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/preconditioner_list_test_utils.py:70
Methodtest_optimizer_zero_grad
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/tests/distributed_shampoo_test.py:287
Methodtest_orthogonalization_non_square_matrix
( self, matrix: Tensor, orthogonalization_config: OrthogonalizationConfig )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/matrix_functions_test.py:941
Methodtest_orthogonalization_with_newton_schulz
( self, scale_by_dims_fn: Callable[[int, int], float] )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/matrix_functions_test.py:907
Methodtest_orthogonalization_with_svd
( self, scale_by_nuclear_norm: bool, scale_by_dims_fn: Callable[[int, int], float] )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/matrix_functions_test.py:880
Methodtest_parameterize_enter_exit_context
Test the enter and exit context management. This test creates an instance of a TestClass, which has enter and exit methods that modif
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/utils/tests/shampoo_utils_test.py:249
Methodtest_parse_fsdp_params
( self, model_to_params: Callable[[nn.Module], Iterator[tuple[str, Parameter]]], named
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fsdp_utils_test.py:164
Methodtest_parse_fully_shard_params
( self, model_to_params: Callable[[nn.Module], Iterator[tuple[str, Parameter]]], named
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fsdp_utils_test.py:279
Methodtest_parse_fully_shard_params_invalid_paramsT
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/distributor/gpu_tests/shampoo_fsdp_utils_test.py:331
Methodtest_perturbation_before_computation
( self, perturb_before_computation: bool )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/matrix_functions_test.py:119
Methodtest_precondition_grad
(self, dims: tuple[list[int], list[int]])
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/shampoo_preconditioner_list_test.py:538
Methodtest_precondition_non_square_matrix
( self, orthogonalization_config: OrthogonalizationConfig )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/spectral_descent_preconditioner_list_test.py:72
Methodtest_pseudoinverse
(self, rank_rtol: float | None)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/matrix_functions_test.py:139
Methodtest_pseudoinverse_with_invalid_epsilon
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/matrix_functions_test.py:181
Methodtest_pseudoinverse_with_invalid_epsilon
(self)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/matrix_functions_test.py:688
Methodtest_pt2_shampoo_after_preconditioning
( self, betas: tuple[float, float], precondition_frequency: int, start_precond
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/gpu_tests/shampoo_pt2_test.py:101
Methodtest_pt2_shampoo_before_preconditioning
( self, weight_decay: float, betas: tuple[float, float], grafting_config: Prec
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/gpu_tests/shampoo_pt2_test.py:67
Methodtest_raise_invalid_value_in_factor_matrix
( self, invalid_value: float )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/shampoo_preconditioner_list_test.py:260
Methodtest_raise_nan_and_inf_in_inv_factor_matrix_amortized_computation
( self, )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/shampoo_preconditioner_list_test.py:277
Methodtest_raise_nan_and_inf_in_inv_factor_matrix_amortized_computation_but_fail_saving
( self, )
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/shampoo_preconditioner_list_test.py:305
Methodtest_reads_environment_variables
Test that get_distributed_env reads from environment.
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/examples/tests/utils_test.py:45
Methodtest_redistribute_and_update_params
(self, num_params: int)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/utils/gpu_tests/shampoo_utils_test.py:53
Methodtest_register_resolvers_idempotent
Test that register_resolvers can be called multiple times safely.
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/examples/tests/resolvers_test.py:97
Methodtest_requires_device_mesh_is_false
Test that SingleGPUStrategy does not require device mesh.
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/examples/tests/parallelism_test.py:52
Methodtest_requires_device_mesh_is_false
Test that DDPStrategy does not require device mesh.
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/examples/tests/parallelism_test.py:75
Methodtest_requires_device_mesh_is_false
Test that FSDPStrategy does not require device mesh.
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/examples/tests/parallelism_test.py:127
Methodtest_requires_device_mesh_is_false
Test that FullyShardStrategy does not require device mesh.
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/examples/tests/parallelism_test.py:227
Methodtest_requires_device_mesh_is_true
Test that HSDPStrategy requires device mesh.
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/examples/tests/parallelism_test.py:180
Methodtest_requires_device_mesh_is_true
Test that HybridShardStrategy requires device mesh.
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/examples/tests/parallelism_test.py:252
Methodtest_requires_distributed_is_false
Test that SingleGPUStrategy does not require distributed.
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/examples/tests/parallelism_test.py:47
Methodtest_requires_distributed_is_true
Test that DDPStrategy requires distributed.
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/examples/tests/parallelism_test.py:70
Methodtest_requires_distributed_is_true
Test that FSDPStrategy requires distributed.
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/examples/tests/parallelism_test.py:122
Methodtest_requires_distributed_is_true
Test that HSDPStrategy requires distributed.
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/examples/tests/parallelism_test.py:175
Methodtest_requires_distributed_is_true
Test that FullyShardStrategy requires distributed.
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/examples/tests/parallelism_test.py:222
Methodtest_requires_distributed_is_true
Test that HybridShardStrategy requires distributed.
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/examples/tests/parallelism_test.py:247
Methodtest_retry_double_precision_double_precision
Test that matrix_inverse_root retries with double precision when eigh fails.
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/matrix_functions_test.py:540
Methodtest_retry_double_precision_raise_exception
(self, mock_eigh: mock.Mock)
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/preconditioner/tests/matrix_functions_test.py:527
Methodtest_returns_model_and_loss_fn
Test that get_model_and_loss_fn returns a model and loss function.
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/examples/tests/utils_test.py:100
Methodtest_rmsprop_eigenvalue_correction
( self, weight_decay: float, device: torch.device, start_preconditioning_step:
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/gpu_tests/shampoo_eigenvalue_correction_test.py:235
Methodtest_rmsprop_grafting
( self, weight_decay: float, device: torch.device, preconditioner_config: Prec
records/track_3_optimization/results/20260513_shampoo_1_4_power/distributed_shampoo/gpu_tests/shampoo_grafting_test.py:184
← previousnext →2,101–2,200 of 2,320, ranked by callers