hub / github.com/cli99/llm-analysis / get_num_params_per_layer_layernorm

Method get_num_params_per_layer_layernorm

llm_analysis/analysis.py:293–294 · view source on GitHub ↗

(self)

Source from the content-addressed store, hash-verified

291	return 0
292
293	def get_num_params_per_layer_layernorm(self) -> int:
294	return 2 * self.model_config.hidden_dim
295
296	def get_num_params_last_layernorm(self) -> int:
297	return self.model_config.hidden_dim

get_num_params_per_layerMethod · 0.95

get_num_active_params_per_layerMethod · 0.95

get_weight_memory_per_layerMethod · 0.95

get_memory_optimizer_state_and_gradient_per_layerMethod · 0.95

no outgoing calls

no test coverage detected