MCPcopy Create free account
hub / github.com/MiniMax-AI/VTP / reset_parameters

Method reset_parameters

vtp/models/layers/embeddings.py:79–83  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

77 return flops
78
79 def reset_parameters(self):
80 k = 1 / (self.in_chans * (self.patch_size[0] ** 2))
81 nn.init.uniform_(self.proj.weight, -math.sqrt(k), math.sqrt(k))
82 if self.proj.bias is not None:
83 nn.init.uniform_(self.proj.bias, -math.sqrt(k), math.sqrt(k))
84
85
86class RopePositionEmbedding(nn.Module):

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected