MCPcopy Create free account
hub / github.com/Standard-Intelligence/hertz-dev / __init__

Method __init__

tokenizer.py:481–500  ·  view source on GitHub ↗
(self, c: Config)

Source from the content-addressed store, hash-verified

479 norm_stddev: float = 1.0
480
481 def __init__(self, c: Config):
482 super().__init__()
483 self.norm_stddev = c.norm_stddev
484 self.encoder = c.resnet_config(mode='encoder')
485 self.sample_rate = c.sample_rate
486
487 self.total_stride = 1
488 for stride in c.resnet_config.strides:
489 self.total_stride *= stride
490 self.tokens_per_second = self.sample_rate / self.total_stride
491
492 self.compressor = c.compressor_config(dim=self.encoder.middle_channels)
493
494 self.decoder = c.resnet_config(mode='decoder')
495
496 if c.use_weight_norm:
497 self.encoder.apply_weight_norm()
498 self.decoder.apply_weight_norm()
499 self.encoder.reset_parameters()
500 self.decoder.reset_parameters()
501
502 def encode(self, data):
503 return self.encoder(data/self.norm_stddev)

Callers

nothing calls this directly

Calls 3

apply_weight_normMethod · 0.80
__init__Method · 0.45
reset_parametersMethod · 0.45

Tested by

no test coverage detected