MCPcopy Create free account
hub / github.com/AlayaLab/Hive / tokenizer

Method tokenizer

models/audiosep/models/clap_encoder.py:108–116  ·  view source on GitHub ↗
(self, text)

Source from the content-addressed store, hash-verified

106 return embed.float()
107
108 def tokenizer(self, text):
109 result = self.tokenize(
110 text,
111 padding="max_length",
112 truncation=True,
113 max_length=512,
114 return_tensors="pt",
115 )
116 return {k: v.squeeze(0) for k, v in result.items()}

Callers 15

_get_text_embedMethod · 0.95
encode_textMethod · 0.80
__call__Method · 0.80
_encode_promptMethod · 0.80
_encode_promptMethod · 0.80
_encode_promptMethod · 0.80
_encode_promptMethod · 0.80
_encode_promptMethod · 0.80
_encode_promptMethod · 0.80
prepare_text_inputsMethod · 0.80
_generateMethod · 0.80
_encode_promptMethod · 0.80

Calls

no outgoing calls

Tested by

no test coverage detected