MCPcopy Create free account
hub / github.com/zai-org/CodeGeeX / _add_symbol

Method _add_symbol

codegeex/mindspore/src/code_tokenizer.py:103–107  ·  view source on GitHub ↗
(self, sym: str, count: int)

Source from the content-addressed store, hash-verified

101 self._add_symbol(sym, int(count))
102
103 def _add_symbol(self, sym: str, count: int):
104 self._idx[sym] = self._num_symbols
105 self._count[sym] = count
106 self._symbols.append(sym)
107 self._num_symbols += 1
108
109 def __len__(self):
110 return self._num_symbols

Callers 3

__init__Method · 0.95
_pad_to_vocab_sizeMethod · 0.95
_load_dictMethod · 0.95

Calls

no outgoing calls

Tested by

no test coverage detected