MCPcopy Create free account
hub / github.com/SooLab/CGFormer / default_bpe

Function default_bpe

utils/simple_tokenizer.py:11–12  ·  view source on GitHub ↗
()

Source from the content-addressed store, hash-verified

9
10@lru_cache()
11def default_bpe():
12 return os.path.join(os.path.dirname(os.path.abspath(__file__)), "bpe_simple_vocab_16e6.txt.gz")
13
14
15@lru_cache()

Callers 1

__init__Method · 0.85

Calls

no outgoing calls

Tested by

no test coverage detected