MCPcopy Create free account
hub / github.com/appdevforall/CodeOnTheGo / test-tokenizer-random.py

File test-tokenizer-random.py

subprojects/llama.cpp/tests/test-tokenizer-random.py:None–None  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

1# Test libllama tokenizer == AutoTokenizer.
2# Brute force random words/text generation.
3#
4# Sample usage:

Callers

nothing calls this directly

Calls 3

mainFunction · 0.70
getLoggerMethod · 0.45
infoMethod · 0.45

Tested by

no test coverage detected