Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/appdevforall/CodeOnTheGo
/ get_tokenizer_pre
Method
get_tokenizer_pre
subprojects/llama.cpp/src/llama-vocab.cpp:3351–3353 ·
view source on GitHub ↗
Source
from the content-addressed store, hash-verified
3349
}
3350
3351
std::string llama_vocab::get_tokenizer_pre() const {
3352
return pimpl->tokenizer_pre;
3353
}
3354
3355
enum llama_vocab_type llama_vocab::get_type() const {
3356
return pimpl->type;
Callers
1
add_kv_from_model
Method · 0.80
Calls
no outgoing calls
Tested by
no test coverage detected