MCPcopy Create free account
hub / github.com/FastFlowLM/FastFlowLM / setup_tokenizer

Method setup_tokenizer

src/common/AutoModel/modeling_llama3.cpp:41–43  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

39}
40
41void Llama3::setup_tokenizer(std::string model_path) {
42 auto tokenizer_config = this->_shared_setup_tokenizer(model_path);
43}
44
45std::string Llama3::apply_chat_template(nlohmann::ordered_json& messages, nlohmann::ordered_json tools) {
46 minja::chat_template_inputs inputs;

Callers 1

load_modelMethod · 0.95

Calls 2

encodeMethod · 0.80

Tested by

no test coverage detected