MCPcopy Create free account
hub / github.com/FastFlowLM/FastFlowLM / setup_tokenizer

Method setup_tokenizer

src/common/AutoModel/modeling_lfm2.cpp:42–45  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

40}
41
42void LFM2::setup_tokenizer(std::string model_path) {
43 auto tokenizer_config = this->_shared_setup_tokenizer(model_path);
44 this->tokenizer->is_doubled_encoded = true;
45}
46
47std::string LFM2::apply_chat_template(nlohmann::ordered_json& messages, nlohmann::ordered_json tools) {
48 minja::chat_template_inputs inputs;

Callers 1

load_modelMethod · 0.95

Calls 1

Tested by

no test coverage detected