MCPcopy Create free account
hub / github.com/FastFlowLM/FastFlowLM / generate

Method generate

src/common/AutoModel/modeling_llama3.cpp:80–83  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

78
79
80std::string Llama3::generate(chat_meta_info_t& meta_info, int length_limit, std::ostream& os, std::function<bool()> is_cancelled) {
81 //header_print("is_cancelled", is_cancelled);
82 return this->_shared_generate(meta_info, length_limit, os, is_cancelled);
83}
84
85std::string Llama3::generate_with_prompt(chat_meta_info_t& meta_info, lm_uniform_input_t& input, int length_limit, std::ostream& os) {
86 if (!this->insert(meta_info, input)) {

Callers 1

generate_with_promptMethod · 0.45

Calls 14

cast_to_usFunction · 0.85
_shared_generateMethod · 0.80
push_backMethod · 0.80
is_normal_tokenMethod · 0.80
run_time_decoderMethod · 0.80
is_eosMethod · 0.80
clearMethod · 0.80
forwardMethod · 0.80
sampleMethod · 0.80
get_total_timeMethod · 0.80
reserveMethod · 0.45
resetMethod · 0.45

Tested by

no test coverage detected