MCPcopy Create free account
hub / github.com/Tiiny-AI/PowerInfer / llama_perf_sampler_print

Function llama_perf_sampler_print

smallthinker/src/llama-sampling.cpp:2560–2565  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

2558}
2559
2560void llama_perf_sampler_print(const struct llama_sampler * chain) {
2561 const auto data = llama_perf_sampler(chain);
2562
2563 LLAMA_LOG_INFO("%s: sampling time = %10.2f ms / %5d runs (%8.2f ms per token, %8.2f tokens per second)\n",
2564 __func__, data.t_sample_ms, data.n_sample, data.t_sample_ms / data.n_sample, 1e3 / data.t_sample_ms * data.n_sample);
2565}
2566
2567void llama_perf_sampler_reset(struct llama_sampler * chain) {
2568 if (chain == nullptr || chain->iface != &llama_sampler_chain_i) {

Callers 4

common_perf_printFunction · 0.85
mainFunction · 0.85
mainFunction · 0.85
llama.hFile · 0.85

Calls 1

llama_perf_samplerFunction · 0.85

Tested by

no test coverage detected