MCPcopy Create free account
hub / github.com/Tiiny-AI/PowerInfer / release

Method release

examples/server/server.cpp:457–463  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

455 }
456
457 void release() {
458 if (state == IDLE || state == PROCESSING)
459 {
460 t_token_generation = (ggml_time_us() - t_start_genereration) / 1e3;
461 command = RELEASE;
462 }
463 }
464
465 json get_formated_timings() {
466 return json

Callers 3

process_tasksMethod · 0.45
update_slotsMethod · 0.45

Calls 1

ggml_time_usFunction · 0.50

Tested by

no test coverage detected