MCPcopy Create free account
hub / github.com/Tiiny-AI/PowerInfer / n_batch

Method n_batch

smallthinker/src/llama-context.cpp:404–406  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

402}
403
404uint32_t llama_context::n_batch() const {
405 return cparams.n_batch;
406}
407
408uint32_t llama_context::n_ubatch() const {
409 return cparams.n_ubatch;

Callers 3

opt_initMethod · 0.95
opt_epoch_iterMethod · 0.95
llama_n_batchFunction · 0.80

Calls

no outgoing calls

Tested by

no test coverage detected