Loads the model and prepares it for inference. In case of any error, this method will throw an exception. Parameters ---------- shared_library : RWKVSharedLibrary rwkv.cpp shared library. model_path : str Path to RWKV model fi
(
self,
shared_library: rwkv_cpp_shared_library.RWKVSharedLibrary,
model_path: str,
thread_count: int = max(1, multiprocessing.cpu_count() // 2),
gpu_layer_count: int = 0,
**kwargs
)
source not stored for this graph (policy: none)
nothing calls this directly
no test coverage detected