Method free

llama_cpp/server/model.py:68–71 · view source on GitHub ↗

(self)

Source from the content-addressed store, hash-verified

66	yield model
67
68	def free(self):
69	if self._current_model:
70	self._current_model.close()
71	del self._current_model
72
73	@staticmethod
74	def load_llama_from_model_settings(settings: ModelSettings) -> llama_cpp.Llama:

nothing calls this directly

closeMethod · 0.45

no test coverage detected