MCPcopy
hub / github.com/mudler/LocalAI / DistributedModelManager

Struct DistributedModelManager

core/services/nodes/managers_distributed.go:22–25  ·  view source on GitHub ↗

DistributedModelManager wraps a local ModelManager and adds NATS fan-out for model deletion so worker nodes clean up stale files.

Source from the content-addressed store, hash-verified

20// DistributedModelManager wraps a local ModelManager and adds NATS fan-out
21// for model deletion so worker nodes clean up stale files.
22type DistributedModelManager struct {
23 local galleryop.ModelManager
24 adapter *RemoteUnloaderAdapter
25}
26
27// NewDistributedModelManager creates a DistributedModelManager.
28// Backend auto-install is disabled because the frontend node delegates

Callers

nothing calls this directly

Calls

no outgoing calls

Tested by

no test coverage detected