Code
Hub
Workspaces
Connect
Indexed graphs
Engine
MCP
copy
hub
/
github.com/mudler/LocalAI
/ Predict
Method
Predict
pkg/grpc/interface.go:14–14 ·
view source on GitHub ↗
(*pb.PredictOptions)
Source
from the content-addressed store, hash-verified
12
Unlock()
13
Locking() bool
14
Predict(*pb.PredictOptions) (string, error)
15
PredictStream(*pb.PredictOptions,
chan
string) error
16
Load(*pb.ModelOptions) error
17
Free() error
Callers
15
test_text
Method · 0.65
test_sampling_params
Method · 0.65
test_text
Method · 0.65
test_sampling_params
Method · 0.65
make_request
Method · 0.65
test_cache_reuse
Method · 0.65
test_prefix_cache_reuse
Method · 0.65
test_text
Method · 0.65
test_sampling_params
Method · 0.65
test_inference
Method · 0.65
test_text
Method · 0.65
test_sampling_params
Method · 0.65
Implementers
1
Base
pkg/grpc/base/base.go
Calls
no outgoing calls
Tested by
15
test_text
Method · 0.52
test_sampling_params
Method · 0.52
test_text
Method · 0.52
test_sampling_params
Method · 0.52
make_request
Method · 0.52
test_cache_reuse
Method · 0.52
test_prefix_cache_reuse
Method · 0.52
test_text
Method · 0.52
test_sampling_params
Method · 0.52
test_inference
Method · 0.52
test_text
Method · 0.52
test_sampling_params
Method · 0.52