MCPcopy Index your code
hub / github.com/mudler/LocalAI / Predict

Method Predict

core/services/nodes/inflight.go:107–111  ·  view source on GitHub ↗

--- Tracked inference methods ---

(ctx context.Context, in *pb.PredictOptions, opts ...ggrpc.CallOption)

Source from the content-addressed store, hash-verified

105// --- Tracked inference methods ---
106
107func (c *InFlightTrackingClient) Predict(ctx context.Context, in *pb.PredictOptions, opts ...ggrpc.CallOption) (*pb.Reply, error) {
108 defer c.track(ctx)()
109 reply, err := c.inner.Predict(ctx, in, opts...)
110 return reply, c.reconcile(err)
111}
112
113func (c *InFlightTrackingClient) PredictStream(ctx context.Context, in *pb.PredictOptions, f func(reply *pb.Reply), opts ...ggrpc.CallOption) error {
114 defer c.track(ctx)()

Callers

nothing calls this directly

Calls 3

trackMethod · 0.95
reconcileMethod · 0.95
PredictMethod · 0.65

Tested by

no test coverage detected