MCPcopy Index your code
hub / github.com/mudler/LocalAI / PredictStream

Method PredictStream

core/services/nodes/inflight.go:113–116  ·  view source on GitHub ↗
(ctx context.Context, in *pb.PredictOptions, f func(reply *pb.Reply), opts ...ggrpc.CallOption)

Source from the content-addressed store, hash-verified

111}
112
113func (c *InFlightTrackingClient) PredictStream(ctx context.Context, in *pb.PredictOptions, f func(reply *pb.Reply), opts ...ggrpc.CallOption) error {
114 defer c.track(ctx)()
115 return c.reconcile(c.inner.PredictStream(ctx, in, f, opts...))
116}
117
118func (c *InFlightTrackingClient) Embeddings(ctx context.Context, in *pb.PredictOptions, opts ...ggrpc.CallOption) (*pb.EmbeddingResult, error) {
119 defer c.track(ctx)()

Callers

nothing calls this directly

Calls 3

trackMethod · 0.95
reconcileMethod · 0.95
PredictStreamMethod · 0.65

Tested by

no test coverage detected