MCPcopy
hub / github.com/mudler/LocalAI / Forward

Method Forward

pkg/grpc/interface.go:57–57  ·  view source on GitHub ↗

Forward proxies a raw HTTP request to an upstream provider for passthrough-mode cloud-proxy backends. ctx is the gRPC stream context — cancellation propagates to the upstream HTTP request so client disconnect closes the upstream connection.

(ctx context.Context, in <-chan *pb.ForwardRequest, out chan<- *pb.ForwardReply)

Source from the content-addressed store, hash-verified

55 // context — cancellation propagates to the upstream HTTP request
56 // so client disconnect closes the upstream connection.
57 Forward(ctx context.Context, in <-chan *pb.ForwardRequest, out chan<- *pb.ForwardReply) error
58
59 ModelMetadata(*pb.ModelOptions) (*pb.ModelMetadataResponse, error)
60

Callers 9

ForwardViaBackendFunction · 0.65
ForwardMethod · 0.65
ForwardMethod · 0.65
forward_test.goFile · 0.65
ForwardMethod · 0.65

Implementers 1

Basepkg/grpc/base/base.go

Calls

no outgoing calls

Tested by 3