Forward proxies a raw HTTP request to an upstream provider for passthrough-mode cloud-proxy backends. ctx is the gRPC stream context — cancellation propagates to the upstream HTTP request so client disconnect closes the upstream connection.
(ctx context.Context, in <-chan *pb.ForwardRequest, out chan<- *pb.ForwardReply)
| 55 | // context — cancellation propagates to the upstream HTTP request |
| 56 | // so client disconnect closes the upstream connection. |
| 57 | Forward(ctx context.Context, in <-chan *pb.ForwardRequest, out chan<- *pb.ForwardReply) error |
| 58 | |
| 59 | ModelMetadata(*pb.ModelOptions) (*pb.ModelMetadataResponse, error) |
| 60 |
no outgoing calls