Merge batch_size requests for one prediction.Taking one piece of data from the input channel each time until equals batch_size, or t

Generate one ThreadChannel or ProcessChannel. Args: name_gen: channel name Returns: channel: one ch

This method returns the Packaged Request. @param feed_dict HashMap<String, String>(input data). @param profile boolean(profile sign). @param logid int

Packing one RPC response Args: channeldata: one channel data to be packed Returns: resp: one RPC re

Starting the GRPC gateway in a new process. Exposing one available HTTP port outside, and reflecting the data to RPC port.

Serialize parameters using given program and executor.

serialize given program to bytes.

This static method returns the HashMap which is unpackaged from Response. @param resp Response(the grpc protobuf Response). @return HashMap<String,Str

not thread safe, and can only be called during initialization.

Adding one input channel to the Op. Each op have many front op, but, only one input channel.

not thread safe, and can only be called during initialization.

inference interface

Function get_client is only used for local predictor case, creates one LocalPredictor object, and initializes the paddle predictor by

Get output channels of jump ops Args: None Returns: list of channels

Starting from ResponseOp, recursively traverse the front OPs. Getting all used ops and the post op list of each op (excluding Respons

Initialize the client object. There are three types of clients, brpc, grpc and local_predictor. In grpc or brpc mode, the client conn