Method handle_request

beginner_source/serving_tutorial.py:155–166

Handle an incoming HTTP request using FastAPI. Inputs are automatically validated using the Pydantic model.

(self, request: ImageRequest)

    @app.post("/")
    async def handle_request(self, request: ImageRequest):
        """Handle an incoming HTTP request using FastAPI.

        Inputs are automatically validated using the Pydantic model.
        """
        # Process the single request.
        image_array = np.array(request.image)

        # Ray Serve's @serve.batch automatically batches requests.
        result = await self.predict_batch(image_array)

        return result


######################################################################