Method set_processor

optillm/batching.py:221–228

Set the batch processing function Args: processor_func: Function that takes list of request data and returns list of responses

(self, processor_func)

                req.future.set_exception(BatchingError(error_msg))
    
    def set_processor(self, processor_func):
        """
        Set the batch processing function
        
        Args:
            processor_func: Function that takes list of request data and returns list of responses
        """
        self._processor_func = processor_func
    
    def add_request(self, request_data: Dict[str, Any]) -> Dict[str, Any]:
        """