MCPcopy
hub / github.com/ray-project/ray / enqueue_request

Function enqueue_request

python/ray/serve/batching.py:949–967  ·  view source on GitHub ↗
(args, kwargs)

Source from the content-addressed store, hash-verified

947 break
948
949 def enqueue_request(args, kwargs) -> asyncio.Future:
950 flattened_args: List = flatten_args(extract_signature(_func), args, kwargs)
951
952 # If the function is a method, remove self as an argument.
953 self = extract_self_if_method_call(args, _func)
954 if self is not None:
955 flattened_args = flattened_args[2:]
956
957 batch_queue = lazy_batch_queue_wrapper.queue
958
959 future = get_or_create_event_loop().create_future()
960 request_context = serve.context._get_serve_request_context()
961 trace_context = get_trace_context()
962 batch_queue.put(
963 _SingleRequest(
964 self, flattened_args, future, request_context, trace_context
965 )
966 )
967 return future
968
969 @wraps(_func)
970 def generator_batch_wrapper(*args, **kwargs):

Callers 2

generator_batch_wrapperFunction · 0.85
batch_wrapperFunction · 0.85

Calls 7

flatten_argsFunction · 0.90
extract_signatureFunction · 0.90
get_or_create_event_loopFunction · 0.90
get_trace_contextFunction · 0.90
_SingleRequestClass · 0.85
putMethod · 0.65

Tested by

no test coverage detected

Used in the wild real call sites across dependent graphs

searching dependent graphs…