MCPcopy Create free account
hub / github.com/NVIDIA/OpenShell / _current_cluster_inference

Function _current_cluster_inference

e2e/python/test_inference_routing.py:108–116  ·  view source on GitHub ↗
(
    inference_client: InferenceRouteClient,
)

Source from the content-addressed store, hash-verified

106
107
108def _current_cluster_inference(
109 inference_client: InferenceRouteClient,
110) -> ClusterInferenceConfig | None:
111 try:
112 return inference_client.get_cluster()
113 except grpc.RpcError as exc:
114 if exc.code() == grpc.StatusCode.NOT_FOUND:
115 return None
116 raise
117
118
119def _restore_cluster_inference(

Callers 1

managed_openai_routeFunction · 0.85

Calls 2

get_clusterMethod · 0.80
codeMethod · 0.80

Tested by

no test coverage detected