MCPcopy Create free account
hub / github.com/NVIDIA/OpenShell / fetch_inference_bundle

Function fetch_inference_bundle

crates/openshell-core/src/grpc_client.rs:842–853  ·  view source on GitHub ↗

Fetch the resolved inference route bundle from the server.

(endpoint: &str)

Source from the content-addressed store, hash-verified

840
841/// Fetch the resolved inference route bundle from the server.
842pub async fn fetch_inference_bundle(endpoint: &str) -> Result<GetInferenceBundleResponse> {
843 debug!(endpoint = %endpoint, "Fetching inference route bundle");
844
845 let mut client = connect_inference(endpoint).await?;
846
847 let response = client
848 .get_inference_bundle(GetInferenceBundleRequest {})
849 .await
850 .into_diagnostic()?;
851
852 Ok(response.into_inner())
853}

Callers 2

build_inference_contextFunction · 0.85
spawn_route_refreshFunction · 0.85

Calls 2

connect_inferenceFunction · 0.85
get_inference_bundleMethod · 0.80

Tested by

no test coverage detected