MCPcopy
hub / github.com/mudler/LocalAI / GetGPUAggregateInfo

Function GetGPUAggregateInfo

pkg/xsysinfo/gpu.go:346–363  ·  view source on GitHub ↗

GetGPUAggregateInfo returns aggregate GPU information across all GPUs

()

Source from the content-addressed store, hash-verified

344
345// GetGPUAggregateInfo returns aggregate GPU information across all GPUs
346func GetGPUAggregateInfo() GPUAggregateInfo {
347 gpus := GetGPUMemoryUsage()
348
349 var aggregate GPUAggregateInfo
350 aggregate.GPUCount = len(gpus)
351
352 for _, gpu := range gpus {
353 aggregate.TotalVRAM += gpu.TotalVRAM
354 aggregate.UsedVRAM += gpu.UsedVRAM
355 aggregate.FreeVRAM += gpu.FreeVRAM
356 }
357
358 if aggregate.TotalVRAM > 0 {
359 aggregate.UsagePercent = float64(aggregate.UsedVRAM) / float64(aggregate.TotalVRAM) * 100
360 }
361
362 return aggregate
363}
364
365var (
366 computeCapOnce sync.Once

Callers 3

heartbeatBodyMethod · 0.92
heartbeatBodyMethod · 0.92
GetResourceInfoFunction · 0.85

Calls 1

GetGPUMemoryUsageFunction · 0.85

Tested by

no test coverage detected