MCPcopy Create free account
hub / github.com/OpenImagingLab/FlashVSR / offload

Method offload

diffsynth/vram_management/layers.py:23–26  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

21 self.state = 0
22
23 def offload(self):
24 if self.state == 1 and (self.offload_dtype != self.onload_dtype or self.offload_device != self.onload_device):
25 self.module.to(dtype=self.offload_dtype, device=self.offload_device)
26 self.state = 0
27
28 def onload(self):
29 if self.state == 0 and (self.offload_dtype != self.onload_dtype or self.offload_device != self.onload_device):

Callers 1

load_models_to_deviceMethod · 0.45

Calls 1

toMethod · 0.45

Tested by

no test coverage detected