MCPcopy Create free account
hub / github.com/MegEngine/MegEngine / __init__

Method __init__

imperative/python/megengine/data/dataloader.py:249–271  ·  view source on GitHub ↗
(self, loader, preload)

Source from the content-addressed store, hash-verified

247
248class PreLoader:
249 def __init__(self, loader, preload):
250 self.dataset = loader.dataset
251 self.sampler = loader.sampler
252 self.seed = _random_seed_generator().__next__()
253 self.transform = loader.transform
254 self.collator = loader.collator
255 self.num_workers = loader.num_workers
256 self.timeout = loader.timeout
257 self.num_processed = 0
258 self.datakind = loader.datakind
259 self.parallel_stream = loader.parallel_stream
260
261 if preload:
262 self.default_device = get_default_device()
263 self.pre_load_device = self.default_device + ":" + str(_sh.get_next())
264 self.pre_load_device_cache = None
265 self.preload = preload
266
267 if data_monitor:
268 global monitor_num_workers, monitor_workers, put_time
269 monitor_num_workers.value = self.num_workers
270 monitor_workers = Array("i", [0] * monitor_num_workers.value)
271 put_time = Array("d", [0.0] * monitor_num_workers.value)
272
273 def __iter__(self):
274 return self

Callers 6

__init__Method · 0.45
__init__Method · 0.45
__init__Method · 0.45
__init__Method · 0.45
__init__Method · 0.45
__init__Method · 0.45

Calls 6

_random_seed_generatorFunction · 0.85
strFunction · 0.85
ArrayClass · 0.85
get_nextMethod · 0.80
get_default_deviceFunction · 0.50
__next__Method · 0.45

Tested by

no test coverage detected