MCPcopy Create free account
hub / github.com/OpenBitSys/BitDistiller / _time_module

Function _time_module

inference/utils/tune.py:16–28  ·  view source on GitHub ↗
(module, inputs, measure_iters=1000)

Source from the content-addressed store, hash-verified

14
15
16def _time_module(module, inputs, measure_iters=1000):
17 time_lis = []
18 # Warmup
19 for i in range(measure_iters):
20 module(inputs)
21 for i in range(measure_iters):
22 torch.cuda.synchronize()
23 st = time.time()
24 module(inputs)
25 torch.cuda.synchronize()
26 ed = time.time()
27 time_lis.append((ed - st))
28 return np.median(time_lis)
29
30
31def tune_wqlinear(module: WQLinear, measure_iters: int = 1000):

Callers 1

tune_wqlinearFunction · 0.85

Calls

no outgoing calls

Tested by

no test coverage detected