MCPcopy
hub / github.com/InternLM/lmdeploy / tick

Method tick

lmdeploy/profiler.py:22–24  ·  view source on GitHub ↗
(self, n_token)

Source from the content-addressed store, hash-verified

20 self.status = Session.UNKNOWN
21
22 def tick(self, n_token):
23 self.ts.append(time.perf_counter())
24 self.ns.append(n_token)
25
26 def finish(self, status):
27 self.status = status

Callers 3

_inferenceMethod · 0.45
process_requestMethod · 0.45
process_requestMethod · 0.45

Calls 1

appendMethod · 0.45

Tested by

no test coverage detected