MCPcopy
hub / github.com/ModelTC/LightLLM / generate_id

Method generate_id

lightllm/server/req_id_generator.py:59–64  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

57 time.sleep(3)
58
59 def generate_id(self):
60 with self.lock:
61 self._check_and_set_new_id_range()
62 id = self.current_id.arr[0]
63 self.current_id.arr[0] += MAX_BEST_OF
64 return id
65
66
67def convert_sub_id_to_group_id(sub_req_id):

Callers 3

health_checkFunction · 0.80
generateMethod · 0.80
alloc_req_idMethod · 0.80

Calls 1

Tested by

no test coverage detected