MCPcopy Create free account
hub / github.com/InternScience/SciReason / get_token

Method get_token

opencompass/models/base_api.py:448–462  ·  view source on GitHub ↗

Get a token from the bucket.

(self)

Source from the content-addressed store, hash-verified

446 sleep(1 / self._rate)
447
448 def get_token(self):
449 """Get a token from the bucket."""
450 if not self.started:
451 self.started = True
452 threading.Thread(target=self._add_tokens, daemon=True).start()
453 self._tokens.acquire()
454 if self.verbose:
455 cur_time = time.time()
456 while not self._request_queue.empty():
457 if cur_time - self._request_queue.queue[0] > 60:
458 self._request_queue.get()
459 else:
460 break
461 self._request_queue.put(cur_time)
462 self.logger.info(f'Current RPM {self._request_queue.qsize()}.')

Callers 4

waitMethod · 0.80
waitMethod · 0.80
waitMethod · 0.80
waitMethod · 0.80

Calls 2

acquireMethod · 0.80
getMethod · 0.80

Tested by

no test coverage detected