MCPcopy Create free account
hub / github.com/ScalingIntelligence/tokasaurus / remove

Method remove

tokasaurus/manager/types.py:207–215  ·  view source on GitHub ↗
(self, sid: str)

Source from the content-addressed store, hash-verified

205 self.queued_seqs.pop(sid)
206
207 def remove(self, sid: str):
208 if self.in_decoding(sid):
209 self.remove_decoding(sid)
210 elif self.in_prefilling(sid):
211 self.remove_prefilling(sid)
212 elif self.in_queued(sid):
213 self.remove_queued(sid)
214 else:
215 raise ValueError(f"Sequence {sid} not found")
216
217 def in_decoding(self, sid: str) -> bool:
218 return sid in self.decoding_seqs

Callers 7

setup_loggingFunction · 0.80
get_next_leafFunction · 0.80
update_prefix_treeMethod · 0.80
assign_block_to_seqMethod · 0.80
free_and_updateMethod · 0.80
try_cancelling_requestsFunction · 0.80

Calls 6

in_decodingMethod · 0.95
remove_decodingMethod · 0.95
in_prefillingMethod · 0.95
remove_prefillingMethod · 0.95
in_queuedMethod · 0.95
remove_queuedMethod · 0.95

Tested by

no test coverage detected