Result of searching the cache trie.
| 31 | |
| 32 | @dataclass |
| 33 | class SearchResult: |
| 34 | """Result of searching the cache trie.""" |
| 35 | model: Any |
| 36 | exact: Optional[List[int]] |
| 37 | shorter: Optional[List[int]] |
| 38 | longer: Optional[List[int]] |
| 39 | common_prefix: int |
| 40 | |
| 41 | |
| 42 | class ThreadSafeLRUPromptCache: |