MCPcopy Create free account
hub / github.com/BerriAI/litellm / async_batch_get_cache

Method async_batch_get_cache

litellm/caching/in_memory_cache.py:262–267  ·  view source on GitHub ↗
(self, keys: list, **kwargs)

Source from the content-addressed store, hash-verified

260 return self.get_cache(key=key, **kwargs)
261
262 async def async_batch_get_cache(self, keys: list, **kwargs):
263 return_val: Final = []
264 for k in keys:
265 val = self.get_cache(key=k, **kwargs)
266 return_val.append(val)
267 return return_val
268
269 async def async_increment(self, key, value: float, **kwargs) -> float:
270 return self.increment_cache(key=key, value=value, **kwargs)

Callers

nothing calls this directly

Calls 2

get_cacheMethod · 0.95
appendMethod · 0.45

Tested by

no test coverage detected