Function
get_token_usage
(chunk: BaseMessageChunk, token_usage: dict = None)
Source from the content-addressed store, hash-verified
| 1751 | |
| 1752 | |
| 1753 | def get_token_usage(chunk: BaseMessageChunk, token_usage: dict = None): |
| 1754 | try: |
| 1755 | if chunk.usage_metadata: |
| 1756 | if token_usage is None: |
| 1757 | token_usage = {} |
| 1758 | token_usage['input_tokens'] = chunk.usage_metadata.get('input_tokens') |
| 1759 | token_usage['output_tokens'] = chunk.usage_metadata.get('output_tokens') |
| 1760 | token_usage['total_tokens'] = chunk.usage_metadata.get('total_tokens') |
| 1761 | except Exception: |
| 1762 | pass |
| 1763 | |
| 1764 | |
| 1765 | def process_stream(res: Iterator[BaseMessageChunk], |
Tested by
no test coverage detected