Normalized model outputs consumed by scoring adapters.
| 61 | |
| 62 | @dataclass(frozen=True) |
| 63 | class StatelessForwardOutputs: |
| 64 | """Normalized model outputs consumed by scoring adapters.""" |
| 65 | |
| 66 | raw: Any |
| 67 | logits: Optional[torch.Tensor] |
| 68 | kv_cache: Optional[Any] = None |
| 69 | |
| 70 | |
| 71 | @dataclass(frozen=True) |
no outgoing calls