Dense full-sequence batch for stateless scoring.
| 51 | |
| 52 | @dataclass(frozen=True) |
| 53 | class StatelessForwardInputs: |
| 54 | """Dense full-sequence batch for stateless scoring.""" |
| 55 | |
| 56 | input_ids: torch.Tensor |
| 57 | attention_mask: torch.Tensor |
| 58 | completion_mask: torch.Tensor |
| 59 | labels: Optional[torch.Tensor] = None |
| 60 | |
| 61 | |
| 62 | @dataclass(frozen=True) |
no outgoing calls