inps: a torch tensor of shape [batch, sequence] the size of sequence may vary from call to call returns: a torch tensor of shape [batch, sequence, vocab] with the logits returned from the model
(self, inps)
| 164 | |
| 165 | @abstractmethod |
| 166 | def _model_call(self, inps): |
| 167 | """ |
| 168 | inps: a torch tensor of shape [batch, sequence] |
| 169 | the size of sequence may vary from call to call |
| 170 | |
| 171 | returns: a torch tensor of shape [batch, sequence, vocab] with the |
| 172 | logits returned from the model |
| 173 | """ |
| 174 | pass |
| 175 | |
| 176 | def _detect_batch_size(self, requests=None, pos=0): |
| 177 | if requests: |
no outgoing calls
no test coverage detected