Encode prompt to tokens. Not necessary for most cases. Args: prompt (str): Input string. Returns: torch.Tensor: Encoded tokens.
(self, prompt: str)
| 109 | |
| 110 | @abstractmethod |
| 111 | def encode(self, prompt: str) -> torch.Tensor: |
| 112 | """Encode prompt to tokens. Not necessary for most cases. |
| 113 | |
| 114 | Args: |
| 115 | prompt (str): Input string. |
| 116 | |
| 117 | Returns: |
| 118 | torch.Tensor: Encoded tokens. |
| 119 | """ |
| 120 | raise NotImplementedError( |
| 121 | f'{self.__class__.__name__} does not implement' |
| 122 | '`encode` method.') |
| 123 | |
| 124 | @abstractmethod |
| 125 | def decode(self, tokens: torch.Tensor) -> str: |
no outgoing calls
no test coverage detected