Method encode

backend/app/models/retrieval/tokenizer/_base.py:24–25

(self, text: str)

    @abstractmethod
    def encode(self, text: str) -> List[int]:
        raise NotImplementedError

    @abstractmethod
    def decode(self, tokens: List[int]) -> str: