Method count_tokens

code/inference/evaluators/pulse.py:50–51

(self, prompt)

    @retry(wait=wait_random_exponential(min=1, max=60), stop=stop_after_attempt(6))
    def count_tokens(self, prompt):
        return len(self.tokenizer(prompt)['input_ids'])