Method get_prompt_length

src/model.py:167–168 · view source on GitHub ↗

(self, prompt)

Source from the content-addressed store, hash-verified

165	self.tokenizer = self.model.get_tokenizer()
166
167	def get_prompt_length(self, prompt):
168	return len(self.tokenizer(prompt).input_ids)
169
170
171	def format_chats(self, dialogs, pad = False):

batch_infer_local_chat_modelFunction · 0.95

batch_infer_local_prompt_modelFunction · 0.95

get_all_promptsMethod · 0.80

no outgoing calls

no test coverage detected