组建reference的 input
(doc, doc_idx, tokenizer)
| 93 | self.condition.notify() |
| 94 | |
| 95 | def compose_input(doc, doc_idx, tokenizer): |
| 96 | """组建reference的 input""" |
| 97 | new_doc = "<|im_start|>" + f"[{doc_idx}]. {doc}[{doc_idx}]<|im_end|>" |
| 98 | return new_doc,tokenizer(new_doc, add_special_tokens=False) |
| 99 | |
| 100 | |
| 101 | class TimePoint: |
no outgoing calls
no test coverage detected