A class that keeps all conversation history.

Fake file-like stream object that redirects writes to a logger instance.

Collate examples for supervised fine-tuning.

AutoTokenizer + Adaptation for MOD. A simple wrapper around AutoTokenizer to make instantiating an MOD-adapted tokenizer a bit easier. M

Displays a chatbot output showing both user submitted messages and responses. Supports a subset of Markdown including bold, italics, code, and im

Dataset for supervised fine-tuning.

Multi-Query self attention. Using torch or triton attention implemetation enables user to also use additive bias.

Multi-head self attention. Using torch or triton attention implemetation enables user to also use additive bias.

Different separator style.

Dataset for supervised fine-tuning.