A class that manages prompt templates and keeps all conversation history.

This should contains everything needed to continue the conversation. For example, the history of the conversation, the current task (success/fail

Dataset for supervised fine-tuning.

Gym environment for Text mode of WebShop environment

Compressed Linear Layer.

r""" Initialize DPOTrainer. Args: model (`transformers.PreTrainedModel`): The model to train, preferably an `AutoModelFor

Fake file-like stream object that redirects writes to a logger instance.

Group-wise quantization.

Collate examples for supervised fine-tuning.

The PPOTrainer uses Proximal Policy Optimization to optimise language models. Note, this trainer is heavily inspired by the original OpenAI l

r""" Reward DataCollator class that pads the inputs to the maximum length of the batch. Args: tokenizer (`PreTrainedTokenizerBase`):

r""" The RewardTrainer can be used to train your custom Reward Model. It is a subclass of the `transformers.Trainer` class and inherits all of

Separator styles.

Simulated browser for rendering the HTML source of WebShop environment pages

Lightweight simulator of WebShop Flask application for generating HTML observations

Dataset for supervised fine-tuning.

Gym environment for HTML mode of WebShop environment

The model adapter for jondurbin/airoboros-*

Alfworld task instance.

The model adapter for Alpaca

The model adapter for BAAI/Aquila Now supports: - BAAI/AquilaChat-7B - BAAI/AquilaChat2-7B - BAAI/AquilaChat2-34B

The model adapter for Azure OpenAI

The model adapter for BGE (e.g., BAAI/bge-large-en-v1.5)

The model adapter for Baichuan models (e.g., baichuan-inc/Baichuan-7B)

The model adapter for project-baize/baize-v2-7b

The model adapter for Bard

The base and the default model adapter.

The model adapter for Neutralzz/BiLLa-7B-SFT

The model adapter for camel-ai/CAMEL-13B-Combined-Data

The model adapter for lcw99/polyglot-ko-12.8b-chang-instruct-chat

The model adapter for THUDM/chatglm-6b, THUDM/chatglm2-6b

The model adapter for ChatGPT

The model adapter for Claude

The model adapter for THUDM/codegeex-6b, THUDM/codegeex2-6b

The model adapter for CodeLlama (e.g., codellama/CodeLlama-34b-hf)