Add speaker and start/end signal on each round.

Add speaker and start/end signal on each round.

Performs invalid character removal and whitespace cleanup on text.

compute the accuracy (soft score) of human answers

Converts a BLOOM Causal LM to a Prefix LM. Supported HuggingFace model classes: - `BloomForCausalLM` See `convert_hf_causal_lm_to_pr

Converts a GPT-style Causal LM to a Prefix LM. Supported HuggingFace model classes: - `GPT2LMHeadModel` - `GPTNeoForCausalLM`

Converts an OPT Causal LM to a Prefix LM. Supported HuggingFace model classes: - `OPTForCausalLM` See `convert_hf_causal_lm_to_prefi

Wrap LlamaAttention modules with newly created AdaptedAttention modules.

Returns the base model class.

Checks whether CP is the codepoint of a CJK character.

Checks whether `chars` is a control character.

Checks whether `chars` is a punctuation character.

Helper function to match module names target_key and key. Makes sure that either the key is exactly the target_key or the target_key

Checks whether `chars` is a whitespace character.

Make causal mask used for bi-directional self-attention.

Make causal mask used for bi-directional self-attention.

Freeze all parameters of the model except the adaption prompts.