r"""Add the user input to chatbot. Inputs: infer.chatbot, infer.messages, infer.role, infer.query, infer.escape_html Output: infer.ch

r"""Register a chat template. To add the following chat template: ``` <s><user>user prompt here <model>model response here</s> <u

r"""Get plugin for multimodal inputs.

r"""Optionally check the package version.

r"""Get element by id. Example: top.lang, train.dataset

r"""Validate if this model accepts the input modalities.

r"""Forms a list of slots according to the inputs to encode.

r"""Get chat template and fixes the tokenizer.

r"""Load pretrained tokenizer and optionally loads processor. Note: including inplace operation of model_args.

r"""Register a new composite model. Args: model_type: model type projector_key: multi_modal_projector vision_model_keys:

r"""Check if the environment variable is enabled.

r"""Validate if the number of images, videos and audios match the number of placeholders in messages.

r"""Get the path to saved model checkpoints.

r"""Load pretrained model.

r"""Pre-process input messages before tokenization for VLMs.

r"""Return a single pair of token ids representing prompt and response respectively.

r"""Get the train dataset and optionally gets the evaluation dataset.

r"""Pre-process token ids after tokenization for VLMs.

r"""Regularize images to avoid error. Including reading and pre-processing.

r"""Optionally concatenate media path to media dir when loading from local disk.

r"""Add elements to manager.

r"""Convert slots to jinja template.

获取文本的token数量

r"""Check template. Args: model_id: the model id on hugging face hub. template_name: the template name. prompt_str: the s

r"""Regularizes videos to avoid error. Including reading, resizing and converting.

r"""Get the number of available devices.

获取文本的token数量

r"""Load user config if exists.

r"""Save model checkpoint. Subclass and override to inject custom behavior.

r"""Collect the device memory.

r"""Get the current available device.

r"""Return stop token ids.

r"""Compute the real sequence length after truncation by the cutoff_len.

r"""Cast a torch tensor or a numpy array to a numpy array.

r"""Plot loss curves and saves the image.

Accept '20' or '0.2' → 0.2

r"""Check token ids and texts. encode(text) == token_ids decode(token_ids) == text

r"""Regularizes audios to avoid error. Including reading and resampling.

Expand around anchor to include a minimal mathy expression. Stops at sentence separators and at **top-level commas** between tokens.

r"""Build batched multimodal inputs for VLMs. Arguments: images: a list of image inputs, shape (num_images,) videos: