Types & classes — github.com/bigcode-project/starcoder

CodeHub MCPcopy Create free account

hub / github.com/bigcode-project/starcoder / types & classes

Types & classes8 in github.com/bigcode-project/starcoder

⨍ Functions 31 ◇ Types & classes 8

↓ 5 callersClassDialogueTemplate

Converts all turns of a dialogue between a user and assistant to a standardized format. Adapted from OpenAI's ChatML (https://github.com/openai/o

chat/dialogues.py:32

↓ 2 callersClassConstantLengthDataset

Iterable dataset that returns constant length chunks of tokens from stream of text files. Args: tokenizer (Tokenizer): The pr

finetune/finetune.py:130

↓ 1 callersClassStarChatArgumentParser

chat/utils.py:25

↓ 1 callersClassTrainingArguments

Arguments related to the training process itself. For all parameters, see: https://huggingface.co/docs/transformers/v4.26.1/en/main_classes/train

chat/config.py:112

ClassDataArguments

Arguments pertaining to what data we are going to input our model for training and eval.

chat/config.py:60

ClassLoadBestPeftModelCallback

finetune/finetune.py:35

ClassModelArguments

Arguments pertaining to which model/config/tokenizer we are going to fine-tune, or train from scratch.

chat/config.py:26

ClassSavePeftModelCallback

finetune/finetune.py:18