MCPcopy Create free account

hub / github.com/bigcode-project/starcoder / functions

Functions31 in github.com/bigcode-project/starcoder

⨍ Functions 31◇ Types & classes 8
↓ 2 callersMethodcopy
(self)
chat/dialogues.py:83
↓ 2 callersFunctionget_dialogue_template
(template: str)
chat/dialogues.py:199
↓ 2 callersMethodget_inference_prompt
(self)
chat/dialogues.py:56
↓ 2 callersFunctionprepare_sample_text
Prepare the text from a sample of the dataset.
finetune/finetune.py:124
↓ 1 callersFunctionchars_token_ratio
Estimate the average number of characters per token in the dataset.
finetune/finetune.py:93
↓ 1 callersFunctioncreate_datasets
(tokenizer, args)
finetune/finetune.py:194
↓ 1 callersMethodfrom_dict
(cls, data)
chat/dialogues.py:97
↓ 1 callersFunctionget_args
()
finetune/finetune.py:51
↓ 1 callersFunctionget_args
()
finetune/merge_peft_adapters.py:8
↓ 1 callersMethodget_special_tokens
(self)
chat/dialogues.py:80
↓ 1 callersMethodget_training_prompt
(self)
chat/dialogues.py:45
↓ 1 callersFunctionhf_login
Login to HuggingFace Hub if HF_TOKEN is defined in the environment
chat/utils.py:61
↓ 1 callersFunctionmain
()
chat/train.py:44
↓ 1 callersFunctionmain
()
chat/generate.py:25
↓ 1 callersFunctionmain
(args)
finetune/finetune.py:300
↓ 1 callersFunctionmain
()
finetune/merge_peft_adapters.py:16
↓ 1 callersFunctionmask_user_labels
Masks the user turns of a dialogue from the loss
chat/dialogues.py:232
↓ 1 callersMethodparse_yaml_and_args
(self, yaml_arg: str, other_args: Optional[List[str]] = None)
chat/utils.py:26
↓ 1 callersFunctionprint_trainable_parameters
Prints the number of trainable parameters in the model.
finetune/finetune.py:109
↓ 1 callersFunctionrun_training
(args, train_data, val_data)
finetune/finetune.py:237
↓ 1 callersMethodto_dict
(self)
chat/dialogues.py:93
Method__init__
( self, tokenizer, dataset, infinite=False, seq_length=1024, n
finetune/finetune.py:142
Method__iter__
(self)
finetune/finetune.py:163
Method_from_pretrained
Loads the dialogue template from a local directory or the Huggingface Hub. Args: model_id (`str`): ID of the mode
chat/dialogues.py:114
Method_save_pretrained
(self, save_directory: Union[str, Path])
chat/dialogues.py:107
Methodget_dialogue
Helper function to format the messages as an easy-to-read dialogue.
chat/dialogues.py:68
Functiongroup_texts
(examples)
chat/train.py:190
Methodon_save
( self, args: TrainingArguments, state: TrainerState, control: TrainerControl,
finetune/finetune.py:19
Methodon_train_end
( self, args: TrainingArguments, state: TrainerState, control: TrainerControl,
finetune/finetune.py:36
Functionprepare_dialogue
Format example to single- or multi-turn dialogue.
chat/dialogues.py:205
Functiontokenize_function
(examples)
chat/train.py:148