MCPcopy Create free account

hub / github.com/cambridgeltl/composable-sft / functions

Functions110 in github.com/cambridgeltl/composable-sft

↓ 9 callersMethodapply
Applies SFT to a model by adding the sparse parameter differences to the model's parameters, and setting the value of the "abs" param
src/sft/sft.py:135
↓ 9 callersMethodmap
(self, *args, **kwargs)
src/sft/multisource.py:40
↓ 6 callersMethodtrain
(self, **kwargs)
src/sft/lt_sft.py:69
↓ 5 callersFunctionLotteryTicketSparseFineTuner
(_Trainer)
src/sft/lt_sft.py:13
↓ 5 callersMethodevaluate
(self, eval_dataset=None, eval_examples=None, ignore_keys=None, metric_key_prefix: str = "eval")
examples/question-answering/trainer_qa.py:34
↓ 5 callersFunctionload_multisource_dataset
( multisource_json, training_args, **kwargs, )
src/sft/multisource.py:351
↓ 5 callersMethodsave
(self, save_dir)
src/sft/sft.py:123
↓ 5 callersMethodsft
Calculates the sparse difference vector between the current parameter values and the pre-trained values. Args:
src/sft/trainer.py:123
↓ 4 callersFunctionMultiSourcePlugin
(_Trainer)
src/sft/multisource.py:389
↓ 4 callersMethodactivate_sft
(self, source)
src/sft/multisource.py:422
↓ 4 callersFunctionload_single_dataset
( dataset_json, training_args, source=None, split=None, preprocessor=None, provide_sou
src/sft/multisource.py:194
↓ 3 callersMethodeval
(self)
src/sft/utils.py:16
↓ 3 callersMethodfilter
(self, *args, **kwargs)
src/sft/multisource.py:49
↓ 2 callersMethodadd
(self, gold, prediction)
examples/dependency-parsing/dp/utils_udp.py:181
↓ 2 callersMethodadd_param
Adds a new parameter tensor to the SFT. Args: name: the parameter name, e.g. bert.embeddings.word_embeddings.weight.
src/sft/sft.py:107
↓ 2 callersFunctionget_label_mapping
(dataset)
examples/text-classification/run_text_classification.py:295
↓ 2 callersFunctionmain
()
examples/dependency-parsing/run_dp.py:172
↓ 2 callersFunctionmain
()
examples/token-classification/run_token_classification.py:207
↓ 2 callersFunctionmain
()
examples/question-answering/run_qa.py:218
↓ 2 callersFunctionmain
()
examples/language-modeling/run_mlm.py:198
↓ 2 callersMethodpredict
(self, predict_dataset, predict_examples, ignore_keys=None, metric_key_prefix: str = "test")
examples/question-answering/trainer_qa.py:75
↓ 2 callersMethodset_training_len
(self, min_steps, max_steps, max_epochs)
src/sft/trainer.py:149
↓ 1 callersFunctionSparseFineTuner
(_Trainer)
src/sft/trainer.py:28
↓ 1 callersMethod__init__
(self, datasets: Dict[str, Dataset], upsampling={})
src/sft/multisource.py:29
↓ 1 callersMethod__init__
(self)
examples/dependency-parsing/dp/utils_udp.py:202
↓ 1 callersMethod__init__
(self, n_in, n_out=1, bias_x=True, bias_y=True)
examples/dependency-parsing/dp/modeling_biaffine.py:11
↓ 1 callersMethod_get_loss
(self, arc_preds, rel_preds, labels_arc, labels_rel, loss_fn)
examples/dependency-parsing/dp/modeling_biaffine.py:150
↓ 1 callersMethod_merge_subword_tokens
(self, subword_outputs, word_starts)
examples/dependency-parsing/dp/modeling_biaffine.py:115
↓ 1 callersFunction_upsampled_iter
(loader, upsampling_factor)
src/sft/multisource.py:144
↓ 1 callersMethodadd
Parameters ---------- predicted_indices : ``torch.Tensor``, required. A tensor of head index predictions of shape
examples/dependency-parsing/dp/utils_udp.py:207
↓ 1 callersFunctiondataset_preprocessor
(tokenizer, label2id, padding)
examples/dependency-parsing/dp/utils_udp.py:87
↓ 1 callersFunctiondecode_sparse_tensor
Inverse of encode_sparse_tensor.
src/sft/sft.py:37
↓ 1 callersMethoddisable_masking
(self)
src/sft/trainer.py:112
↓ 1 callersMethodenable_masking
(self)
src/sft/trainer.py:109
↓ 1 callersFunctionencode_sparse_tensor
Compresses a sparse tensor by flattening indices into a single dimension to reduce size of saved SFTs.
src/sft/sft.py:14
↓ 1 callersMethodevaluate
(self, *args, **kwargs)
src/sft/trainer.py:213
↓ 1 callersMethodfreeze
(self)
src/sft/trainer.py:119
↓ 1 callersMethodget_eval_dataloader
(self, eval_dataset: Optional[Dataset] = None)
src/sft/multisource.py:484
↓ 1 callersFunctionget_label_list
(labels)
examples/token-classification/run_token_classification.py:322
↓ 1 callersMethodget_metric
(self)
examples/dependency-parsing/dp/utils_udp.py:242
↓ 1 callersMethodget_test_dataloader
(self, test_dataset: Dataset)
src/sft/multisource.py:501
↓ 1 callersMethodinit_weights
(self)
examples/dependency-parsing/dp/modeling_biaffine.py:30
↓ 1 callersFunctionload_source_data
( source_json, training_args, **kwargs, )
src/sft/multisource.py:322
↓ 1 callersFunctionmain
()
examples/text-classification/run_text_classification.py:204
↓ 1 callersFunctionpostprocess_qa_predictions
Post-processes the predictions of a question-answering model to convert them to answers that are substrings of the original contexts. This is
examples/question-answering/utils_qa.py:31
↓ 1 callersMethodprediction_step
(self, model, inputs, prediction_loss_only, ignore_keys=None)
src/sft/multisource.py:448
↓ 1 callersFunctionpull_from_hf_model_hub
(specifier, version=None, cache_dir=None)
src/sft/hf_utils.py:4
↓ 1 callersMethodrevert
Removes SFT from a model by subtracting the sparse parameter differences.
src/sft/sft.py:168
↓ 1 callersMethodunfreeze_k_most_changed_params
(self, k)
src/sft/lt_sft.py:29
↓ 1 callersMethodunpack
(*tensors: torch.Tensor)
examples/dependency-parsing/dp/utils_udp.py:191
Method__call__
(self, features)
examples/dependency-parsing/dp/utils_udp.py:159
Method__getitem__
(self, index)
src/sft/multisource.py:111
Method__init__
(self, dataset, loaders, sampling_policy='random')
src/sft/multisource.py:152
Method__init__
( self, *args, train_dataset=None, eval_dataset=None,
src/sft/multisource.py:393
Method__init__
(self, name_or_path=None, version=None, cache_dir=None, )
src/sft/sft.py:70
Method__init__
(self, **kwargs)
src/sft/lt_sft.py:19
Method__init__
(self, *args, **kwargs)
src/sft/utils.py:8
Method__init__
(self, sft)
src/sft/trainer.py:21
Method__init__
( self, *args, sft_args=None, maskable_params=None,
src/sft/trainer.py:45
Method__init__
(self, **kwargs)
examples/dependency-parsing/dp/utils_udp.py:262
Method__init__
(self, config)
examples/dependency-parsing/dp/modeling_biaffine.py:51
Method__init__
BuilderConfig for Masakhaner. Args: **kwargs: keyword arguments forwarded to super.
examples/token-classification/ner_dataset.py:72
Method__init__
(self, *args, eval_examples=None, post_process_function=None, **kwargs)
examples/question-answering/trainer_qa.py:29
Method__iter__
(self)
src/sft/multisource.py:115
Method__iter__
(self)
src/sft/multisource.py:167
Method__len__
(self)
src/sft/multisource.py:122
Method__len__
(self)
src/sft/multisource.py:190
Method__post_init__
(self)
examples/token-classification/run_token_classification.py:194
Method__post_init__
(self)
examples/question-answering/run_qa.py:197
Method__post_init__
(self)
examples/language-modeling/run_mlm.py:113
Method__post_init__
(self)
examples/language-modeling/run_mlm.py:186
Method__str__
(self)
src/sft/multisource.py:125
Method_generate_examples
(self, filepath)
examples/token-classification/ner_dataset.py:147
Method_info
(self)
examples/token-classification/ner_dataset.py:99
Method_maybe_log_save_evaluate
(self, tr_loss, model, trial, epoch, ignore_keys_for_eval)
src/sft/trainer.py:221
Function_mp_fn
(index)
examples/dependency-parsing/run_dp.py:364
Function_mp_fn
(index)
examples/token-classification/run_token_classification.py:631
Function_mp_fn
(index)
examples/question-answering/run_qa.py:679
Function_mp_fn
(index)
examples/language-modeling/run_mlm.py:595
Method_split_generators
Returns SplitGenerators.
examples/token-classification/ner_dataset.py:126
Functionaugment_id_with_source
(examples, source=None)
examples/question-answering/run_qa.py:490
Methodcolumn_names
(self)
src/sft/multisource.py:68
Functioncompute_metrics
(p)
examples/token-classification/run_token_classification.py:500
Functioncompute_metrics
(p: EvalPrediction)
examples/text-classification/run_text_classification.py:423
Functioncompute_metrics
(p: EvalPrediction)
examples/question-answering/run_qa.py:586
Methodextra_repr
(self)
examples/dependency-parsing/dp/modeling_biaffine.py:21
Methodfeatures
(self)
src/sft/multisource.py:81
Methodforward
(self, x, y)
examples/dependency-parsing/dp/modeling_biaffine.py:33
Methodforward
( self, input_ids=None, attention_mask=None, token_type_ids=None, labe
examples/dependency-parsing/dp/modeling_biaffine.py:61
Methodget_metric
(self)
examples/dependency-parsing/dp/utils_udp.py:184
Methodget_train_dataloader
(self)
src/sft/multisource.py:465
Functiongroup_texts
(examples)
examples/language-modeling/run_mlm.py:434
Methodon_step_begin
(self, args, state, control, **kwargs)
src/sft/trainer.py:24
Functionpost_processing_function
(examples, features, predictions, stage="eval")
examples/question-answering/run_qa.py:559
Functionpostprocess_qa_predictions_with_beam_search
Post-processes the predictions of a question-answering model with beam search to convert them to answers that are substrings of the original
examples/question-answering/utils_qa.py:250
Methodprediction_loop
Prediction/evaluation loop, shared by `evaluate()` and `predict()`. Works both with or without labels.
examples/dependency-parsing/dp/utils_udp.py:265
Functionprepare_train_features
(examples)
examples/question-answering/run_qa.py:373
Functionprepare_validation_features
(examples, source=None)
examples/question-answering/run_qa.py:446
Functionpreprocess
(examples)
examples/dependency-parsing/dp/utils_udp.py:89
Functionpreprocess_function
(examples)
examples/text-classification/run_text_classification.py:379
next →1–100 of 110, ranked by callers