Functions — github.com/debjitpaul/refiner

hub / github.com/debjitpaul/refiner / functions

Functions152 in github.com/debjitpaul/refiner

⨍ Functions 152◇ Types & classes 10 ↳ Endpoints 6

↓ 15 callersFunctioncalculate_bleu_from_lists

(gold_texts, predicted_texts)

src/eval/conala_eval.py:171

↓ 13 callersFunctionload_and_cache_examples

(data_file, local_rank, max_seq_length, tokenizer, evaluate=False, input_label="Bo

src/data_processing/processor.py:10

↓ 11 callersFunction_enabled

(phrase_config, attr)

data_preprocessing/utils.py:204

↓ 11 callersFunctionget_encoded_code_tokens

(code)

src/data_processing/utils.py:15

↓ 6 callersFunctionget_phrases

(text, phrase_type="vp", phrase_config=None)

data_preprocessing/utils.py:357

↓ 6 callersFunctionread_labels

(dataset_file, tag='Linear_Formula')

src/data_processing/utils.py:7

↓ 6 callersFunctiontokenize_for_bleu_eval

(code)

src/eval/conala_eval.py:94

↓ 5 callersMethod_tokenids2tokens

(self, token_ids)

src/test_lm.py:695

↓ 4 callersMethod_critique_function

------------------------ Parameter: generated explantion: gold explanation: ------------------------

data_preprocessing/create_negative_examples_mwp.py:161

↓ 4 callersMethodgen_hint

(self, equation, difference_position, regret)

src/exp_t5_lm.py:622

↓ 4 callersMethodgen_hint

(self, equation, difference_position, regret, types)

src/test_lm.py:539

↓ 4 callersMethodgen_hint

(self, equation, difference_position, regret)

src/refiner.py:544

↓ 4 callersMethodget_math_pb

get math problem Args: index (int): index Returns: str: selected math problem

docs/services/data_service.py:75

↓ 4 callersMethodget_new_instances

(self, pair, perturbed_label, feedbacks)

data_preprocessing/create_negative_examples_mwp.py:61

↓ 4 callersFunctionget_noun_phrases_from_token

(token, phrase_config=None)

data_preprocessing/utils.py:207

↓ 4 callersFunctionread_jsonl

(filepath)

data_preprocessing/utils.py:57

↓ 3 callersMethod_critique_function

------------------------ Parameter: generated explantion: gold explanation: ------------------------

src/test_lm.py:457

↓ 3 callersMethod_predict

(self, eval_dataset, model, per_gpu_eval_batch_size,

src/exp_t5_lm.py:635

↓ 3 callersMethod_predict

(self, eval_dataset, model, per_gpu_eval_batch_size,

src/test_lm.py:588

↓ 3 callersMethod_predict

(self, eval_dataset, model, per_gpu_eval_batch_size,

src/refiner.py:592

↓ 3 callersFunctionget_datasets

(difficulty="easy")

data_preprocessing/prepare_snlr_datasets.py:9

↓ 3 callersFunctionget_prep_phrases_from_token

(token, phrase_config=None)

data_preprocessing/utils.py:256

↓ 3 callersMethodget_sample

(self, input_ids, attention_mask, labels,

src/test_lm.py:741

↓ 3 callersFunctionwrite_json

(obj, filepath, indent=2)

data_preprocessing/utils.py:53

↓ 2 callersMethod_critique_function

------------------------ Parameter: generated explantion: gold explanation: ------------------------

src/exp_t5_lm.py:551

↓ 2 callersMethod_critique_function

------------------------ Parameter: generated explantion: gold explanation: ------------------------

src/refiner.py:474

↓ 2 callersFunction_get_ngrams

Extracts all n-grams upto a given maximum order from an input segment. Args: segment: text segment from which n-grams will be extracted. max

src/eval/bleu_score.py:27

↓ 2 callersMethod_predict

(self, eval_dataset, model, per_gpu_eval_batch_size,

src/finetune.py:268

↓ 2 callersFunction_replace_word

(words, word_pair)

data_preprocessing/preprocess_moral_stories_for_critic.py:14

↓ 2 callersFunction_split_by_prefix

(text)

data_preprocessing/preprocess_moral_stories_for_critic.py:23

↓ 2 callersMethod_tokenids2tokens

(self, token_ids)

src/exp_t5_lm.py:680

↓ 2 callersMethod_tokenids2tokens

(self, token_ids)

src/refiner.py:637

↓ 2 callersMethodbatch_move_zeros

(self, attention_mask)

src/test_lm.py:703

↓ 2 callersMethodclean_sentence

clean syntaxe of math problem

docs/services/data_service.py:176

↓ 2 callersMethodforward_actor_model

perform actor model forward for: 1) first turn actor model: body + question -> answer 2) second turn actor model: body + quest

docs/services/model_service.py:32

↓ 2 callersFunctiongen_hint

(equation, difference_position, regret)

docs/services/data_service.py:323

↓ 2 callersMethodgen_hint

(self, equation, difference_position)

data_preprocessing/create_negative_examples_mwp.py:209

↓ 2 callersFunctionget_sents

(text, by_sentence=None, use_cache=True)

data_preprocessing/utils.py:74

↓ 2 callersFunctionget_words

(text: str, ignore_stopwords: bool = False, ignore_entities: bool = False, placeholders=None)

data_preprocessing/utils.py:91

↓ 2 callersMethodmove_zeros

(self, attention_mask)

src/exp_t5_lm.py:701

↓ 2 callersMethodmove_zeros

(self, attention_mask)

src/test_lm.py:715

↓ 2 callersMethodmove_zeros

(self, attention_mask)

src/refiner.py:658

↓ 2 callersFunctionoracle_hint

------------------------ Parameter: generated explantion: gold explanation: ------------------------

docs/services/data_service.py:278

↓ 2 callersMethodpredict

(self, test_file, per_gpu_eval_batch_size, max_generated_tokens)

src/test_lm.py:368

↓ 2 callersFunctionread_json

(filepath)

data_preprocessing/utils.py:49

↓ 2 callersFunctionreload_model_selection

()

docs/static/js/data_selection.js:20

↓ 2 callersFunctionreplace_strings_in_ast

(py_ast, string2slot)

src/data_processing/canonicalize.py:20

↓ 2 callersFunctiontokenize_for_bleu_eval

(code)

src/scripts/finetune.py:46

↓ 2 callersFunctiontokenize_for_bleu_eval

(code)

src/scripts/train_refiner.py:55

↓ 2 callersMethodtokenize_for_bleu_eval

(self, code)

src/test_lm.py:506

↓ 2 callersMethodtrain

Train the model

src/test_lm.py:101

↓ 1 callersMethod_add_gen_input

(self, gen, input_ids, label)

src/exp_t5_lm.py:712

↓ 1 callersFunction_choose_random_prefix

(prefixes)

data_preprocessing/preprocess_moral_stories_for_critic.py:38

↓ 1 callersMethod_critique_gen

------------------------ Parameter: generated explantion: gold explanation: ------------------------

src/test_lm.py:517

↓ 1 callersFunction_estimate_sentiment

(text)

data_preprocessing/preprocess_moral_stories_for_critic.py:42

↓ 1 callersMethod_occurance

for tree2linear get the number and operation of an equation

docs/services/data_service.py:144

↓ 1 callersMethodadd_operations

(self, equation, operation_dict, numbers, operations)

data_preprocessing/create_negative_examples_mwp.py:106

↓ 1 callersMethodbatch_move_zeros

(self, attention_mask)

src/exp_t5_lm.py:689

↓ 1 callersMethodbatch_move_zeros

(self, attention_mask)

src/refiner.py:646

↓ 1 callersFunctioncheck_add_multiply

(r)

src/eval/conala_eval.py:140

↓ 1 callersMethodcount_operations

(self, operation_list, label)

data_preprocessing/create_negative_examples_mwp.py:130

↓ 1 callersMethodcreate

Create Negative Examples

data_preprocessing/create_negative_examples_mwp.py:14

↓ 1 callersMethodcreate_label

create label for data : index:filename

docs/services/data_service.py:49

↓ 1 callersMethodcreate_linear_equation

create linear equation for all data

docs/services/data_service.py:56

↓ 1 callersMethodcreate_math_pb

create math problem = Body + Question and clean the syntaxe

docs/services/data_service.py:30

↓ 1 callersFunctionevaluate

(test_file, trained_models_dir, trained_critique_dir, sequence_length, per_gpu_eval_batch_size, l

src/scripts/test_predict.py:42

↓ 1 callersFunctionevaluate

(test_file, trained_models_dir, trained_critique_dir, sequence_length, per_gpu_eval_batch_size, l

src/scripts/finetune.py:56

↓ 1 callersFunctionevaluate

(test_file, trained_models_dir, trained_critique_dir, sequence_length, per_gpu_eval_batch_size, l

src/scripts/train_refiner.py:65

↓ 1 callersMethodforward_critic_model

perform crtic model forward for the last actor generation: body + question + answer + answer -> hint Args: Returns: ge

docs/services/model_service.py:72

↓ 1 callersFunctiongenerate_critic

()

docs/static/js/critic_model.js:51

↓ 1 callersMethodgenerate_hint

(self, critique_model, input_ids, attention_mask)

src/exp_t5_lm.py:475

↓ 1 callersMethodgenerate_hint

(self, critique_model, input_ids, attention_mask)

src/test_lm.py:381

↓ 1 callersMethodgenerate_hint

(self, critique_model, input_ids, attention_mask)

src/refiner.py:398

↓ 1 callersFunctionget_acomp_phrases_from_token

(token, phrase_config=None)

data_preprocessing/utils.py:264

↓ 1 callersFunctionget_adjectives

(text)

data_preprocessing/utils.py:407

↓ 1 callersFunctionget_doc

(text)

data_preprocessing/utils.py:67

↓ 1 callersMethodget_index

for tree2linear get index of number and operation of an equation

docs/services/data_service.py:159

↓ 1 callersMethodget_item

get item Args: index (int): index Returns: dict: data selected

docs/services/data_service.py:64

↓ 1 callersFunctionget_overlap

(source: str, target: str, ignore_stopwords: bool = False, ignore_entities: bool = False)

data_preprocessing/utils.py:108

↓ 1 callersMethodget_sample

(self, input_ids, attention_mask, labels,

src/exp_t5_lm.py:724

↓ 1 callersMethodget_sample

(self, input_ids, attention_mask, labels,

src/refiner.py:680

↓ 1 callersFunctionget_synonyms_antonyms

(word, top=2, pos="adj")

data_preprocessing/utils.py:377

↓ 1 callersFunctionget_verb_phrases_from_token

(token, phrase_config=None)

data_preprocessing/utils.py:277

↓ 1 callersFunctionhas_overlap

(source: str, target: str, threshold: float, ignore_stopwords: bool = False, ignore_entities: bool = False)

data_preprocessing/utils.py:114

↓ 1 callersFunctionmain

()

src/eval/conala_eval.py:14

↓ 1 callersFunctionmain

()

src/scripts/test_predict.py:119

↓ 1 callersFunctionmain

()

src/scripts/finetune.py:140

↓ 1 callersFunctionmain

()

src/scripts/train_refiner.py:157

↓ 1 callersFunctionmain

()

data_preprocessing/prepare_moral_stories_for_actor.py:7

↓ 1 callersFunctionmain

()

data_preprocessing/prepare_moral_stories_for_critic.py:13

↓ 1 callersFunctionmain

()

data_preprocessing/preprocess_moral_stories_for_critic.py:55

↓ 1 callersMethodnumber_perturbed

(self, label, numbers)

data_preprocessing/create_negative_examples_mwp.py:113

↓ 1 callersMethodoccurance_operations

(self, operation_list, equation)

data_preprocessing/create_negative_examples_mwp.py:69

↓ 1 callersMethodoccurance_values

(self,number_list, equation)

data_preprocessing/create_negative_examples_mwp.py:76

↓ 1 callersMethodoperator_perturbed

(self, label, operations)

data_preprocessing/create_negative_examples_mwp.py:92

↓ 1 callersFunctionparse_args

()

src/scripts/test_predict.py:87

↓ 1 callersFunctionparse_args

()

src/scripts/finetune.py:110

↓ 1 callersFunctionparse_args

()

src/scripts/train_refiner.py:119

↓ 1 callersFunctionparse_file_json

(f)

src/eval/conala_eval.py:82

↓ 1 callersMethodperturb

(self, label)

data_preprocessing/create_negative_examples_mwp.py:137

next →1–100 of 152, ranked by callers