Functions — github.com/Dai-shen/LAiW

hub / github.com/Dai-shen/LAiW / functions

Functions1,647 in github.com/Dai-shen/LAiW

⨍ Functions 1,647◇ Types & classes 407↳ Endpoints 3

Method_generate_examples

(self, filepath, split)

src/financial-evaluation/lm_eval/datasets/coqa/coqa.py:182

Method_generate_examples

(self, basepath, split)

src/financial-evaluation/lm_eval/datasets/mutual/mutual.py:117

Method_generate_examples

(self, filepath, split)

src/financial-evaluation/lm_eval/datasets/hendrycks_ethics/hendrycks_ethics.py:178

Method_generate_examples

Yields examples.

src/financial-evaluation/lm_eval/datasets/headqa/headqa.py:133

Method_generate_examples

(self, filepath, split)

src/financial-evaluation/lm_eval/datasets/unscramble/unscramble.py:103

Method_generate_examples

(self, filepath, split)

src/financial-evaluation/lm_eval/datasets/pile/pile.py:119

Method_generate_examples

(self, filepath, split)

src/financial-evaluation/lm_eval/datasets/asdiv/asdiv.py:101

Method_get_prune_text

(self, doc)

src/financial-evaluation/lm_eval/tasks/scrolls.py:363

Method_info

(self)

src/financial-evaluation/lm_eval/datasets/quac/quac.py:62

Method_info

(self)

src/financial-evaluation/lm_eval/datasets/drop/drop.py:79

Method_info

(self)

src/financial-evaluation/lm_eval/datasets/logiqa/logiqa.py:62

Method_info

(self)

src/financial-evaluation/lm_eval/datasets/sat_analogies/sat_analogies.py:69

Method_info

(self)

src/financial-evaluation/lm_eval/datasets/hendrycks_math/hendrycks_math.py:67

Method_info

(self)

src/financial-evaluation/lm_eval/datasets/coqa/coqa.py:99

Method_info

(self)

src/financial-evaluation/lm_eval/datasets/mutual/mutual.py:63

Method_info

(self)

src/financial-evaluation/lm_eval/datasets/hendrycks_ethics/hendrycks_ethics.py:136

Method_info

(self)

src/financial-evaluation/lm_eval/datasets/headqa/headqa.py:77

Method_info

(self)

src/financial-evaluation/lm_eval/datasets/unscramble/unscramble.py:73

Method_info

(self)

src/financial-evaluation/lm_eval/datasets/pile/pile.py:85

Method_info

(self)

src/financial-evaluation/lm_eval/datasets/asdiv/asdiv.py:65

Method_loglikelihood_tokens

(self, requests, disable_tqdm=False)

src/chatlm.py:104

Method_loglikelihood_tokens

(self, requests, disable_tqdm=False)

src/financial-evaluation/lm_eval/models/anthropic_llms.py:83

Method_loglikelihood_tokens

(self, requests, disable_tqdm=False)

src/financial-evaluation/lm_eval/models/gpt3.py:117

src/financial-evaluation/lm_eval/models/anthropic_llms.py:106

Method_model_call

inps: a torch tensor of shape [batch, sequence] the size of sequence may vary from call to call returns: a torch tensor of s

src/financial-evaluation/lm_eval/models/gpt2.py:160

Method_model_call

(self, inps)

src/financial-evaluation/lm_eval/models/textsynth.py:150

Method_model_call

(self, inps)

src/financial-evaluation/lm_eval/models/gpt3.py:224

Method_model_call

( self, inputs: TokenSequence, labels: Optional[TokenSequence] = None )

src/financial-evaluation/lm_eval/models/huggingface.py:764

Method_model_call

( self, inputs: TokenSequence, labels: Optional[TokenSequence] = None )

src/financial-evaluation/lm_eval/models/huggingface.py:863

Method_model_generate

(self, context, max_length, eos_token_id)

src/chatlm.py:163

Method_model_generate

(self, context, max_length, eos_token_id)

src/financial-evaluation/lm_eval/models/anthropic_llms.py:110

Method_model_generate

(self, context, max_length, eos_token_id)

src/financial-evaluation/lm_eval/models/gpt2.py:171

Method_model_generate

(self, context, max_length, eos_token_id)

src/financial-evaluation/lm_eval/models/textsynth.py:154

Method_model_generate

(self, context, max_length, eos_token_id)

src/financial-evaluation/lm_eval/models/gpt3.py:228

Method_model_generate

( self, inputs: transformers.BatchEncoding, max_tokens: int, stop: Optional[Li

src/financial-evaluation/lm_eval/models/huggingface.py:868

Method_model_generate

( self, inputs: transformers.BatchEncoding, max_tokens: int, stop: Optional[Li

src/financial-evaluation/lm_eval/models/huggingface.py:1028

Function_num_cpu_cores

()

src/financial-evaluation/lm_eval/tasks/scrolls.py:118

Method_prepare_summary

(summary)

src/financial-evaluation/lm_eval/tasks/truthfulqa.py:406

Method_process_doc

(self, doc)

src/financial-evaluation/templates/new_multiple_choice_task.py:68

Method_process_doc

(self, doc)

src/financial-evaluation/templates/new_task.py:75

Method_process_doc

Override this to process (detokenize, strip, replace, etc.) individual documents. This can be used in a map over documents of a data

src/financial-evaluation/lm_eval/base.py:587

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/drop.py:62

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/sciq.py:50

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/ceval.py:131

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/piqa.py:51

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/hellaswag.py:52

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/arc.py:54

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/wsc273.py:69

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/qa4mre.py:47

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/hendrycks_test.py:138

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/csatqa.py:20

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/sat.py:60

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/headqa.py:52

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/json.py:61

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/hendrycks_ethics.py:355

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/hendrycks_math.py:49

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/toxigen.py:62

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/openbookqa.py:55

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/logiqa.py:55

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/swag.py:50

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/prost.py:65

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/wikitext.py:85

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/scrolls.py:268

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/scrolls.py:295

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/scrolls.py:336

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/scrolls.py:387

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/quac.py:53

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/haerae.py:20

Method_process_doc

(self, doc)

src/financial-evaluation/lm_eval/tasks/mathqa.py:52

Method_scrolls_metrics

(self)

src/financial-evaluation/lm_eval/tasks/scrolls.py:228

Method_scrolls_metrics

(self)

src/financial-evaluation/lm_eval/tasks/scrolls.py:271

Method_scrolls_metrics

(self)

src/financial-evaluation/lm_eval/tasks/scrolls.py:301

Method_scrolls_metrics

(self)

src/financial-evaluation/lm_eval/tasks/scrolls.py:360

Method_split_generators

(self, dl_manager)

src/financial-evaluation/lm_eval/datasets/quac/quac.py:80

Method_split_generators

(self, dl_manager)

src/financial-evaluation/lm_eval/datasets/drop/drop.py:120

Method_split_generators

(self, dl_manager)

src/financial-evaluation/lm_eval/datasets/logiqa/logiqa.py:79

Method_split_generators

(self, dl_manager)

src/financial-evaluation/lm_eval/datasets/sat_analogies/sat_analogies.py:86

Method_split_generators

(self, dl_manager)

src/financial-evaluation/lm_eval/datasets/hendrycks_math/hendrycks_math.py:84

Method_split_generators

(self, dl_manager)

src/financial-evaluation/lm_eval/datasets/coqa/coqa.py:159

Method_split_generators

(self, dl_manager)

src/financial-evaluation/lm_eval/datasets/mutual/mutual.py:80

Method_split_generators

(self, dl_manager)

src/financial-evaluation/lm_eval/datasets/hendrycks_ethics/hendrycks_ethics.py:145

Method_split_generators

Returns SplitGenerators.

src/financial-evaluation/lm_eval/datasets/headqa/headqa.py:102

Method_split_generators

(self, dl_manager)

src/financial-evaluation/lm_eval/datasets/unscramble/unscramble.py:88

Method_split_generators

(self, dl_manager)

src/financial-evaluation/lm_eval/datasets/pile/pile.py:99

Method_split_generators

(self, dl_manager)

src/financial-evaluation/lm_eval/datasets/asdiv/asdiv.py:83

Function_squad_agg

(key, items)

src/financial-evaluation/lm_eval/tasks/squad.py:40

Function_wrapper

(*args, **kwargs)

src/financial-evaluation/lm_eval/utils.py:236

Functionacc_all

(items)

src/financial-evaluation/lm_eval/metrics.py:48

Functionacc_all_stderr

(items)

src/financial-evaluation/lm_eval/metrics.py:67

Methodaggregation

(self)

src/financial-evaluation/lm_eval/base.py:772

Methodaggregation

(self)

src/financial-evaluation/lm_eval/base.py:844

Methodaggregation

:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a

src/financial-evaluation/lm_eval/tasks/drop.py:284

Methodaggregation

:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a

src/financial-evaluation/lm_eval/tasks/cbt.py:127

Methodaggregation

(self)

src/financial-evaluation/lm_eval/tasks/triviaqa.py:83

Methodaggregation

:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a

src/financial-evaluation/lm_eval/tasks/winogrande.py:118

Methodaggregation

(self)

src/financial-evaluation/lm_eval/tasks/babi.py:86

Methodaggregation

:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a

src/financial-evaluation/lm_eval/tasks/wsc273.py:157

Methodaggregation

(self)

src/financial-evaluation/lm_eval/tasks/truthfulqa.py:161

Methodaggregation

(self)

src/financial-evaluation/lm_eval/tasks/truthfulqa.py:332

← previous next →401–500 of 1,647, ranked by callers