Functions — github.com/Dai-shen/LAiW

CodeHub MCPcopy Create free account

hub / github.com/Dai-shen/LAiW / functions

Functions1,647 in github.com/Dai-shen/LAiW

⨍ Functions 1,647◇ Types & classes 407↳ Endpoints 3

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/unscramble.py:49

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/qa4mre.py:57

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/gsm8k.py:63

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/naturalqs.py:63

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/qasper.py:118

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/glue.py:70

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/glue.py:124

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/glue.py:180

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/glue.py:245

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/glue.py:298

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/glue.py:349

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/glue.py:403

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/glue.py:455

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/glue.py:510

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/superglue.py:57

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/superglue.py:113

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/superglue.py:182

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/superglue.py:244

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/superglue.py:313

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/superglue.py:391

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/superglue.py:453

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/webqs.py:56

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/hendrycks_test.py:173

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/crowspairs.py:97

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/translation.py:160

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/csatqa.py:36

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/sat.py:70

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/storycloze.py:67

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/headqa.py:61

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/hendrycks_ethics.py:62

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/hendrycks_ethics.py:90

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/hendrycks_ethics.py:124

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/hendrycks_ethics.py:175

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/hendrycks_ethics.py:325

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/hendrycks_ethics.py:358

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/arithmetic.py:51

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/xcopa.py:48

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/hendrycks_math.py:53

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/mutual.py:52

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/lambada_cloze.py:36

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/lambada_cloze.py:54

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/toxigen.py:69

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/pubmedqa.py:53

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/lambada.py:46

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/openbookqa.py:64

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/asdiv.py:65

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/logiqa.py:82

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/anli.py:62

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/coqa.py:54

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/swag.py:58

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/prost.py:73

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/mc_taco.py:57

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/scrolls.py:284

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/scrolls.py:393

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/scrolls.py:430

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/quac.py:57

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/haerae.py:31

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/mathqa.py:66

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/squad.py:71

Methoddoc_to_text

src/financial-evaluation/lm_eval/tasks/race.py:105

Methoddoc_to_text

src/tasks/legal.py:69

Methoddoc_to_text

src/tasks/legal.py:183

Methoddoc_to_text

src/tasks/legal.py:293

Methoddoc_to_text

src/tasks/legal.py:410

Methoddoc_to_text

src/tasks/legal.py:549

Methoddoc_to_text

src/tasks/legal.py:656

(self, data_dir=None, cache_dir=None, download_mode=None)

src/financial-evaluation/lm_eval/tasks/translation.py:128

(self, data_dir=None, cache_dir=None, download_mode=None)

src/financial-evaluation/lm_eval/tasks/json.py:46

(self, *args, **kwargs)

src/financial-evaluation/lm_eval/tasks/scrolls.py:163

Methodentity_f1

src/tasks/legal.py:227

Methodeot_token

src/financial-evaluation/lm_eval/models/huggingface.py:403

Methodeot_token

src/financial-evaluation/lm_eval/models/huggingface.py:545

Methodeot_token_id

src/chatlm.py:76

Methodeot_token_id

src/financial-evaluation/lm_eval/base.py:130

Methodeot_token_id

src/financial-evaluation/lm_eval/models/anthropic_llms.py:56

Methodeot_token_id

src/financial-evaluation/lm_eval/models/gpt2.py:121

Methodeot_token_id

src/financial-evaluation/lm_eval/models/textsynth.py:58

Methodeot_token_id

src/financial-evaluation/lm_eval/models/gpt3.py:89

Methodeot_token_id

src/financial-evaluation/lm_eval/models/huggingface.py:407

Methodeot_token_id

src/financial-evaluation/lm_eval/models/huggingface.py:549

Functionevaluate

( model, tokenizer, input: str, temperature=0.1, top_p=0.75, top_k=40, num_beams=4

src/interface.py:31

Functionexact_match

Counts a question as correct if the model accurately classifies the plausibility of an answer for all candidate answers. See section 4 "Evalu

src/financial-evaluation/lm_eval/tasks/mc_taco.py:121

See section 4 "Evaluation Metrics" in the paper about the F1 metric used.

src/financial-evaluation/lm_eval/tasks/mc_taco.py:133

Methodfewshot_context

( self, doc, num_fewshot, provide_description=None, rnd=None, description=None )

src/financial-evaluation/lm_eval/base.py:791

Methodfewshot_context

(self, doc, num_fewshot, **kwargs)

src/financial-evaluation/lm_eval/tasks/ceval.py:125

Methodfewshot_context

( self, doc, num_fewshot, provide_description=None, rnd=None, description=None )

src/financial-evaluation/lm_eval/tasks/truthfulqa.py:102

Methodfewshot_context

( self, doc, num_fewshot, provide_description=None, rnd=None, description=None )

src/financial-evaluation/lm_eval/tasks/blimp.py:53

Methodfewshot_context

(self, doc, num_fewshot, **kwargs)

src/financial-evaluation/lm_eval/tasks/hendrycks_test.py:132

Methodfewshot_context

( self, doc, num_fewshot, provide_description=None, rnd=None, description=None )

src/financial-evaluation/lm_eval/tasks/crowspairs.py:77

Methodfewshot_context

(self, doc, num_fewshot, **kwargs)

src/financial-evaluation/lm_eval/tasks/bigbench.py:166

Methodfewshot_context

( self, doc, num_fewshot, provide_description=None, rnd=None, description=None )

src/financial-evaluation/lm_eval/tasks/asdiv.py:57

Methodfewshot_context

Returns a fewshot context string that is made up of a prepended description (if provided), the `num_fewshot` number of examples, and an append

src/financial-evaluation/lm_eval/tasks/xnli.py:148

Methodfewshot_context

Returns a fewshot context string that is made up of a prepended description (if provided), the `num_fewshot` number of examples, and an append

src/financial-evaluation/lm_eval/tasks/pawsx.py:146

Methodfewshot_context

( self, doc, num_fewshot, provide_description=None, rnd=None, description=None )

src/financial-evaluation/lm_eval/tasks/prost.py:55

Methodfewshot_description

src/financial-evaluation/lm_eval/base.py:663

Methodfewshot_examples

src/financial-evaluation/lm_eval/base.py:787

Methodfewshot_examples

src/financial-evaluation/lm_eval/tasks/ceval.py:156

Methodfewshot_examples

src/financial-evaluation/lm_eval/tasks/wsc273.py:87

Methodfewshot_examples

src/financial-evaluation/lm_eval/tasks/naturalqs.py:56

Methodfewshot_examples

src/financial-evaluation/lm_eval/tasks/hendrycks_test.py:163

← previous next →801–900 of 1,647, ranked by callers