MCPcopy Create free account

hub / github.com/Dai-shen/LAiW / functions

Functions1,647 in github.com/Dai-shen/LAiW

Methodaggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
src/financial-evaluation/lm_eval/tasks/mgsm.py:131
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/blimp.py:112
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/unscramble.py:70
Methodaggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
src/financial-evaluation/lm_eval/tasks/gsm8k.py:113
Methodaggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
src/financial-evaluation/lm_eval/tasks/naturalqs.py:118
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/qasper.py:198
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/glue.py:98
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/glue.py:146
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/glue.py:207
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/glue.py:272
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/glue.py:323
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/glue.py:374
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/glue.py:429
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/glue.py:481
Methodaggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
src/financial-evaluation/lm_eval/tasks/glue.py:546
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/superglue.py:87
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/superglue.py:153
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/superglue.py:214
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/superglue.py:272
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/superglue.py:362
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/superglue.py:421
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/superglue.py:489
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/webqs.py:92
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/crowspairs.py:137
Methodaggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
src/financial-evaluation/lm_eval/tasks/translation.py:205
Methodaggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
src/financial-evaluation/lm_eval/tasks/storycloze.py:124
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/bigbench.py:126
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/hendrycks_ethics.py:78
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/hendrycks_ethics.py:113
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/hendrycks_ethics.py:164
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/hendrycks_ethics.py:214
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/hendrycks_ethics.py:287
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/hendrycks_ethics.py:344
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/hendrycks_ethics.py:392
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/arithmetic.py:71
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/hendrycks_math.py:82
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/mutual.py:94
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/pubmedqa.py:85
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/lambada.py:68
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/asdiv.py:90
Methodaggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
src/financial-evaluation/lm_eval/tasks/anli.py:116
Methodaggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
src/financial-evaluation/lm_eval/tasks/xnli.py:131
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/coqa.py:174
Methodaggregation
:returns: {str: [metric_score] -> float} A dictionary where keys are the names of submetrics and values are functions
src/financial-evaluation/lm_eval/tasks/pawsx.py:132
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/mc_taco.py:108
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/scrolls.py:217
Methodaggregation
(self)
src/financial-evaluation/lm_eval/tasks/scrolls.py:231
Methodaggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
src/financial-evaluation/lm_eval/tasks/quac.py:107
Methodaggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
src/financial-evaluation/lm_eval/tasks/squad.py:171
Methodaggregation
:returns: {str: [float] -> float} A dictionary where keys are the names of submetrics and values are functions that a
src/financial-evaluation/lm_eval/tasks/race.py:159
Methodaggregation
(self)
src/tasks/legal.py:144
Methodaggregation
(self)
src/tasks/legal.py:260
Methodaggregation
(self)
src/tasks/legal.py:374
Methodaggregation
(self)
src/tasks/legal.py:513
Methodaggregation
(self)
src/tasks/legal.py:616
Methodaggregation
(self)
src/tasks/legal.py:816
Methodbart_score
(self, items)
src/tasks/legal.py:367
Methodbart_score
(self, items)
src/tasks/legal.py:503
Methodbatch_size
(self)
src/chatlm.py:89
Methodbatch_size
(self)
src/financial-evaluation/lm_eval/base.py:145
Methodbatch_size
(self)
src/financial-evaluation/lm_eval/models/anthropic_llms.py:68
Methodbatch_size
(self)
src/financial-evaluation/lm_eval/models/gpt2.py:145
Methodbatch_size
(self)
src/financial-evaluation/lm_eval/models/textsynth.py:72
Methodbatch_size
(self)
src/financial-evaluation/lm_eval/models/gpt3.py:102
Methodbatch_size
(self)
src/financial-evaluation/lm_eval/models/huggingface.py:439
Methodbatch_size
(self)
src/financial-evaluation/lm_eval/models/huggingface.py:581
Methodbert_score_f1
(self, items)
src/tasks/legal.py:363
Methodbert_score_f1
(self, items)
src/tasks/legal.py:499
Functionbits_per_byte
(items)
src/financial-evaluation/lm_eval/metrics.py:107
Functionbleu
The Bilingual Evaluation Understudy Score, or BLEU for short, is a metric for evaluating a generated sentence to a reference sentence. It counts m
src/financial-evaluation/lm_eval/metrics.py:111
Methodcal_f1
(self, items)
src/tasks/legal.py:609
Methodcalc_em
(self, items)
src/financial-evaluation/lm_eval/tasks/hendrycks_ethics.py:150
Methodcalc_em
(self, items)
src/financial-evaluation/lm_eval/tasks/hendrycks_ethics.py:200
Methodcalc_em
(self, items)
src/financial-evaluation/lm_eval/tasks/hendrycks_ethics.py:377
Methodcb_multi_fi
(cls, items)
src/financial-evaluation/lm_eval/tasks/superglue.py:143
Functionchrf
chrF++ is a tool for automatic evaluation of machine translation output based on character n-gram precision and recall enhanced with word n-grams.
src/financial-evaluation/lm_eval/metrics.py:128
Functionchunks
(iter, n=0, fn=None)
src/financial-evaluation/lm_eval/utils.py:68
Methodclean
Clean a string (e.g. a training set) by removing all ngrams previously registered as contaminants. Returns a list of clean chunks, or empty if
src/financial-evaluation/lm_eval/decontamination/janitor.py:159
Functionclean_ngram
Takes a string and makes ngrams of length N, splitting grams on whitespace and ignoring ignored characters Returns a LARGE array of ngrams
src/financial-evaluation/scripts/clean_training_data/janitor_util.cpp:24
Functionclean_ngram_with_indices
Takes a string and makes ngrams of length N, splitting grams on whitespace and ignoring ignored characters Returns a LARGE array of tuples of (ngram,
src/financial-evaluation/scripts/clean_training_data/janitor_util.cpp:109
Functionclear_torch_cache
()
src/financial-evaluation/lm_eval/utils.py:289
Methodcompute_metrics
(samples)
src/financial-evaluation/lm_eval/tasks/scrolls.py:211
Methodconstruct_requests
(self, doc, ctx)
src/financial-evaluation/lm_eval/base.py:747
Methodconstruct_requests
(self, doc, ctx)
src/financial-evaluation/lm_eval/base.py:829
Methodconstruct_requests
Uses RequestFactory to construct Requests and returns an iterable of Requests which will be sent to the LM. :param doc: T
src/financial-evaluation/lm_eval/tasks/drop.py:126
Methodconstruct_requests
Uses RequestFactory to construct Requests and returns an iterable of Requests which will be sent to the LM. :param doc: T
src/financial-evaluation/lm_eval/tasks/cbt.py:94
Methodconstruct_requests
Uses RequestFactory to construct Requests and returns an iterable of Requests which will be sent to the LM. :param doc:
src/financial-evaluation/lm_eval/tasks/triviaqa.py:65
Methodconstruct_requests
Uses RequestFactory to construct Requests and returns an iterable of Requests which will be sent to the LM. :param doc: T
src/financial-evaluation/lm_eval/tasks/winogrande.py:81
Methodconstruct_requests
Uses RequestFactory to construct Requests and returns an iterable of Requests which will be sent to the LM. :param doc: T
src/financial-evaluation/lm_eval/tasks/babi.py:59
Methodconstruct_requests
Uses RequestFactory to construct Requests and returns an iterable of Requests which will be sent to the LM. :param doc: T
src/financial-evaluation/lm_eval/tasks/wsc273.py:120
Methodconstruct_requests
Uses RequestFactory to construct Requests and returns an iterable of Requests which will be sent to the LM. :param doc: T
src/financial-evaluation/lm_eval/tasks/truthfulqa.py:112
Methodconstruct_requests
Uses RequestFactory to construct Requests and returns an iterable of Requests which will be sent to the LM. :param doc: T
src/financial-evaluation/lm_eval/tasks/truthfulqa.py:238
Methodconstruct_requests
Uses RequestFactory to construct Requests and returns an iterable of Requests which will be sent to the LM. :param doc: T
src/financial-evaluation/lm_eval/tasks/mgsm.py:91
Methodconstruct_requests
(self, doc, ctx)
src/financial-evaluation/lm_eval/tasks/blimp.py:87
Methodconstruct_requests
(self, doc, ctx)
src/financial-evaluation/lm_eval/tasks/unscramble.py:61
Methodconstruct_requests
Uses RequestFactory to construct Requests and returns an iterable of Requests which will be sent to the LM. :param doc: T
src/financial-evaluation/lm_eval/tasks/gsm8k.py:69
Methodconstruct_requests
Uses RequestFactory to construct Requests and returns an iterable of Requests which will be sent to the LM. :param doc: T
src/financial-evaluation/lm_eval/tasks/naturalqs.py:91
Methodconstruct_requests
Uses RequestFactory to construct Requests and returns an iterable of Requests which will be sent to the LM. :param doc: T
src/financial-evaluation/lm_eval/tasks/qasper.py:204
Methodconstruct_requests
(self, doc, ctx)
src/financial-evaluation/lm_eval/tasks/glue.py:84
Methodconstruct_requests
(self, doc, ctx)
src/financial-evaluation/lm_eval/tasks/glue.py:132
← previousnext →501–600 of 1,647, ranked by callers