MCPcopy Create free account

hub / github.com/Dai-shen/LAiW / types & classes

Types & classes407 in github.com/Dai-shen/LAiW

⨍ Functions 1,647◇ Types & classes 407↳ Endpoints 3
↓ 10 callersClassJanitor
src/financial-evaluation/lm_eval/decontamination/janitor.py:106
↓ 5 callersClassEthicsConfig
BuilderConfig for Hendrycks ETHICS.
src/financial-evaluation/lm_eval/datasets/hendrycks_ethics/hendrycks_ethics.py:50
↓ 3 callersClassRequest
src/financial-evaluation/lm_eval/base.py:952
↓ 3 callersClassTextReader
src/financial-evaluation/lm_eval/decontamination/archiver.py:94
↓ 2 callersClassCacheHook
src/financial-evaluation/lm_eval/base.py:866
↓ 2 callersClassReader
src/financial-evaluation/lm_eval/decontamination/archiver.py:46
↓ 2 callersClassTask
A task represents an entire benchmark including its dataset, problems, answers, and evaluation methods. See BoolQ for a simple example implementat
src/financial-evaluation/lm_eval/base.py:470
↓ 2 callersClasseach
src/financial-evaluation/lm_eval/tasks/race.py:29
↓ 1 callersClassArchive
src/financial-evaluation/lm_eval/decontamination/archiver.py:21
↓ 1 callersClassBuckets
src/financial-evaluation/scripts/clean_training_data/generate_13_grams.py:86
↓ 1 callersClassChatLM
src/chatlm.py:51
↓ 1 callersClassDryrunLM
src/financial-evaluation/scripts/cost_estimate.py:7
↓ 1 callersClassExitCodeError
src/financial-evaluation/lm_eval/utils.py:17
↓ 1 callersClassMultiTokenEOSCriteria
Criteria to stop on the specified multi-token sequence.
src/financial-evaluation/lm_eval/models/huggingface.py:1061
↓ 1 callersClassRequestFactory
src/financial-evaluation/lm_eval/base.py:985
↓ 1 callersClassTextArchive
src/financial-evaluation/lm_eval/decontamination/archiver.py:74
↓ 1 callersClassZStdTextReader
src/financial-evaluation/lm_eval/decontamination/archiver.py:151
↓ 1 callersClass_bootstrap_internal
src/financial-evaluation/lm_eval/metrics.py:192
ClassANLIBase
src/financial-evaluation/lm_eval/tasks/anli.py:33
ClassANLIRound1
src/financial-evaluation/lm_eval/tasks/anli.py:133
ClassANLIRound2
src/financial-evaluation/lm_eval/tasks/anli.py:137
ClassANLIRound3
src/financial-evaluation/lm_eval/tasks/anli.py:141
ClassAR
src/tasks/legal.py:878
ClassARCChallenge
src/financial-evaluation/lm_eval/tasks/arc.py:77
ClassARCEasy
src/financial-evaluation/lm_eval/tasks/arc.py:29
ClassASDiv
ASDiv: A Diverse Corpus for Evaluating and Developing English Math Word Problem Solvers
src/financial-evaluation/lm_eval/datasets/asdiv/asdiv.py:52
ClassAbstractiveSummarization
src/tasks/legal.py:267
ClassAnagrams1
src/financial-evaluation/lm_eval/tasks/unscramble.py:77
ClassAnagrams2
src/financial-evaluation/lm_eval/tasks/unscramble.py:81
ClassAnthropicLM
src/financial-evaluation/lm_eval/models/anthropic_llms.py:40
ClassArithmetic
src/financial-evaluation/lm_eval/tasks/arithmetic.py:29
ClassArithmetic1DComposite
src/financial-evaluation/lm_eval/tasks/arithmetic.py:116
ClassArithmetic2DMinus
src/financial-evaluation/lm_eval/tasks/arithmetic.py:84
ClassArithmetic2DMultiplication
src/financial-evaluation/lm_eval/tasks/arithmetic.py:112
ClassArithmetic2DPlus
src/financial-evaluation/lm_eval/tasks/arithmetic.py:80
ClassArithmetic3DMinus
src/financial-evaluation/lm_eval/tasks/arithmetic.py:92
ClassArithmetic3DPlus
src/financial-evaluation/lm_eval/tasks/arithmetic.py:88
ClassArithmetic4DMinus
src/financial-evaluation/lm_eval/tasks/arithmetic.py:100
ClassArithmetic4DPlus
src/financial-evaluation/lm_eval/tasks/arithmetic.py:96
ClassArithmetic5DMinus
src/financial-evaluation/lm_eval/tasks/arithmetic.py:108
ClassArithmetic5DPlus
src/financial-evaluation/lm_eval/tasks/arithmetic.py:104
ClassAsdiv
src/financial-evaluation/lm_eval/tasks/asdiv.py:35
ClassAustralian
src/tasks/legal.py:848
ClassAutoCausalLM
Causal language modeling. You can find a set of supported models in the HF documentation: https://huggingface.co/docs/transformers/main/model_
src/financial-evaluation/lm_eval/models/huggingface.py:833
ClassAutoGLM
src/financial-evaluation/lm_eval/models/huggingface.py:1154
ClassAutoLlamaCausalLM
Causal language modeling supporting Llama
src/financial-evaluation/lm_eval/models/huggingface.py:1110
ClassAutoSeq2SeqLM
Seq2Seq language modeling. You can find a set of supported models in the following documentation: https://huggingface.co/docs/transformers/mai
src/financial-evaluation/lm_eval/models/huggingface.py:902
ClassBabi
src/financial-evaluation/lm_eval/tasks/babi.py:19
ClassBaseLM
src/financial-evaluation/lm_eval/base.py:121
ClassBigBenchJsonTask
src/financial-evaluation/lm_eval/tasks/bigbench.py:40
ClassBlimpAdjunctIsland
src/financial-evaluation/lm_eval/tasks/blimp.py:118
ClassBlimpAnaphorGenderAgreement
src/financial-evaluation/lm_eval/tasks/blimp.py:122
ClassBlimpAnaphorNumberAgreement
src/financial-evaluation/lm_eval/tasks/blimp.py:126
ClassBlimpAnimateSubjectPassive
src/financial-evaluation/lm_eval/tasks/blimp.py:130
ClassBlimpAnimateSubjectTrans
src/financial-evaluation/lm_eval/tasks/blimp.py:134
ClassBlimpCausative
src/financial-evaluation/lm_eval/tasks/blimp.py:138
ClassBlimpComplex_NPIsland
src/financial-evaluation/lm_eval/tasks/blimp.py:142
ClassBlimpCoordinateStructureConstraintComplexLeftBranch
src/financial-evaluation/lm_eval/tasks/blimp.py:146
ClassBlimpCoordinateStructureConstraintObjectExtraction
src/financial-evaluation/lm_eval/tasks/blimp.py:150
ClassBlimpDeterminerNounAgreementIrregular_1
src/financial-evaluation/lm_eval/tasks/blimp.py:162
ClassBlimpDeterminerNounAgreementIrregular_2
src/financial-evaluation/lm_eval/tasks/blimp.py:166
ClassBlimpDeterminerNounAgreementWithAdjIrregular_1
src/financial-evaluation/lm_eval/tasks/blimp.py:174
ClassBlimpDeterminerNounAgreementWithAdjIrregular_2
src/financial-evaluation/lm_eval/tasks/blimp.py:178
ClassBlimpDeterminerNounAgreementWithAdj_2
src/financial-evaluation/lm_eval/tasks/blimp.py:170
ClassBlimpDeterminerNounAgreementWithAdjective_1
src/financial-evaluation/lm_eval/tasks/blimp.py:182
ClassBlimpDeterminerNounAgreement_1
src/financial-evaluation/lm_eval/tasks/blimp.py:154
ClassBlimpDeterminerNounAgreement_2
src/financial-evaluation/lm_eval/tasks/blimp.py:158
ClassBlimpDistractorAgreementRelationalNoun
src/financial-evaluation/lm_eval/tasks/blimp.py:186
ClassBlimpDistractorAgreementRelativeClause
src/financial-evaluation/lm_eval/tasks/blimp.py:190
ClassBlimpDropArgument
src/financial-evaluation/lm_eval/tasks/blimp.py:194
ClassBlimpEllipsisNBar_1
src/financial-evaluation/lm_eval/tasks/blimp.py:198
ClassBlimpEllipsisNBar_2
src/financial-evaluation/lm_eval/tasks/blimp.py:202
ClassBlimpExistentialThereObjectRaising
src/financial-evaluation/lm_eval/tasks/blimp.py:206
ClassBlimpExistentialThereQuantifiers_1
src/financial-evaluation/lm_eval/tasks/blimp.py:210
ClassBlimpExistentialThereQuantifiers_2
src/financial-evaluation/lm_eval/tasks/blimp.py:214
ClassBlimpExistentialThereSubjectRaising
src/financial-evaluation/lm_eval/tasks/blimp.py:218
ClassBlimpExpletiveItObjectRaising
src/financial-evaluation/lm_eval/tasks/blimp.py:222
ClassBlimpInchoative
src/financial-evaluation/lm_eval/tasks/blimp.py:226
ClassBlimpIntransitive
src/financial-evaluation/lm_eval/tasks/blimp.py:230
ClassBlimpIrregularPastParticipleAdjectives
src/financial-evaluation/lm_eval/tasks/blimp.py:234
ClassBlimpIrregularPastParticipleVerbs
src/financial-evaluation/lm_eval/tasks/blimp.py:238
ClassBlimpIrregularPluralSubjectVerbAgreement_1
src/financial-evaluation/lm_eval/tasks/blimp.py:242
ClassBlimpIrregularPluralSubjectVerbAgreement_2
src/financial-evaluation/lm_eval/tasks/blimp.py:246
ClassBlimpLeftBranchIslandEchoQuestion
src/financial-evaluation/lm_eval/tasks/blimp.py:250
ClassBlimpLeftBranchIslandSimpleQuestion
src/financial-evaluation/lm_eval/tasks/blimp.py:254
ClassBlimpMatrixQuestionNpiLicensorPresent
src/financial-evaluation/lm_eval/tasks/blimp.py:258
ClassBlimpNpiPresent_1
src/financial-evaluation/lm_eval/tasks/blimp.py:262
ClassBlimpNpiPresent_2
src/financial-evaluation/lm_eval/tasks/blimp.py:266
ClassBlimpOnlyNpiLicensorPresent
src/financial-evaluation/lm_eval/tasks/blimp.py:270
ClassBlimpOnlyNpiScope
src/financial-evaluation/lm_eval/tasks/blimp.py:274
ClassBlimpPassive_1
src/financial-evaluation/lm_eval/tasks/blimp.py:278
ClassBlimpPassive_2
src/financial-evaluation/lm_eval/tasks/blimp.py:282
ClassBlimpPrinciple_ACCommand
src/financial-evaluation/lm_eval/tasks/blimp.py:286
ClassBlimpPrinciple_ACase_1
src/financial-evaluation/lm_eval/tasks/blimp.py:290
ClassBlimpPrinciple_ACase_2
src/financial-evaluation/lm_eval/tasks/blimp.py:294
ClassBlimpPrinciple_ADomain_1
src/financial-evaluation/lm_eval/tasks/blimp.py:298
ClassBlimpPrinciple_ADomain_2
src/financial-evaluation/lm_eval/tasks/blimp.py:302
ClassBlimpPrinciple_ADomain_3
src/financial-evaluation/lm_eval/tasks/blimp.py:306
ClassBlimpPrinciple_AReconstruction
src/financial-evaluation/lm_eval/tasks/blimp.py:310
ClassBlimpRegularPluralSubjectVerbAgreement_1
src/financial-evaluation/lm_eval/tasks/blimp.py:314
next →1–100 of 407, ranked by callers