Types & classes — github.com/TRI-ML/vlm-evaluation

CodeHub MCPcopy Create free account

hub / github.com/TRI-ML/vlm-evaluation / types & classes

Types & classes99 in github.com/TRI-ML/vlm-evaluation

⨍ Functions 337◇ Types & classes 99 ↳ Endpoints 9

↓ 4 callersClassREFER

vlm_eval/util/loading/refer.py:53

↓ 3 callersClassVQAEval

vlm_eval/util/evaluation/vizwiz/eval.py:17

↓ 2 callersClassContextAdapter

vlm_eval/overwatch/overwatch.py:37

↓ 2 callersClassEvalAIAnswerProcessor

Processes an answer similar to Eval AI. See: github.com/facebookresearch/mmf/blob/c46b3b3391275b4181567db80943473a89ab98ab/pythia/tasks/proc

vlm_eval/util/evaluation/textvqa/m4c_evaluators.py:7

↓ 2 callersClassTextVQAAccuracyEvaluator

vlm_eval/util/evaluation/textvqa/m4c_evaluators.py:219

↓ 2 callersClassVQAIndex

vlm_eval/util/evaluation/vqav2/eval.py:244

↓ 1 callersClassAI2DMapDataset

vlm_eval/tasks/harnesses/ai2d.py:149

↓ 1 callersClassController

vlm_eval/serve/controller.py:57

↓ 1 callersClassDistributedOverwatch

vlm_eval/overwatch/overwatch.py:45

↓ 1 callersClassGQAMapDataset

vlm_eval/tasks/harnesses/gqa.py:134

↓ 1 callersClassLLaVaV15ImageTransform

vlm_eval/models/llava.py:54

↓ 1 callersClassLetterboxSquarePad

vlm_eval/models/llava.py:42

↓ 1 callersClassModelWorker

scripts/interactive_demo.py:49

↓ 1 callersClassOCIDRefMapDataset

vlm_eval/tasks/harnesses/ocidref.py:170

↓ 1 callersClassPopeMapDataset

vlm_eval/tasks/harnesses/pope.py:145

↓ 1 callersClassPureOverwatch

vlm_eval/overwatch/overwatch.py:77

↓ 1 callersClassRefCOCOMapDataset

vlm_eval/tasks/harnesses/refcoco.py:173

↓ 1 callersClassScoreConfig

scripts/score.py:32

↓ 1 callersClassTallyQAMapDataset

vlm_eval/tasks/harnesses/tallyqa.py:133

↓ 1 callersClassTextVQAMapDataset

vlm_eval/tasks/harnesses/textvqa.py:142

↓ 1 callersClassVQAEvaluator

vlm_eval/util/evaluation/vqav2/eval.py:403

↓ 1 callersClassVQAv2MapDataset

vlm_eval/tasks/harnesses/vqav2.py:152

↓ 1 callersClassVSRMapDataset

vlm_eval/tasks/harnesses/vsr.py:116

↓ 1 callersClassVizWizMapDataset

vlm_eval/tasks/harnesses/vizwiz.py:144

↓ 1 callersClassWorkerInfo

vlm_eval/serve/controller.py:43

ClassAI2DFullDatasetConfig

vlm_eval/conf/datasets.py:343

ClassAI2DIndexDataset

vlm_eval/tasks/harnesses/ai2d.py:130

ClassAI2DScorer

vlm_eval/tasks/harnesses/ai2d.py:275

ClassAI2DSlimDatasetConfig

vlm_eval/conf/datasets.py:356

ClassAI2DTaskRunner

vlm_eval/tasks/harnesses/ai2d.py:190

ClassAnalyzeEvalsConfig

scripts/compute_z_scores.py:34

ClassDatasetConfig

vlm_eval/conf/datasets.py:16

ClassDatasetPreparationConfig

scripts/datasets/prepare.py:22

ClassDatasetRegistry

vlm_eval/conf/datasets.py:370

ClassDemoConfig

scripts/interactive_demo.py:212

ClassDispatchMethod

vlm_eval/serve/controller.py:28

ClassEvalRunnerConfig

scripts/eval_runner.py:37

ClassEvaluationConfig

scripts/evaluate.py:32

ClassEvaluationDatasetType

vlm_eval/tasks/registry.py:13

ClassGQAFullDatasetConfig

vlm_eval/conf/datasets.py:78

ClassGQAIndexDataset

vlm_eval/tasks/harnesses/gqa.py:115

vlm_eval/tasks/harnesses/gqa.py:253

ClassGQASlimDatasetConfig

vlm_eval/conf/datasets.py:91

ClassGQATaskRunner

vlm_eval/tasks/harnesses/gqa.py:175

ClassImageProcessor

vlm_eval/util/interfaces.py:33

ClassInstructBLIP

vlm_eval/models/instructblip.py:21

vlm_eval/models/llava.py:65

ClassNoCapsFullDatasetConfig

vlm_eval/conf/datasets.py:176

ClassNoCapsSlimDatasetConfig

vlm_eval/conf/datasets.py:189

ClassOCIDRefFullDatasetConfig

vlm_eval/conf/datasets.py:245

ClassOCIDRefIndexDataset

vlm_eval/tasks/harnesses/ocidref.py:151

ClassOCIDRefScorer

vlm_eval/tasks/harnesses/ocidref.py:322

ClassOCIDRefSlimDatasetConfig

vlm_eval/conf/datasets.py:258

ClassOCIDRefTaskRunner

vlm_eval/tasks/harnesses/ocidref.py:211

ClassPopeFullDatasetConfig

vlm_eval/conf/datasets.py:314

ClassPopeIndexDataset

vlm_eval/tasks/harnesses/pope.py:126

ClassPopeScorer

vlm_eval/tasks/harnesses/pope.py:274

ClassPopeSlimDatasetConfig

vlm_eval/conf/datasets.py:328

ClassPopeTaskRunner

vlm_eval/tasks/harnesses/pope.py:192

ClassPrismaticVLM

vlm_eval/models/prismatic.py:19

ClassRefCOCOFullDatasetConfig

vlm_eval/conf/datasets.py:217

ClassRefCOCOIndexDataset

vlm_eval/tasks/harnesses/refcoco.py:154

ClassRefCOCOScorer

vlm_eval/tasks/harnesses/refcoco.py:324

ClassRefCOCOSlimDatasetConfig

vlm_eval/conf/datasets.py:230

ClassRefCOCOTaskRunner

vlm_eval/tasks/harnesses/refcoco.py:214

ClassSTVQAANLSEvaluator

vlm_eval/util/evaluation/textvqa/m4c_evaluators.py:272

ClassSTVQAAccuracyEvaluator

vlm_eval/util/evaluation/textvqa/m4c_evaluators.py:256

vlm_eval/tasks/harnesses/__init__.py:24

ClassTallyQAFullDatasetConfig

vlm_eval/conf/datasets.py:272

ClassTallyQAIndexDataset

vlm_eval/tasks/harnesses/tallyqa.py:114

ClassTallyQAScorer

vlm_eval/tasks/harnesses/tallyqa.py:259

ClassTallyQASlimDatasetConfig

vlm_eval/conf/datasets.py:299

ClassTallyQASubsampledDatasetConfig

vlm_eval/conf/datasets.py:285

ClassTallyQATaskRunner

vlm_eval/tasks/harnesses/tallyqa.py:174

ClassTaskRunner

vlm_eval/tasks/harnesses/__init__.py:19

ClassTextCapsBleu4Evaluator

vlm_eval/util/evaluation/textvqa/m4c_evaluators.py:295

ClassTextVQAFullDatasetConfig

vlm_eval/conf/datasets.py:134

ClassTextVQAFullOCRDatasetConfig

vlm_eval/conf/datasets.py:147

ClassTextVQAIndexDataset

vlm_eval/tasks/harnesses/textvqa.py:123

ClassTextVQAScorer

vlm_eval/tasks/harnesses/textvqa.py:269

ClassTextVQASlimDatasetConfig

vlm_eval/conf/datasets.py:162

ClassTextVQATaskRunner

vlm_eval/tasks/harnesses/textvqa.py:185

vlm_eval/util/interfaces.py:16

vlm_eval/util/interfaces.py:39

ClassVQAv2FullDatasetConfig

vlm_eval/conf/datasets.py:36

ClassVQAv2IndexDataset

vlm_eval/tasks/harnesses/vqav2.py:133

ClassVQAv2Scorer

vlm_eval/tasks/harnesses/vqav2.py:272

ClassVQAv2SlimDatasetConfig

vlm_eval/conf/datasets.py:63

ClassVQAv2SubSampledDatasetConfig

vlm_eval/conf/datasets.py:50

ClassVQAv2TaskRunner

vlm_eval/tasks/harnesses/vqav2.py:194

ClassVSRFullDatasetConfig

vlm_eval/conf/datasets.py:203

ClassVSRIndexDataset

vlm_eval/tasks/harnesses/vsr.py:97

vlm_eval/tasks/harnesses/vsr.py:239

ClassVSRTaskRunner

vlm_eval/tasks/harnesses/vsr.py:157

ClassVizWizFullDatasetConfig

vlm_eval/conf/datasets.py:105

ClassVizWizIndexDataset

vlm_eval/tasks/harnesses/vizwiz.py:119

ClassVizWizScorer

vlm_eval/tasks/harnesses/vizwiz.py:274

ClassVizWizSlimDatasetConfig

vlm_eval/conf/datasets.py:119

ClassVizWizTaskRunner

vlm_eval/tasks/harnesses/vizwiz.py:192