Types & classes — github.com/OpenBMB/MiniCPM-V

CodeHub MCPcopy Create free account

hub / github.com/OpenBMB/MiniCPM-V / types & classes

Types & classes141 in github.com/OpenBMB/MiniCPM-V

⨍ Functions 1,137◇ Types & classes 141↳ Endpoints 6

↓ 9 callersClassConversation

A class that keeps all conversation history.

omnilmm/conversation.py:13

↓ 3 callersClassGroupScale

Rescales the input PIL.Image to the given 'size'. 'size' will be the size of the smaller edge. For example, if height > width, then image wil

eval_mm/vlmevalkit/vlmeval/dataset/utils/mvbench.py:209

↓ 2 callersClassIdentity

omnilmm/model/omnilmm.py:27

↓ 2 callersClassNumberValue

eval_mm/vlmevalkit/vlmeval/dataset/utils/tablevqabench.py:284

↓ 2 callersClassOcrEvaluator

eval_mm/vlmevalkit/vlmeval/dataset/utils/ccocr_evaluator/ocr_evaluator.py:78

↓ 2 callersClassStack

eval_mm/vlmevalkit/vlmeval/dataset/utils/mvbench.py:464

↓ 2 callersClassStreamToLogger

Fake file-like stream object that redirects writes to a logger instance.

omnilmm/utils.py:60

↓ 2 callersClassTableTree

# Copyright 2020 IBM # Author: peter.zhong@au1.ibm.com # License: Apache 2.0 License.

eval_mm/vlmevalkit/vlmeval/dataset/utils/ccocr_evaluator/doc_parsing_evaluator.py:24

↓ 2 callersClassToTorchFormatTensor

Converts a PIL.Image (RGB) or numpy.ndarray (H x W x C) in the range [0, 255] to a torch.FloatTensor of shape (C x H x W) in the range [0.0, 1.0]

eval_mm/vlmevalkit/vlmeval/dataset/utils/mvbench.py:483

↓ 2 callersClassVadOptions

VAD options. Attributes: threshold: Speech threshold. Silero VAD outputs speech probabilities for each audio chunk, probabilities A

web_demos/minicpm-o_2.6/vad_utils.py:10

↓ 1 callersClassAutoScoringJudge

eval_mm/vlmevalkit/vlmeval/dataset/mmmath.py:17

↓ 1 callersClassCOCO_Caption_Scorer

eval_mm/vlmevalkit/vlmeval/dataset/image_caption.py:5

↓ 1 callersClassCPMTrainer

finetune/trainer.py:12

↓ 1 callersClassCustomConfig

# Copyright 2020 IBM # Author: peter.zhong@au1.ibm.com # License: Apache 2.0 License.

eval_mm/vlmevalkit/vlmeval/dataset/utils/ccocr_evaluator/doc_parsing_evaluator.py:53

↓ 1 callersClassCustomMCQDataset

eval_mm/vlmevalkit/vlmeval/dataset/image_mcq.py:827

↓ 1 callersClassCustomTextMCQDataset

eval_mm/vlmevalkit/vlmeval/dataset/text_mcq.py:112

↓ 1 callersClassCustomVQADataset

eval_mm/vlmevalkit/vlmeval/dataset/image_vqa.py:982

↓ 1 callersClassDateValue

eval_mm/vlmevalkit/vlmeval/dataset/utils/tablevqabench.py:339

↓ 1 callersClassDownloadProgressBar

eval_mm/vlmevalkit/vlmeval/smp/file.py:198

↓ 1 callersClassGroupRandomCrop

eval_mm/vlmevalkit/vlmeval/dataset/utils/mvbench.py:109

↓ 1 callersClassInferenceSampler

eval_mm/vqaeval/eval_utils/vqa_evaluate.py:11

↓ 1 callersClassKieEvaluator

eval_mm/vlmevalkit/vlmeval/dataset/utils/ccocr_evaluator/kie_evaluator.py:350

↓ 1 callersClassMIABench

eval_mm/vlmevalkit/vlmeval/dataset/miabench.py:102

↓ 1 callersClassMathJudger

eval_mm/vlmevalkit/vlmeval/dataset/utils/olympiadbench.py:91

↓ 1 callersClassMiniCPMV

↓ 1 callersClassMiniCPMV2_5

↓ 1 callersClassMiniCPMV2_6

↓ 1 callersClassMiniCPMVChat

↓ 1 callersClassMiniCPM_V

eval_mm/vqaeval/models/MiniCPM/minicpmv.py:17

↓ 1 callersClassMiniCPM_V_2_6

eval_mm/vqaeval/models/MiniCPM/minicpmv.py:95

↓ 1 callersClassMiniCPM_o_2_6

eval_mm/vqaeval/models/MiniCPM/minicpmv.py:195

↓ 1 callersClassOmniLMM12B

↓ 1 callersClassOmniLMMModel

omnilmm/model/omnilmm.py:56

↓ 1 callersClassOpenAIWrapper

eval_mm/vlmevalkit/vlmeval/api/gpt.py:32

↓ 1 callersClassParsingEvaluator

eval_mm/vlmevalkit/vlmeval/dataset/utils/ccocr_evaluator/doc_parsing_evaluator.py:159

↓ 1 callersClassRandomAugment

omnilmm/model/utils.py:394

↓ 1 callersClassResampler

A 2D perceiver-resampler network with one cross attention layers by (grid_size**2) learnable queries and 2d sincos pos_emb Outputs:

omnilmm/model/resampler.py:96

↓ 1 callersClassSileroVADModel

web_demos/minicpm-o_2.6/vad_utils.py:44

↓ 1 callersClassStreamManager

web_demos/minicpm-o_2.6/model_server.py:62

↓ 1 callersClassStringValue

eval_mm/vlmevalkit/vlmeval/dataset/utils/tablevqabench.py:261

↓ 1 callersClassTEDS

Tree Edit Distance basead Similarity # Copyright 2020 IBM # Author: peter.zhong@au1.ibm.com # License: Apache 2.0 License.

eval_mm/vlmevalkit/vlmeval/dataset/utils/ccocr_evaluator/doc_parsing_evaluator.py:74

↓ 1 callersClassVLRewardBench

eval_mm/vlmevalkit/vlmeval/dataset/vl_rewardbench.py:72

↓ 1 callersClassVQAEval

eval_mm/vlmevalkit/vlmeval/dataset/utils/mmniah.py:14

↓ 1 callersClassVQAEval

eval_mm/vqaeval/eval_utils/vqa_evaluate.py:84

↓ 1 callersClassWildVision

eval_mm/vlmevalkit/vlmeval/dataset/wildvision.py:91

↓ 1 callersClassdocVQADataset

eval_mm/vqaeval/datasets/vqa_dataset.py:51

↓ 1 callersClassdocVQATESTDataset

eval_mm/vqaeval/datasets/vqa_dataset.py:87

↓ 1 callersClasstextVQADataset

eval_mm/vqaeval/datasets/vqa_dataset.py:23

web_demos/minicpm-o_2.6/web_server/src/utils/websocket.js:1

web_demos/minicpm-o_2.6/web_server/src/hooks/useQueue.js:1

eval_mm/vlmevalkit/vlmeval/api/base.py:9

ClassBaseMetric

eval_mm/vlmevalkit/vlmeval/dataset/utils/ccocr_evaluator/common.py:69

eval_mm/vlmevalkit/vlmeval/vlm/base.py:6

ClassCCOCRDataset

eval_mm/vlmevalkit/vlmeval/dataset/image_ccocr.py:16

ClassCGBench_MCQ_Grounding

eval_mm/vlmevalkit/vlmeval/dataset/cgbench.py:886

ClassCGBench_MCQ_Grounding_Mini

eval_mm/vlmevalkit/vlmeval/dataset/cgbench.py:9

ClassCGBench_OpenEnded

eval_mm/vlmevalkit/vlmeval/dataset/cgbench.py:1357

ClassCGBench_OpenEnded_Mini

eval_mm/vlmevalkit/vlmeval/dataset/cgbench.py:477

eval_mm/vlmevalkit/vlmeval/dataset/cmmmu.py:195

eval_mm/vlmevalkit/vlmeval/dataset/image_vqa.py:1001

InterfaceComponentCustomProperties

web_demos/minicpm-o_2.6/web_server/components.d.ts:28

ClassConcatDataset

eval_mm/vlmevalkit/vlmeval/dataset/__init__.py:45

ClassConcatVideoDataset

eval_mm/vlmevalkit/vlmeval/dataset/video_concat_dataset.py:5

ClassConvertDataFormat

eval_mm/vlmevalkit/vlmeval/dataset/utils/mvbench.py:450

eval_mm/vlmevalkit/vlmeval/dataset/dude.py:37

ClassDataArguments

finetune/finetune.py:32

eval_mm/vlmevalkit/vlmeval/dataset/dynamath.py:117

ClassGMAIMMBenchDataset

eval_mm/vlmevalkit/vlmeval/dataset/image_mcq.py:405

eval_mm/vlmevalkit/vlmeval/api/gpt.py:264

InterfaceGlobalComponents

web_demos/minicpm-o_2.6/web_server/components.d.ts:9

ClassGroupCenterCrop

eval_mm/vlmevalkit/vlmeval/dataset/utils/mvbench.py:165

ClassGroupFullResSample

eval_mm/vlmevalkit/vlmeval/dataset/utils/mvbench.py:266

ClassGroupMultiScaleCrop

eval_mm/vlmevalkit/vlmeval/dataset/utils/mvbench.py:313

ClassGroupNormalize

eval_mm/vlmevalkit/vlmeval/dataset/utils/mvbench.py:193

ClassGroupOverSample

eval_mm/vlmevalkit/vlmeval/dataset/utils/mvbench.py:225

ClassGroupRandomHorizontalFlip

Randomly horizontally flips the given PIL.Image with a probability of 0.5

eval_mm/vlmevalkit/vlmeval/dataset/utils/mvbench.py:173

ClassGroupRandomSizedCrop

Random crop the given PIL.Image to a random size of (0.08 to 1.0) of the original size and and a random aspect ratio of 3/4 to 4/3 of the original

eval_mm/vlmevalkit/vlmeval/dataset/utils/mvbench.py:400

ClassHRBenchDataset

eval_mm/vlmevalkit/vlmeval/dataset/image_mcq.py:757

ClassIdentityTransform

eval_mm/vlmevalkit/vlmeval/dataset/utils/mvbench.py:506

ClassImageBaseDataset

eval_mm/vlmevalkit/vlmeval/dataset/image_base.py:33

ClassImageCaptionDataset

eval_mm/vlmevalkit/vlmeval/dataset/image_caption.py:39

ClassImageMCQDataset

eval_mm/vlmevalkit/vlmeval/dataset/image_mcq.py:39

ClassImageMTDataset

eval_mm/vlmevalkit/vlmeval/dataset/image_mt.py:7

ClassImageVQADataset

eval_mm/vlmevalkit/vlmeval/dataset/image_vqa.py:14

ClassImageYORNDataset

eval_mm/vlmevalkit/vlmeval/dataset/image_yorn.py:7

ClassKeywordsStoppingCriteria

omnilmm/model/utils.py:42

ClassLLaVABench

eval_mm/vlmevalkit/vlmeval/dataset/image_vqa.py:790

ClassLogicVista

eval_mm/vlmevalkit/vlmeval/dataset/image_vqa.py:716

ClassLongVideoBench

eval_mm/vlmevalkit/vlmeval/dataset/longvideobench.py:90

ClassLoraArguments

finetune/finetune.py:59

eval_mm/vlmevalkit/vlmeval/dataset/mlvu.py:23

eval_mm/vlmevalkit/vlmeval/dataset/mlvu.py:59

ClassMLVU_OpenEnded

eval_mm/vlmevalkit/vlmeval/dataset/mlvu.py:275

ClassMMBenchVideo

eval_mm/vlmevalkit/vlmeval/dataset/mmbench_video.py:32

ClassMMDUDataset

eval_mm/vlmevalkit/vlmeval/dataset/image_mt.py:52

ClassMMERealWorld

eval_mm/vlmevalkit/vlmeval/dataset/image_mcq.py:556

ClassMMGenBench

eval_mm/vlmevalkit/vlmeval/dataset/mmgenbench.py:8

ClassMMLongBench

eval_mm/vlmevalkit/vlmeval/dataset/mmlongbench.py:423

ClassMMMUDataset

eval_mm/vlmevalkit/vlmeval/dataset/image_mcq.py:286

eval_mm/vlmevalkit/vlmeval/dataset/mmmath.py:398

next →1–100 of 141, ranked by callers