MCPcopy Create free account

hub / github.com/apple/ml-fastvlm / types & classes

Types & classes53 in github.com/apple/ml-fastvlm

↓ 14 callersClassConversation
A class that keeps all conversation history.
llava/conversation.py:21
↓ 7 callersClassMobileOneBlock
MobileOne building block. This block has a multi-branched architecture at train-time and plain-CNN style architecture at inference time F
llava/model/multimodal_encoder/mobileclip/mci.py:84
↓ 2 callersClassConvFFN
Convolutional FFN Module.
llava/model/multimodal_encoder/mobileclip/mci.py:862
↓ 2 callersClassLLaVATrainer
llava/train/llava_trainer.py:137
↓ 2 callersClassStreamToLogger
Fake file-like stream object that redirects writes to a logger instance.
llava/utils.py:60
↓ 1 callersClassAttentionBlock
Implementation of metaformer block with MHSA as token mixer. For more details on Metaformer structure, please refer to: `MetaFormer Is Actual
llava/model/multimodal_encoder/mobileclip/mci.py:1116
↓ 1 callersClassCLIPVisionTower
llava/model/multimodal_encoder/clip_encoder.py:7
↓ 1 callersClassCLIPVisionTowerS2
llava/model/multimodal_encoder/clip_encoder.py:111
↓ 1 callersClassController
llava/serve/controller.py:57
↓ 1 callersClassDataCollatorForSupervisedDataset
Collate examples for supervised fine-tuning.
llava/train/train.py:863
↓ 1 callersClassDataCollatorForSupervisedDataset
Collate examples for supervised fine-tuning.
llava/train/train_qwen.py:995
↓ 1 callersClassFastViT
This class implements `FastViT architecture <https://arxiv.org/pdf/2303.14189.pdf>`_
llava/model/multimodal_encoder/mobileclip/mci.py:1305
↓ 1 callersClassGlobalPool2D
This class implements global pooling with linear projection.
llava/model/multimodal_encoder/mobileclip/mci.py:1272
↓ 1 callersClassIdentityMap
llava/model/multimodal_projector/builder.py:5
↓ 1 callersClassLazySupervisedDataset
Dataset for supervised fine-tuning.
llava/train/train.py:767
↓ 1 callersClassLazySupervisedDataset
Dataset for supervised fine-tuning.
llava/train/train_qwen.py:891
↓ 1 callersClassLengthGroupedSampler
r""" Sampler that samples indices in a way that groups together features of the dataset of roughly the same length while keeping a bit of rand
llava/train/llava_trainer.py:103
↓ 1 callersClassLlavaLlamaModel
llava/model/language_model/llava_llama.py:34
↓ 1 callersClassLlavaMistralModel
llava/model/language_model/llava_mistral.py:35
↓ 1 callersClassLlavaMptModel
llava/model/language_model/llava_mpt.py:29
↓ 1 callersClassLlavaQwen2Model
llava/model/language_model/llava_qwen.py:34
↓ 1 callersClassMHSA
Multi-headed Self Attention module. Source modified from: https://github.com/rwightman/pytorch-image-models/blob/master/timm/models/vision_tr
llava/model/multimodal_encoder/mobileclip/mci.py:626
↓ 1 callersClassMobileCLIPVisionTower
llava/model/multimodal_encoder/mobileclip_encoder.py:13
↓ 1 callersClassModelWorker
llava/serve/model_worker.py:44
↓ 1 callersClassModelWorker
llava/serve/sglang_worker.py:54
↓ 1 callersClassPatchEmbed
Convolutional patch embedding layer.
llava/model/multimodal_encoder/mobileclip/mci.py:688
↓ 1 callersClassRepMixer
Reparameterizable token mixer. For more details, please refer to our paper: `FastViT: A Fast Hybrid Vision Transformer using Structural Repar
llava/model/multimodal_encoder/mobileclip/mci.py:744
↓ 1 callersClassRepMixerBlock
Implementation of Metaformer block with RepMixer as token mixer. For more details on Metaformer structure, please refer to: `MetaFormer Is Ac
llava/model/multimodal_encoder/mobileclip/mci.py:1042
↓ 1 callersClassReparamLargeKernelConv
Building Block of RepLKNet This class defines overparameterized large kernel conv block introduced in `RepLKNet <https://arxiv.org/abs/2203.0
llava/model/multimodal_encoder/mobileclip/mci.py:368
↓ 1 callersClassSEBlock
Squeeze and Excite module. Pytorch implementation of `Squeeze-and-Excitation Networks` - https://arxiv.org/pdf/1709.01507.pdf
llava/model/multimodal_encoder/mobileclip/mci.py:42
↓ 1 callersClassWorkerInfo
llava/serve/controller.py:43
ClassDataArguments
llava/train/train.py:74
ClassDataArguments
llava/train/train_qwen.py:74
ClassDispatchMethod
llava/serve/controller.py:28
ClassKeywordsStoppingCriteria
llava/mm_utils.py:218
ClassLayerNormChannel
LayerNorm only for Channel Dimension. Input: tensor in shape [B, C, H, W]
llava/model/multimodal_encoder/mobileclip/mci.py:606
ClassLlavaConfig
llava/model/language_model/llava_qwen.py:30
ClassLlavaConfig
llava/model/language_model/llava_llama.py:30
ClassLlavaLlamaForCausalLM
llava/model/language_model/llava_llama.py:41
ClassLlavaMetaForCausalLM
llava/model/llava_arch.py:132
ClassLlavaMetaModel
llava/model/llava_arch.py:29
ClassLlavaMistralConfig
llava/model/language_model/llava_mistral.py:31
ClassLlavaMistralForCausalLM
llava/model/language_model/llava_mistral.py:42
ClassLlavaMptConfig
llava/model/language_model/llava_mpt.py:25
ClassLlavaMptForCausalLM
llava/model/language_model/llava_mpt.py:40
ClassLlavaQwen2ForCausalLM
llava/model/language_model/llava_qwen.py:41
ClassMCi
This class implements `MCi Models <https://arxiv.org/pdf/2311.17049.pdf>`_
llava/model/multimodal_encoder/mobileclip/__init__.py:34
ClassModelArguments
llava/train/train.py:54
ClassModelArguments
llava/train/train_qwen.py:54
ClassRepCPE
Implementation of conditional positional encoding. For more details refer to paper: `Conditional Positional Encodings for Vision Transformers
llava/model/multimodal_encoder/mobileclip/mci.py:930
ClassSeparatorStyle
Different separator style.
llava/conversation.py:9
ClassTrainingArguments
llava/train/train.py:87
ClassTrainingArguments
llava/train/train_qwen.py:87