Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/apple/ml-fastvlm
/ types & classes
Types & classes
53 in github.com/apple/ml-fastvlm
⨍
Functions
294
◇
Types & classes
53
↳
Endpoints
11
↓ 14 callers
Class
Conversation
A class that keeps all conversation history.
llava/conversation.py:21
↓ 7 callers
Class
MobileOneBlock
MobileOne building block. This block has a multi-branched architecture at train-time and plain-CNN style architecture at inference time F
llava/model/multimodal_encoder/mobileclip/mci.py:84
↓ 2 callers
Class
ConvFFN
Convolutional FFN Module.
llava/model/multimodal_encoder/mobileclip/mci.py:862
↓ 2 callers
Class
LLaVATrainer
llava/train/llava_trainer.py:137
↓ 2 callers
Class
StreamToLogger
Fake file-like stream object that redirects writes to a logger instance.
llava/utils.py:60
↓ 1 callers
Class
AttentionBlock
Implementation of metaformer block with MHSA as token mixer. For more details on Metaformer structure, please refer to: `MetaFormer Is Actual
llava/model/multimodal_encoder/mobileclip/mci.py:1116
↓ 1 callers
Class
CLIPVisionTower
llava/model/multimodal_encoder/clip_encoder.py:7
↓ 1 callers
Class
CLIPVisionTowerS2
llava/model/multimodal_encoder/clip_encoder.py:111
↓ 1 callers
Class
Controller
llava/serve/controller.py:57
↓ 1 callers
Class
DataCollatorForSupervisedDataset
Collate examples for supervised fine-tuning.
llava/train/train.py:863
↓ 1 callers
Class
DataCollatorForSupervisedDataset
Collate examples for supervised fine-tuning.
llava/train/train_qwen.py:995
↓ 1 callers
Class
FastViT
This class implements `FastViT architecture <https://arxiv.org/pdf/2303.14189.pdf>`_
llava/model/multimodal_encoder/mobileclip/mci.py:1305
↓ 1 callers
Class
GlobalPool2D
This class implements global pooling with linear projection.
llava/model/multimodal_encoder/mobileclip/mci.py:1272
↓ 1 callers
Class
IdentityMap
llava/model/multimodal_projector/builder.py:5
↓ 1 callers
Class
LazySupervisedDataset
Dataset for supervised fine-tuning.
llava/train/train.py:767
↓ 1 callers
Class
LazySupervisedDataset
Dataset for supervised fine-tuning.
llava/train/train_qwen.py:891
↓ 1 callers
Class
LengthGroupedSampler
r""" Sampler that samples indices in a way that groups together features of the dataset of roughly the same length while keeping a bit of rand
llava/train/llava_trainer.py:103
↓ 1 callers
Class
LlavaLlamaModel
llava/model/language_model/llava_llama.py:34
↓ 1 callers
Class
LlavaMistralModel
llava/model/language_model/llava_mistral.py:35
↓ 1 callers
Class
LlavaMptModel
llava/model/language_model/llava_mpt.py:29
↓ 1 callers
Class
LlavaQwen2Model
llava/model/language_model/llava_qwen.py:34
↓ 1 callers
Class
MHSA
Multi-headed Self Attention module. Source modified from: https://github.com/rwightman/pytorch-image-models/blob/master/timm/models/vision_tr
llava/model/multimodal_encoder/mobileclip/mci.py:626
↓ 1 callers
Class
MobileCLIPVisionTower
llava/model/multimodal_encoder/mobileclip_encoder.py:13
↓ 1 callers
Class
ModelWorker
llava/serve/model_worker.py:44
↓ 1 callers
Class
ModelWorker
llava/serve/sglang_worker.py:54
↓ 1 callers
Class
PatchEmbed
Convolutional patch embedding layer.
llava/model/multimodal_encoder/mobileclip/mci.py:688
↓ 1 callers
Class
RepMixer
Reparameterizable token mixer. For more details, please refer to our paper: `FastViT: A Fast Hybrid Vision Transformer using Structural Repar
llava/model/multimodal_encoder/mobileclip/mci.py:744
↓ 1 callers
Class
RepMixerBlock
Implementation of Metaformer block with RepMixer as token mixer. For more details on Metaformer structure, please refer to: `MetaFormer Is Ac
llava/model/multimodal_encoder/mobileclip/mci.py:1042
↓ 1 callers
Class
ReparamLargeKernelConv
Building Block of RepLKNet This class defines overparameterized large kernel conv block introduced in `RepLKNet <https://arxiv.org/abs/2203.0
llava/model/multimodal_encoder/mobileclip/mci.py:368
↓ 1 callers
Class
SEBlock
Squeeze and Excite module. Pytorch implementation of `Squeeze-and-Excitation Networks` - https://arxiv.org/pdf/1709.01507.pdf
llava/model/multimodal_encoder/mobileclip/mci.py:42
↓ 1 callers
Class
WorkerInfo
llava/serve/controller.py:43
Class
DataArguments
llava/train/train.py:74
Class
DataArguments
llava/train/train_qwen.py:74
Class
DispatchMethod
llava/serve/controller.py:28
Class
KeywordsStoppingCriteria
llava/mm_utils.py:218
Class
LayerNormChannel
LayerNorm only for Channel Dimension. Input: tensor in shape [B, C, H, W]
llava/model/multimodal_encoder/mobileclip/mci.py:606
Class
LlavaConfig
llava/model/language_model/llava_qwen.py:30
Class
LlavaConfig
llava/model/language_model/llava_llama.py:30
Class
LlavaLlamaForCausalLM
llava/model/language_model/llava_llama.py:41
Class
LlavaMetaForCausalLM
llava/model/llava_arch.py:132
Class
LlavaMetaModel
llava/model/llava_arch.py:29
Class
LlavaMistralConfig
llava/model/language_model/llava_mistral.py:31
Class
LlavaMistralForCausalLM
llava/model/language_model/llava_mistral.py:42
Class
LlavaMptConfig
llava/model/language_model/llava_mpt.py:25
Class
LlavaMptForCausalLM
llava/model/language_model/llava_mpt.py:40
Class
LlavaQwen2ForCausalLM
llava/model/language_model/llava_qwen.py:41
Class
MCi
This class implements `MCi Models <https://arxiv.org/pdf/2311.17049.pdf>`_
llava/model/multimodal_encoder/mobileclip/__init__.py:34
Class
ModelArguments
llava/train/train.py:54
Class
ModelArguments
llava/train/train_qwen.py:54
Class
RepCPE
Implementation of conditional positional encoding. For more details refer to paper: `Conditional Positional Encodings for Vision Transformers
llava/model/multimodal_encoder/mobileclip/mci.py:930
Class
SeparatorStyle
Different separator style.
llava/conversation.py:9
Class
TrainingArguments
llava/train/train.py:87
Class
TrainingArguments
llava/train/train_qwen.py:87