Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/JIA-Lab-research/LISA
/ types & classes
Types & classes
70 in github.com/JIA-Lab-research/LISA
⨍
Functions
403
◇
Types & classes
70
↓ 11 callers
Class
Conversation
A class that keeps all conversation history.
model/llava/conversation.py:17
↓ 10 callers
Class
AverageMeter
Computes and stores the average and current value
utils/utils.py:52
↓ 9 callers
Class
Conversation
A class that keeps all conversation history.
utils/conversation.py:22
↓ 8 callers
Class
ResizeLongestSide
Resizes images to the longest side 'target_length', as well as provides methods for resizing coordinates and boxes. Provides methods for
model/segment_anything/utils/transforms.py:17
↓ 5 callers
Class
LayerNorm2d
model/segment_anything/modeling/common.py:31
↓ 4 callers
Class
Attention
An attention layer that allows for downscaling the size of the embedding after projection to queries, keys, and values.
model/segment_anything/modeling/transformer.py:185
↓ 3 callers
Class
MaskData
A structure for storing masks and their related data in batched format. Implements basic filtering and concatenation.
model/segment_anything/utils/amg.py:16
↓ 3 callers
Class
REFER
utils/refer.py:43
↓ 2 callers
Class
G_REFER
utils/grefer.py:36
↓ 2 callers
Class
MLP
model/segment_anything/modeling/mask_decoder.py:169
↓ 2 callers
Class
MLPBlock
model/segment_anything/modeling/common.py:13
↓ 2 callers
Class
StreamToLogger
Fake file-like stream object that redirects writes to a logger instance.
model/llava/utils.py:64
↓ 1 callers
Class
Attention
Multi-head Attention block with relative position embeddings.
model/segment_anything/modeling/image_encoder.py:196
↓ 1 callers
Class
Block
Transformer blocks with support of window attention and residual propagation blocks
model/segment_anything/modeling/image_encoder.py:128
↓ 1 callers
Class
CLIPVisionTower
model/llava/model/multimodal_encoder/clip_encoder.py:6
↓ 1 callers
Class
DataCollatorForSupervisedDataset
Collate examples for supervised fine-tuning.
model/llava/train/train.py:764
↓ 1 callers
Class
HybridDataset
utils/dataset.py:163
↓ 1 callers
Class
ImageEncoderViT
model/segment_anything/modeling/image_encoder.py:17
↓ 1 callers
Class
LLaVATrainer
model/llava/train/llava_trainer.py:36
↓ 1 callers
Class
LazySupervisedDataset
Dataset for supervised fine-tuning.
model/llava/train/train.py:681
↓ 1 callers
Class
LisaModel
model/LISA.py:104
↓ 1 callers
Class
LlavaLlamaModel
model/llava/model/language_model/llava_llama.py:32
↓ 1 callers
Class
LlavaMPTModel
model/llava/model/language_model/llava_mpt.py:33
↓ 1 callers
Class
MPTBlock
model/llava/model/language_model/mpt/blocks.py:25
↓ 1 callers
Class
MPTMLP
model/llava/model/language_model/mpt/blocks.py:11
↓ 1 callers
Class
MPTModel
model/llava/model/language_model/mpt/modeling_mpt.py:41
↓ 1 callers
Class
MaskDecoder
model/segment_anything/modeling/mask_decoder.py:16
↓ 1 callers
Class
PatchEmbed
Image to Patch Embedding.
model/segment_anything/modeling/image_encoder.py:395
↓ 1 callers
Class
PositionEmbeddingRandom
Positional encoding using random spatial frequencies.
model/segment_anything/modeling/prompt_encoder.py:189
↓ 1 callers
Class
ProgressMeter
utils/utils.py:131
↓ 1 callers
Class
PromptEncoder
model/segment_anything/modeling/prompt_encoder.py:16
↓ 1 callers
Class
ReasonSegDataset
utils/reason_seg_dataset.py:21
↓ 1 callers
Class
ReferSegDataset
utils/refer_seg_dataset.py:19
↓ 1 callers
Class
Sam
model/segment_anything/modeling/sam.py:18
↓ 1 callers
Class
SamPredictor
model/segment_anything/predictor.py:16
↓ 1 callers
Class
SemSegDataset
utils/sem_seg_dataset.py:127
↓ 1 callers
Class
SharedEmbedding
model/llava/model/language_model/mpt/custom_embedding.py:7
↓ 1 callers
Class
TwoWayAttentionBlock
model/segment_anything/modeling/transformer.py:109
↓ 1 callers
Class
TwoWayTransformer
model/segment_anything/modeling/transformer.py:16
↓ 1 callers
Class
VQADataset
utils/vqa_dataset.py:31
↓ 1 callers
Class
ValDataset
utils/dataset.py:272
Class
AutoTokenizerForMOD
AutoTokenizer + Adaptation for MOD. A simple wrapper around AutoTokenizer to make instantiating an MOD-adapted tokenizer a bit easier. M
model/llava/model/language_model/mpt/adapt_tokenizer.py:30
Class
DataArguments
model/llava/train/train.py:62
Class
FlashAttnFunc
model/llava/model/language_model/mpt/flash_attn_triton.py:1042
Class
FlashAttnKVPackedFunc
model/llava/model/language_model/mpt/flash_attn_triton.py:989
Class
FlashAttnQKVPackedFunc
model/llava/model/language_model/mpt/flash_attn_triton.py:938
Class
KeywordsStoppingCriteria
model/llava/mm_utils.py:56
Class
LISAForCausalLM
model/LISA.py:123
Class
LPLayerNorm
model/llava/model/language_model/mpt/norm.py:16
Class
LPRMSNorm
model/llava/model/language_model/mpt/norm.py:78
Class
LisaMetaModel
model/LISA.py:62
Class
LlavaConfig
model/llava/model/language_model/llava_llama.py:28
Class
LlavaLlamaForCausalLM
model/llava/model/language_model/llava_llama.py:39
Class
LlavaMPTConfig
model/llava/model/language_model/llava_mpt.py:29
Class
LlavaMPTForCausalLM
model/llava/model/language_model/llava_mpt.py:44
Class
LlavaMetaForCausalLM
model/llava/model/llava_arch.py:85
Class
LlavaMetaModel
model/llava/model/llava_arch.py:29
Class
MPTConfig
model/llava/model/language_model/mpt/configuration_mpt.py:30
Class
MPTForCausalLM
model/llava/model/language_model/mpt/modeling_mpt.py:377
Class
MPTPreTrainedModel
model/llava/model/language_model/mpt/modeling_mpt.py:35
Class
ModelArguments
model/llava/train/train.py:46
Class
MultiQueryAttention
Multi-Query self attention. Using torch or triton attention implemetation enables user to also use additive bias.
model/llava/model/language_model/mpt/attention.py:357
Class
MultiheadAttention
Multi-head self attention. Using torch or triton attention implemetation enables user to also use additive bias.
model/llava/model/language_model/mpt/attention.py:261
Class
RMSNorm
model/llava/model/language_model/mpt/norm.py:61
Class
SamAutomaticMaskGenerator
model/segment_anything/automatic_mask_generator.py:24
Class
SamOnnxModel
This model should not be called directly, but is used in ONNX export. It combines the prompt encoder, mask decoder, and mask postprocessing o
model/segment_anything/utils/onnx.py:17
Class
SeparatorStyle
Different separator style.
utils/conversation.py:10
Class
SeparatorStyle
Different separator style.
model/llava/conversation.py:6
Class
Summary
utils/utils.py:45
Class
TrainingArguments
model/llava/train/train.py:74