MCPcopy Create free account

hub / github.com/JIA-Lab-research/LISA / types & classes

Types & classes70 in github.com/JIA-Lab-research/LISA

↓ 11 callersClassConversation
A class that keeps all conversation history.
model/llava/conversation.py:17
↓ 10 callersClassAverageMeter
Computes and stores the average and current value
utils/utils.py:52
↓ 9 callersClassConversation
A class that keeps all conversation history.
utils/conversation.py:22
↓ 8 callersClassResizeLongestSide
Resizes images to the longest side 'target_length', as well as provides methods for resizing coordinates and boxes. Provides methods for
model/segment_anything/utils/transforms.py:17
↓ 5 callersClassLayerNorm2d
model/segment_anything/modeling/common.py:31
↓ 4 callersClassAttention
An attention layer that allows for downscaling the size of the embedding after projection to queries, keys, and values.
model/segment_anything/modeling/transformer.py:185
↓ 3 callersClassMaskData
A structure for storing masks and their related data in batched format. Implements basic filtering and concatenation.
model/segment_anything/utils/amg.py:16
↓ 3 callersClassREFER
utils/refer.py:43
↓ 2 callersClassG_REFER
utils/grefer.py:36
↓ 2 callersClassMLP
model/segment_anything/modeling/mask_decoder.py:169
↓ 2 callersClassMLPBlock
model/segment_anything/modeling/common.py:13
↓ 2 callersClassStreamToLogger
Fake file-like stream object that redirects writes to a logger instance.
model/llava/utils.py:64
↓ 1 callersClassAttention
Multi-head Attention block with relative position embeddings.
model/segment_anything/modeling/image_encoder.py:196
↓ 1 callersClassBlock
Transformer blocks with support of window attention and residual propagation blocks
model/segment_anything/modeling/image_encoder.py:128
↓ 1 callersClassCLIPVisionTower
model/llava/model/multimodal_encoder/clip_encoder.py:6
↓ 1 callersClassDataCollatorForSupervisedDataset
Collate examples for supervised fine-tuning.
model/llava/train/train.py:764
↓ 1 callersClassHybridDataset
utils/dataset.py:163
↓ 1 callersClassImageEncoderViT
model/segment_anything/modeling/image_encoder.py:17
↓ 1 callersClassLLaVATrainer
model/llava/train/llava_trainer.py:36
↓ 1 callersClassLazySupervisedDataset
Dataset for supervised fine-tuning.
model/llava/train/train.py:681
↓ 1 callersClassLisaModel
model/LISA.py:104
↓ 1 callersClassLlavaLlamaModel
model/llava/model/language_model/llava_llama.py:32
↓ 1 callersClassLlavaMPTModel
model/llava/model/language_model/llava_mpt.py:33
↓ 1 callersClassMPTBlock
model/llava/model/language_model/mpt/blocks.py:25
↓ 1 callersClassMPTMLP
model/llava/model/language_model/mpt/blocks.py:11
↓ 1 callersClassMPTModel
model/llava/model/language_model/mpt/modeling_mpt.py:41
↓ 1 callersClassMaskDecoder
model/segment_anything/modeling/mask_decoder.py:16
↓ 1 callersClassPatchEmbed
Image to Patch Embedding.
model/segment_anything/modeling/image_encoder.py:395
↓ 1 callersClassPositionEmbeddingRandom
Positional encoding using random spatial frequencies.
model/segment_anything/modeling/prompt_encoder.py:189
↓ 1 callersClassProgressMeter
utils/utils.py:131
↓ 1 callersClassPromptEncoder
model/segment_anything/modeling/prompt_encoder.py:16
↓ 1 callersClassReasonSegDataset
utils/reason_seg_dataset.py:21
↓ 1 callersClassReferSegDataset
utils/refer_seg_dataset.py:19
↓ 1 callersClassSam
model/segment_anything/modeling/sam.py:18
↓ 1 callersClassSamPredictor
model/segment_anything/predictor.py:16
↓ 1 callersClassSemSegDataset
utils/sem_seg_dataset.py:127
↓ 1 callersClassSharedEmbedding
model/llava/model/language_model/mpt/custom_embedding.py:7
↓ 1 callersClassTwoWayAttentionBlock
model/segment_anything/modeling/transformer.py:109
↓ 1 callersClassTwoWayTransformer
model/segment_anything/modeling/transformer.py:16
↓ 1 callersClassVQADataset
utils/vqa_dataset.py:31
↓ 1 callersClassValDataset
utils/dataset.py:272
ClassAutoTokenizerForMOD
AutoTokenizer + Adaptation for MOD. A simple wrapper around AutoTokenizer to make instantiating an MOD-adapted tokenizer a bit easier. M
model/llava/model/language_model/mpt/adapt_tokenizer.py:30
ClassDataArguments
model/llava/train/train.py:62
ClassFlashAttnFunc
model/llava/model/language_model/mpt/flash_attn_triton.py:1042
ClassFlashAttnKVPackedFunc
model/llava/model/language_model/mpt/flash_attn_triton.py:989
ClassFlashAttnQKVPackedFunc
model/llava/model/language_model/mpt/flash_attn_triton.py:938
ClassKeywordsStoppingCriteria
model/llava/mm_utils.py:56
ClassLISAForCausalLM
model/LISA.py:123
ClassLPLayerNorm
model/llava/model/language_model/mpt/norm.py:16
ClassLPRMSNorm
model/llava/model/language_model/mpt/norm.py:78
ClassLisaMetaModel
model/LISA.py:62
ClassLlavaConfig
model/llava/model/language_model/llava_llama.py:28
ClassLlavaLlamaForCausalLM
model/llava/model/language_model/llava_llama.py:39
ClassLlavaMPTConfig
model/llava/model/language_model/llava_mpt.py:29
ClassLlavaMPTForCausalLM
model/llava/model/language_model/llava_mpt.py:44
ClassLlavaMetaForCausalLM
model/llava/model/llava_arch.py:85
ClassLlavaMetaModel
model/llava/model/llava_arch.py:29
ClassMPTConfig
model/llava/model/language_model/mpt/configuration_mpt.py:30
ClassMPTForCausalLM
model/llava/model/language_model/mpt/modeling_mpt.py:377
ClassMPTPreTrainedModel
model/llava/model/language_model/mpt/modeling_mpt.py:35
ClassModelArguments
model/llava/train/train.py:46
ClassMultiQueryAttention
Multi-Query self attention. Using torch or triton attention implemetation enables user to also use additive bias.
model/llava/model/language_model/mpt/attention.py:357
ClassMultiheadAttention
Multi-head self attention. Using torch or triton attention implemetation enables user to also use additive bias.
model/llava/model/language_model/mpt/attention.py:261
ClassRMSNorm
model/llava/model/language_model/mpt/norm.py:61
ClassSamAutomaticMaskGenerator
model/segment_anything/automatic_mask_generator.py:24
ClassSamOnnxModel
This model should not be called directly, but is used in ONNX export. It combines the prompt encoder, mask decoder, and mask postprocessing o
model/segment_anything/utils/onnx.py:17
ClassSeparatorStyle
Different separator style.
utils/conversation.py:10
ClassSeparatorStyle
Different separator style.
model/llava/conversation.py:6
ClassSummary
utils/utils.py:45
ClassTrainingArguments
model/llava/train/train.py:74