MCPcopy Create free account

hub / github.com/boheumd/MA-LMM / functions

Functions1,238 in github.com/boheumd/MA-LMM

⨍ Functions 1,238◇ Types & classes 310↳ Endpoints 9
Methodforward
(self, samples, match_head="itm")
lavis/models/blip2_models/blip2_image_text_matching.py:53
Methodforward_features
(self, x, register_blk=-1)
lavis/models/vit.py:526
Methodforward_text
(self, tokenized_text, **kwargs)
lavis/models/med.py:1404
Methodfrom_config
(cls, cfg, from_pretrained=False)
lavis/models/vit.py:460
Methodfrom_config
(cls, cfg, from_pretrained=False)
lavis/models/med.py:1306
Methodfrom_config
(cls, cfg=None)
lavis/models/blip_models/blip_nlvr.py:133
Methodfrom_config
(cls, cfg=None)
lavis/models/blip_models/blip_vqa.py:357
Methodfrom_config
(cls, cfg=None)
lavis/models/blip_models/blip_classification.py:147
Methodfrom_config
(cls, cfg=None)
lavis/models/blip_models/blip_feature_extractor.py:190
Methodfrom_config
(cls, cfg=None)
lavis/models/blip_models/blip_retrieval.py:361
Methodfrom_config
(cls, cfg=None)
lavis/models/blip_models/blip_image_text_matching.py:132
Methodfrom_config
(cls, cfg=None)
lavis/models/blip_models/blip_pretrain.py:366
Methodfrom_config
(cls, cfg)
lavis/models/blip_models/blip_caption.py:207
Methodfrom_config
(cls, cfg=None)
lavis/models/albef_models/albef_vqa.py:349
Methodfrom_config
(cls, cfg=None)
lavis/models/albef_models/albef_classification.py:154
Methodfrom_config
(cls, cfg=None)
lavis/models/albef_models/albef_nlvr.py:227
Methodfrom_config
(cls, cfg=None)
lavis/models/albef_models/albef_pretrain.py:386
Methodfrom_config
(cls, cfg=None)
lavis/models/albef_models/albef_retrieval.py:310
Methodfrom_config
(cls, cfg=None)
lavis/models/albef_models/albef_feature_extractor.py:175
Methodfrom_config
(cls, cfg=None)
lavis/models/clip_models/model.py:686
Methodfrom_config
(cls, cfg)
lavis/models/blip2_models/blip2_t5_instruct.py:736
Methodfrom_config
(cls, cfg)
lavis/models/blip2_models/blip2_qformer.py:484
Methodfrom_config
(cls, cfg)
lavis/models/blip2_models/blip2_t5.py:352
Methodfrom_config
(cls, cfg)
lavis/models/blip2_models/blip2_vicuna_instruct.py:797
Methodfrom_config
(cls, cfg=None)
lavis/processors/alpro_processors.py:146
Methodfrom_config
(cls, cfg=None)
lavis/processors/alpro_processors.py:205
Methodfrom_config
(cls, cfg=None)
lavis/processors/gpt_processors.py:111
Methodfrom_config
(cls, cfg=None)
lavis/processors/gpt_processors.py:164
Methodfrom_config
(cls, cfg=None)
lavis/processors/clip_processors.py:41
Methodfrom_config
(cls, cfg=None)
lavis/processors/clip_processors.py:79
Methodfrom_config
(cls, cfg=None)
lavis/processors/blip_processors.py:42
Methodfrom_config
(cls, cfg=None)
lavis/processors/blip_processors.py:82
Methodfrom_config
(cls, cfg=None)
lavis/processors/blip_processors.py:147
Methodfrom_config
(cls, cfg=None)
lavis/processors/blip_processors.py:187
Methodfrom_config
(cls, cfg=None)
lavis/processors/blip_processors.py:223
Methodfrom_config
(cls, cfg=None)
lavis/processors/blip_processors.py:275
Methodfrom_config
(cls, cfg=None)
lavis/processors/blip_processors.py:324
Methodgenerate
Args: samples (dict): A dictionary containing the following keys: - image (torch.Tensor): A tensor of shape (batc
lavis/models/blip2_models/blip2_qformer.py:261
FunctiongetAttMap
(img, attMap, blur=True, overlap=True)
lavis/common/gradcam.py:7
MethodgetImgIds
Get image ids that satisfy given filter conditions. default skips that filter :param quesIds (int array) : get image ids for gi
lavis/common/vqa_tools/vqa.py:114
Methodget_attention_map
(self)
lavis/models/med.py:173
Methodget_attention_map
(self)
lavis/models/blip2_models/Qformer.py:158
Methodget_attention_mask
(self, seq)
lavis/processors/gpt_processors.py:134
Methodget_attn_gradients
(self)
lavis/models/med.py:167
Methodget_attn_gradients
(self)
lavis/models/blip2_models/Qformer.py:152
Methodget_classifier
(self)
lavis/models/eva_vit.py:320
Functionget_concat_v
(im1, im2)
app/dataset_browser.py:32
Methodget_config
(self)
lavis/common/config.py:129
Methodget_decoder
(self)
lavis/models/blip2_models/modeling_llama.py:638
Methodget_decoder
(self)
lavis/models/blip2_models/modeling_t5.py:1514
Methodget_decoder
(self)
lavis/models/blip2_models/modeling_t5.py:1727
Methodget_encoder
(self)
lavis/models/blip2_models/modeling_t5.py:1511
Methodget_encoder
(self)
lavis/models/blip2_models/modeling_t5.py:1724
Methodget_encoder
(self)
lavis/models/blip2_models/modeling_t5.py:2008
Functionget_file_size
Given a file, get the size of file in MB
lavis/common/utils.py:419
Methodget_input_embeddings
(self)
lavis/models/med.py:740
Methodget_input_embeddings
(self)
lavis/models/blip_models/nlvr_encoder.py:700
Methodget_input_embeddings
(self)
lavis/models/blip2_models/modeling_llama.py:453
Methodget_input_embeddings
(self)
lavis/models/blip2_models/modeling_llama.py:623
Methodget_input_embeddings
(self)
lavis/models/blip2_models/modeling_llama.py:798
Methodget_input_embeddings
(self)
lavis/models/blip2_models/modeling_t5.py:1015
Methodget_input_embeddings
(self)
lavis/models/blip2_models/modeling_t5.py:1503
Methodget_input_embeddings
(self)
lavis/models/blip2_models/modeling_t5.py:1710
Methodget_input_embeddings
(self)
lavis/models/blip2_models/modeling_t5.py:2001
Methodget_intermediate_layers
(self, x)
lavis/models/eva_vit.py:360
Methodget_optimizer_params
(self, weight_decay, lr_scale=1)
lavis/models/blip2_models/blip2.py:266
Methodget_output_embeddings
(self)
lavis/models/med.py:1018
Methodget_output_embeddings
(self)
lavis/models/med.py:1144
Methodget_output_embeddings
(self)
lavis/models/blip2_models/Qformer.py:981
Methodget_output_embeddings
(self)
lavis/models/blip2_models/Qformer.py:1144
Methodget_output_embeddings
(self)
lavis/models/blip2_models/modeling_llama.py:629
Methodget_output_embeddings
(self)
lavis/models/blip2_models/modeling_t5.py:1721
Methodglobal_avg
(self)
lavis/common/logger.py:63
Functionhflip
Args: clip (torch.tensor): Video clip to be normalized. Size is (C, T, H, W) Returns: flipped clip (torch.tensor): Size is (C
lavis/processors/functional_video.py:112
Functionidentity_func
(img)
lavis/processors/randaugment.py:15
Methodinference_step
(self)
lavis/tasks/base_task.py:80
Methodinit_lr
(self)
lavis/runners/runner_base.py:286
Methoditm_rank
(self, image_embeds, image_atts, encoder_input_ids, match_head='itm')
lavis/models/blip_models/blip_image_text_matching.py:101
Functionlevel_to_args
(level)
lavis/processors/randaugment.py:224
Methodlist_datasets
(cls)
lavis/common/registry.py:276
Methodlist_models
(cls)
lavis/common/registry.py:260
Functionlist_pretrained
returns list of pretrained models Returns a tuple (model_name, pretrain_tag) by default or 'name:tag' if as_str == True
lavis/models/clip_models/pretrained.py:92
Functionlist_pretrained_model_tags
return all pretrain tags for the specified model architecture
lavis/models/clip_models/pretrained.py:112
Methodlist_processors
(cls)
lavis/common/registry.py:268
Methodlist_runners
(cls)
lavis/common/registry.py:256
MethodloadQA
Load questions and answers with the specified question ids. :param ids (int array) : integer ids specifying question ids
lavis/common/vqa_tools/vqa.py:148
Functionload_demo_image
()
app/calculate_coco_features.py:22
Functionload_file
Common i/o utility to handle loading data from various file formats. Supported: .pkl, .pickle, .npy, .json For the npy files, we
lavis/common/utils.py:313
Methodload_from_pretrained
(self, url_or_filename)
lavis/models/blip_models/blip_nlvr.py:156
Methodload_from_pretrained
(self, url_or_filename, use_distill=True)
lavis/models/albef_models/albef_nlvr.py:217
Methodload_from_pretrained
(self, url_or_filename, rename_text_keys=True)
lavis/models/albef_models/__init__.py:30
Methodload_from_pretrained
(self, url_or_filename)
lavis/models/blip2_models/blip2.py:246
Functionload_json
(filename)
lavis/common/utils.py:54
Methodload_pretrained
(self, checkpoint_path, prefix="")
lavis/models/vit.py:284
Functionload_tf_weights_in_t5
Load tf checkpoints in a pytorch model.
lavis/models/blip2_models/modeling_t5.py:79
Methodlock
lock modules Args: unlocked_groups (int): leave last n layer groups unlocked (default: 0)
lavis/models/clip_models/timm_model.py:91
Methodlock
(self, unlocked_groups=0, freeze_bn_stats=False)
lavis/models/clip_models/model.py:342
Methodlock_image_tower
(self, unlocked_groups=0, freeze_bn_stats=False)
lavis/models/clip_models/model.py:546
Methodlog_freq
(self)
lavis/runners/runner_base.py:281
Methodlr_scheduler
A property to get and create learning rate scheduler by split just in need.
lavis/runners/runner_base.py:142
← previousnext →1,001–1,100 of 1,238, ranked by callers