Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/boheumd/MA-LMM
/ functions
Functions
1,238 in github.com/boheumd/MA-LMM
⨍
Functions
1,238
◇
Types & classes
310
↳
Endpoints
9
Method
forward
(ctx, x)
lavis/models/base_model.py:194
Method
forward
(self, x)
lavis/models/eva_vit.py:38
Method
forward
(self, x)
lavis/models/eva_vit.py:55
Method
forward
(self, x, rel_pos_bias=None)
lavis/models/eva_vit.py:119
Method
forward
(self, x, rel_pos_bias=None)
lavis/models/eva_vit.py:175
Method
forward
(self, x, **kwargs)
lavis/models/eva_vit.py:200
Method
forward
(self)
lavis/models/eva_vit.py:240
Method
forward
(self, x)
lavis/models/eva_vit.py:355
Method
forward
( self, input_ids=None, token_type_ids=None, position_ids=None, inputs
lavis/models/med.py:88
Method
forward
( self, hidden_states, attention_mask=None, head_mask=None, encoder_hi
lavis/models/med.py:184
Method
forward
(self, hidden_states, input_tensor)
lavis/models/med.py:299
Method
forward
( self, hidden_states, attention_mask=None, head_mask=None, encoder_hi
lavis/models/med.py:336
Method
forward
(self, hidden_states)
lavis/models/med.py:371
Method
forward
(self, hidden_states, input_tensor)
lavis/models/med.py:384
Method
forward
( self, hidden_states, attention_mask=None, head_mask=None, encoder_hi
lavis/models/med.py:514
Method
forward
(self, hidden_states)
lavis/models/med.py:639
Method
forward
(self, hidden_states)
lavis/models/med.py:658
Method
forward
(self, hidden_states)
lavis/models/med.py:679
Method
forward
(self, sequence_output)
lavis/models/med.py:690
Method
forward
r""" encoder_hidden_states (:obj:`torch.FloatTensor` of shape :obj:`(batch_size, sequence_length, hidden_size)`, `optional`): Seq
lavis/models/med.py:832
Method
forward
r""" labels (:obj:`torch.LongTensor` of shape :obj:`(batch_size, sequence_length)`, `optional`): Labels for computing the masked l
lavis/models/med.py:1024
Method
forward
r""" encoder_hidden_states (:obj:`torch.FloatTensor` of shape :obj:`(batch_size, sequence_length, hidden_size)`, `optional`): Seq
lavis/models/med.py:1150
Method
forward
Args: samples (dict): A dictionary containing the following keys: - image (torch.Tensor): A tensor of shape (batc
lavis/models/blip_models/blip_vqa.py:54
Method
forward
( self, input_ids=None, position_ids=None, inputs_embeds=None, past_ke
lavis/models/blip_models/nlvr_encoder.py:58
Method
forward
( self, hidden_states, attention_mask=None, head_mask=None, encoder_hi
lavis/models/blip_models/nlvr_encoder.py:148
Method
forward
(self, hidden_states, input_tensor)
lavis/models/blip_models/nlvr_encoder.py:273
Method
forward
( self, hidden_states, attention_mask=None, head_mask=None, encoder_hi
lavis/models/blip_models/nlvr_encoder.py:329
Method
forward
(self, hidden_states)
lavis/models/blip_models/nlvr_encoder.py:391
Method
forward
(self, hidden_states, input_tensor)
lavis/models/blip_models/nlvr_encoder.py:404
Method
forward
( self, hidden_states, attention_mask=None, head_mask=None, encoder_hi
lavis/models/blip_models/nlvr_encoder.py:428
Method
forward
( self, hidden_states, attention_mask=None, head_mask=None, encoder_hi
lavis/models/blip_models/nlvr_encoder.py:498
Method
forward
(self, hidden_states)
lavis/models/blip_models/nlvr_encoder.py:599
Method
forward
(self, hidden_states)
lavis/models/blip_models/nlvr_encoder.py:618
Method
forward
(self, hidden_states)
lavis/models/blip_models/nlvr_encoder.py:639
Method
forward
(self, sequence_output)
lavis/models/blip_models/nlvr_encoder.py:650
Method
forward
r""" encoder_hidden_states (:obj:`torch.FloatTensor` of shape :obj:`(batch_size, sequence_length, hidden_size)`, `optional`): Seq
lavis/models/blip_models/nlvr_encoder.py:792
Method
forward
Args: samples (dict): A dictionary containing the following keys: - image (torch.Tensor): A tensor of shape (batc
lavis/models/blip_models/blip_retrieval.py:116
Method
forward
(self, samples, match_head="itm")
lavis/models/blip_models/blip_image_text_matching.py:58
Method
forward
Args: samples (dict): A dictionary containing the following keys: - image (torch.Tensor): A tensor of shape (batc
lavis/models/blip_models/blip_pretrain.py:114
Method
forward
r""" Args: samples (dict): A dictionary containing the following keys: - image (torch.Tensor): A tensor of shape (
lavis/models/blip_models/blip_caption.py:90
Method
forward
Args: samples (dict): A dictionary containing the following keys: - image (torch.Tensor): A tensor of shape (batc
lavis/models/albef_models/albef_vqa.py:83
Method
forward
Args: samples (dict): A dictionary containing the following keys: - image (torch.Tensor): A tensor of shape (batc
lavis/models/albef_models/albef_pretrain.py:105
Method
forward
Args: samples (dict): A dictionary containing the following keys: - image (torch.Tensor): A tensor of shape (batc
lavis/models/albef_models/albef_retrieval.py:107
Method
forward
(self, image_features, text_features, logit_scale)
lavis/models/clip_models/loss.py:100
Method
forward
(self, img)
lavis/models/clip_models/transform.py:40
Method
forward
(self, x)
lavis/models/clip_models/timm_model.py:124
Method
forward
(self, x)
lavis/models/clip_models/timm_model.py:161
Method
forward
(self, x)
lavis/models/clip_models/timm_model.py:227
Method
forward
(self, x)
lavis/models/clip_models/timm_model.py:403
Method
forward
(self, x)
lavis/models/clip_models/timm_model.py:500
Method
forward
(self, x: torch.Tensor)
lavis/models/clip_models/model.py:93
Method
forward
(self, x)
lavis/models/clip_models/model.py:123
Method
forward
(self, x)
lavis/models/clip_models/model.py:236
Method
forward
(self, x: torch.Tensor)
lavis/models/clip_models/model.py:250
Method
forward
(self, x: torch.Tensor)
lavis/models/clip_models/model.py:258
Method
forward
(self, x: torch.Tensor, attn_mask: Optional[torch.Tensor] = None)
lavis/models/clip_models/model.py:282
Method
forward
(self, x: torch.Tensor, attn_mask: Optional[torch.Tensor] = None)
lavis/models/clip_models/model.py:302
Method
forward
(self, x: torch.Tensor)
lavis/models/clip_models/model.py:349
Method
forward
(self, samples)
lavis/models/clip_models/model.py:571
Method
forward
(self, samples)
lavis/models/blip2_models/blip2_t5_instruct.py:118
Method
forward
(self, samples)
lavis/models/blip2_models/blip2_qformer.py:90
Method
forward
(self, samples)
lavis/models/blip2_models/blip2_t5.py:102
Method
forward
( self, input_ids=None, position_ids=None, query_embeds=None, past_key
lavis/models/blip2_models/Qformer.py:78
Method
forward
( self, hidden_states, attention_mask=None, head_mask=None, encoder_hi
lavis/models/blip2_models/Qformer.py:169
Method
forward
(self, hidden_states, input_tensor)
lavis/models/blip2_models/Qformer.py:285
Method
forward
( self, hidden_states, attention_mask=None, head_mask=None, encoder_hi
lavis/models/blip2_models/Qformer.py:322
Method
forward
(self, hidden_states)
lavis/models/blip2_models/Qformer.py:358
Method
forward
(self, hidden_states, input_tensor)
lavis/models/blip2_models/Qformer.py:371
Method
forward
( self, hidden_states, attention_mask=None, head_mask=None, encoder_hi
lavis/models/blip2_models/Qformer.py:402
Method
forward
( self, hidden_states, attention_mask=None, head_mask=None, encoder_hi
lavis/models/blip2_models/Qformer.py:495
Method
forward
(self, hidden_states)
lavis/models/blip2_models/Qformer.py:598
Method
forward
(self, hidden_states)
lavis/models/blip2_models/Qformer.py:617
Method
forward
(self, hidden_states)
lavis/models/blip2_models/Qformer.py:638
Method
forward
(self, sequence_output)
lavis/models/blip2_models/Qformer.py:649
Method
forward
r""" encoder_hidden_states (:obj:`torch.FloatTensor` of shape :obj:`(batch_size, sequence_length, hidden_size)`, `optional`): Seq
lavis/models/blip2_models/Qformer.py:804
Method
forward
r""" encoder_hidden_states (:obj:`torch.FloatTensor` of shape :obj:`(batch_size, sequence_length, hidden_size)`, `optional`): Seq
lavis/models/blip2_models/Qformer.py:987
Method
forward
r""" labels (:obj:`torch.LongTensor` of shape :obj:`(batch_size, sequence_length)`, `optional`): Labels for computing the masked l
lavis/models/blip2_models/Qformer.py:1150
Method
forward
(self, hidden_states)
lavis/models/blip2_models/modeling_llama.py:84
Method
forward
(self, x, seq_len=None)
lavis/models/blip2_models/modeling_llama.py:110
Method
forward
(self, x)
lavis/models/blip2_models/modeling_llama.py:157
Method
forward
( self, hidden_states: torch.Tensor, attention_mask: Optional[torch.Tensor] = None,
lavis/models/blip2_models/modeling_llama.py:186
Method
forward
Args: hidden_states (`torch.FloatTensor`): input to the layer of shape `(batch, seq_len, embed_dim)` attention_mask (
lavis/models/blip2_models/modeling_llama.py:265
Method
forward
( self, input_ids: torch.LongTensor = None, attention_mask: Optional[torch.Tensor] = N
lavis/models/blip2_models/modeling_llama.py:484
Method
forward
r""" Args: labels (`torch.LongTensor` of shape `(batch_size, sequence_length)`, *optional*): Labels for computing
lavis/models/blip2_models/modeling_llama.py:643
Method
forward
r""" labels (`torch.LongTensor` of shape `(batch_size,)`, *optional*): Labels for computing the sequence classification/regression
lavis/models/blip2_models/modeling_llama.py:805
Method
forward
(self, hidden_states)
lavis/models/blip2_models/modeling_t5.py:263
Method
forward
(self, hidden_states)
lavis/models/blip2_models/modeling_t5.py:306
Method
forward
(self, hidden_states)
lavis/models/blip2_models/modeling_t5.py:323
Method
forward
(self, hidden_states)
lavis/models/blip2_models/modeling_t5.py:343
Method
forward
Self-attention (if key_value_states is None) or attention over source sentence (provided by key_value_states).
lavis/models/blip2_models/modeling_t5.py:474
Method
forward
( self, hidden_states, attention_mask=None, position_bias=None, layer_
lavis/models/blip2_models/modeling_t5.py:632
Method
forward
( self, hidden_states, key_value_states, attention_mask=None, position
lavis/models/blip2_models/modeling_t5.py:666
Method
forward
( self, hidden_states, attention_mask=None, position_bias=None, encode
lavis/models/blip2_models/modeling_t5.py:712
Method
forward
( self, input_ids=None, attention_mask=None, encoder_hidden_states=None,
lavis/models/blip2_models/modeling_t5.py:1021
Method
forward
r""" Returns: Example: ```python >>> from transformers import T5Tokenizer, T5Model >>> tokenizer = T5Tokeni
lavis/models/blip2_models/modeling_t5.py:1529
Method
forward
r""" labels (`torch.LongTensor` of shape `(batch_size,)`, *optional*): Labels for computing the sequence classification/regression
lavis/models/blip2_models/modeling_t5.py:1734
Method
forward
r""" Returns: Example: ```python >>> from transformers import T5Tokenizer, T5EncoderModel >>> tokenizer = T
lavis/models/blip2_models/modeling_t5.py:2023
Method
forward
(self, samples)
lavis/models/blip2_models/blip2_vicuna_instruct.py:140
Method
forward
( self, hidden_states, attention_mask=None, head_mask=None, encoder_hi
lavis/models/blip2_models/blip2.py:47
Method
forward
(self, x: torch.Tensor)
lavis/models/blip2_models/blip2.py:414
← previous
next →
901–1,000 of 1,238, ranked by callers