MCPcopy Create free account

hub / github.com/EmbodiedGPT/EmbodiedGPT_Pytorch / functions

Functions424 in github.com/EmbodiedGPT/EmbodiedGPT_Pytorch

Methodforward
( self, hidden_states, attention_mask=None, head_mask=None
robohusky/model/modeling_husky.py:951
Methodforward
r""" encoder_hidden_states (`torch.FloatTensor` of shape `(batch_size, sequence_length, hidden_size)`, `optional`): Sequence of
robohusky/model/modeling_husky.py:1118
Methodforward
(self, hidden_states: torch.Tensor)
robohusky/model/modeling_husky.py:1252
Methodforward
( self, pixel_values: torch.FloatTensor, input_ids: torch.FloatTensor,
robohusky/model/modeling_husky.py:1412
Methodforward
( self, pixel_values: torch.FloatTensor, input_ids: torch.FloatTensor,
robohusky/model/modeling_husky.py:1614
Methodforward
(self, pixel_values: torch.FloatTensor)
robohusky/model/modeling_husky_embody2.py:119
Methodforward
(self, pixel_values: torch.FloatTensor)
robohusky/model/modeling_husky_embody2.py:155
Methodforward
Input shape: Batch x Time x Channel
robohusky/model/modeling_husky_embody2.py:202
Methodforward
( self, hidden_states: torch.Tensor, head_mask: Optional[torch.Tensor]
robohusky/model/modeling_husky_embody2.py:257
Methodforward
(self, hidden_states: torch.Tensor)
robohusky/model/modeling_husky_embody2.py:312
Methodforward
Args: hidden_states (`torch.FloatTensor`): input to the layer of shape `(batch, seq_len, embed_dim)` attention_mas
robohusky/model/modeling_husky_embody2.py:332
Methodforward
r""" Args: inputs_embeds (`torch.FloatTensor` of shape `(batch_size, sequence_length, hidden_size)`): Embedded
robohusky/model/modeling_husky_embody2.py:546
Methodforward
( self, pixel_values: Optional[torch.FloatTensor] = None, output_attent
robohusky/model/modeling_husky_embody2.py:641
Methodforward
( self, hidden_states, attention_mask=None, head_mask=None
robohusky/model/modeling_husky_embody2.py:743
Methodforward
( self, hidden_states, attention_mask=None, head_mask=None
robohusky/model/modeling_husky_embody2.py:829
Methodforward
(self, hidden_states: torch.Tensor, input_tensor: torch.Tensor)
robohusky/model/modeling_husky_embody2.py:901
Methodforward
( self, hidden_states: torch.Tensor, attention_mask: Optional[torch.Flo
robohusky/model/modeling_husky_embody2.py:936
Methodforward
(self, hidden_states: torch.Tensor)
robohusky/model/modeling_husky_embody2.py:969
Methodforward
(self, hidden_states: torch.Tensor, input_tensor: torch.Tensor)
robohusky/model/modeling_husky_embody2.py:982
Methodforward
( self, hidden_states, attention_mask=None, head_mask=None
robohusky/model/modeling_husky_embody2.py:1006
Methodforward
( self, hidden_states, attention_mask=None, head_mask=None
robohusky/model/modeling_husky_embody2.py:1096
Methodforward
r""" encoder_hidden_states (`torch.FloatTensor` of shape `(batch_size, sequence_length, hidden_size)`, `optional`): Sequence of
robohusky/model/modeling_husky_embody2.py:1263
Methodforward
(self, hidden_states: torch.Tensor)
robohusky/model/modeling_husky_embody2.py:1393
Methodforward
( self, pixel_values: torch.FloatTensor, input_ids: torch.FloatTensor,
robohusky/model/modeling_husky_embody2.py:1554
Methodforward
( self, pixel_values: Optional[torch.FloatTensor] = None, input_ids: Op
robohusky/model/modeling_husky_embody2.py:1757
Methodforward
(self, pixel_values: torch.FloatTensor)
robohusky/model/modeling_husky_embody2_ori.py:109
Methodforward
(self, pixel_values: torch.FloatTensor)
robohusky/model/modeling_husky_embody2_ori.py:145
Methodforward
Input shape: Batch x Time x Channel
robohusky/model/modeling_husky_embody2_ori.py:192
Methodforward
(self, hidden_states: torch.Tensor)
robohusky/model/modeling_husky_embody2_ori.py:249
Methodforward
Args: hidden_states (`torch.FloatTensor`): input to the layer of shape `(batch, seq_len, embed_dim)` attention_mask (
robohusky/model/modeling_husky_embody2_ori.py:265
Methodforward
r""" Args: inputs_embeds (`torch.FloatTensor` of shape `(batch_size, sequence_length, hidden_size)`): Embedded rep
robohusky/model/modeling_husky_embody2_ori.py:474
Methodforward
( self, pixel_values: Optional[torch.FloatTensor] = None, output_attention
robohusky/model/modeling_husky_embody2_ori.py:569
Methodforward
( self, hidden_states, attention_mask=None, head_mask=None,
robohusky/model/modeling_husky_embody2_ori.py:671
Methodforward
(self, hidden_states: torch.Tensor, input_tensor: torch.Tensor)
robohusky/model/modeling_husky_embody2_ori.py:764
Methodforward
( self, hidden_states: torch.Tensor, attention_mask: Optional[torch.FloatT
robohusky/model/modeling_husky_embody2_ori.py:795
Methodforward
(self, hidden_states: torch.Tensor)
robohusky/model/modeling_husky_embody2_ori.py:828
Methodforward
(self, hidden_states: torch.Tensor, input_tensor: torch.Tensor)
robohusky/model/modeling_husky_embody2_ori.py:841
Methodforward
( self, hidden_states, attention_mask=None, head_mask=None,
robohusky/model/modeling_husky_embody2_ori.py:865
Methodforward
( self, hidden_states, attention_mask=None, head_mask=None,
robohusky/model/modeling_husky_embody2_ori.py:955
Methodforward
r""" encoder_hidden_states (`torch.FloatTensor` of shape `(batch_size, sequence_length, hidden_size)`, `optional`): Sequence of h
robohusky/model/modeling_husky_embody2_ori.py:1122
Methodforward
(self, hidden_states: torch.Tensor)
robohusky/model/modeling_husky_embody2_ori.py:1252
Methodforward
( self, pixel_values: torch.FloatTensor, input_ids: torch.FloatTensor,
robohusky/model/modeling_husky_embody2_ori.py:1413
Methodforward
( self, pixel_values: Optional[torch.FloatTensor] = None, input_ids: Optio
robohusky/model/modeling_husky_embody2_ori.py:1616
Methodfrom_pretrained
(cls, pretrained_model_name_or_path: Union[str, os.PathLike], **kwargs)
robohusky/configuration_husky.py:217
Methodfrom_pretrained
(cls, pretrained_model_name_or_path: Union[str, os.PathLike], **kwargs)
robohusky/model/configuration_husky_ori.py:112
Methodfrom_pretrained
(cls, pretrained_model_name_or_path: Union[str, os.PathLike], **kwargs)
robohusky/model/configuration_husky_ori.py:218
Methodfrom_pretrained
(cls, pretrained_model_name_or_path: Union[str, os.PathLike], **kwargs)
robohusky/model/configuration_husky.py:222
Methodfrom_vision_qformer_text_configs
r""" Instantiate a [`HuskyConfig`] (or a derived class) from a Husky vision model, Q-Former and language model configurations.
robohusky/configuration_husky.py:289
Methodfrom_vision_qformer_text_configs
r""" Instantiate a [`HuskyConfig`] (or a derived class) from a Husky vision model, Q-Former and language model configurations.
robohusky/model/configuration_husky_ori.py:290
Methodfrom_vision_qformer_text_configs
r""" Instantiate a [`HuskyConfig`] (or a derived class) from a Husky vision model, Q-Former and language model configurations.
robohusky/model/configuration_husky.py:294
Methodgenerate
Overrides `generate` function to be able to use the model as a conditional generator. Args: pixel_values (`torch.Flo
robohusky/model/modeling_husky_embody2.py:1861
Methodgenerate
Overrides `generate` function to be able to use the model as a conditional generator. Args: pixel_values (`torch.FloatTe
robohusky/model/modeling_husky_embody2_ori.py:1720
Functiongenerate_stream
( model, tokenizer, image_processor, params, device )
demo/test.py:185
Functiongenerate_stream
( model, tokenizer, image_processor, params, device )
demo/inference.py:185
Methodget_attention_map
(self)
robohusky/model/modeling_husky.py:659
Methodget_attention_map
(self)
robohusky/model/modeling_husky_embody2.py:735
Methodget_attention_map
(self)
robohusky/model/modeling_husky_embody2_ori.py:663
Methodget_attn_gradients
(self)
robohusky/model/modeling_husky.py:653
Methodget_attn_gradients
(self)
robohusky/model/modeling_husky_embody2.py:729
Methodget_attn_gradients
(self)
robohusky/model/modeling_husky_embody2_ori.py:657
Methodget_decoder
(self)
robohusky/model/modeling_husky.py:1548
Methodget_decoder
(self)
robohusky/model/modeling_husky_embody2.py:1690
Methodget_decoder
(self)
robohusky/model/modeling_husky_embody2_ori.py:1549
Methodget_encoder
(self)
robohusky/model/modeling_husky.py:1545
Methodget_encoder
(self)
robohusky/model/modeling_husky_embody2.py:1687
Methodget_encoder
(self)
robohusky/model/modeling_husky_embody2_ori.py:1546
Functionget_gpu_memory
Get available memory for each GPU.
robohusky/utils.py:118
Methodget_image_features
( self, pixel_values: Optional[torch.FloatTensor] = None, output_attent
robohusky/model/modeling_husky.py:1343
Methodget_image_features
( self, pixel_values: Optional[torch.FloatTensor] = None, output_attent
robohusky/model/modeling_husky_embody2.py:1485
Methodget_image_features
( self, pixel_values: Optional[torch.FloatTensor] = None, output_attention
robohusky/model/modeling_husky_embody2_ori.py:1344
Methodget_input_embeddings
(self)
robohusky/model/modeling_husky.py:615
Methodget_input_embeddings
(self)
robohusky/model/modeling_husky.py:1059
Methodget_input_embeddings
(self)
robohusky/model/modeling_husky.py:1533
Methodget_input_embeddings
(self)
robohusky/model/modeling_husky_embody2.py:691
Methodget_input_embeddings
(self)
robohusky/model/modeling_husky_embody2.py:1204
Methodget_input_embeddings
(self)
robohusky/model/modeling_husky_embody2.py:1675
Methodget_input_embeddings
(self)
robohusky/model/modeling_husky_embody2_ori.py:619
Methodget_input_embeddings
(self)
robohusky/model/modeling_husky_embody2_ori.py:1063
Methodget_input_embeddings
(self)
robohusky/model/modeling_husky_embody2_ori.py:1534
Functionget_media_type
(image_file)
robohusky/base_dataset_uni.py:76
Methodget_output_embeddings
(self)
robohusky/model/modeling_husky.py:1542
Methodget_output_embeddings
(self)
robohusky/model/modeling_husky_embody2.py:1684
Methodget_output_embeddings
(self)
robohusky/model/modeling_husky_embody2_ori.py:1543
Methodget_qformer_features
r""" Returns: vision_outputs (`BaseModelOutputWithPooling` or tuple of `torch.FloatTensor`): The vision model o
robohusky/model/modeling_husky.py:1366
Methodget_qformer_features
r""" Returns: vision_outputs (`BaseModelOutputWithPooling` or tuple of `torch.FloatTensor`): The vision model o
robohusky/model/modeling_husky_embody2.py:1508
Methodget_qformer_features
r""" Returns: vision_outputs (`BaseModelOutputWithPooling` or tuple of `torch.FloatTensor`): The vision model outp
robohusky/model/modeling_husky_embody2_ori.py:1367
Methodget_text_features
r""" Returns: text_outputs (`CausalLMOutputWithPast`, or `tuple(torch.FloatTensor)` if `return_dict=False`): Th
robohusky/model/modeling_husky.py:1311
Methodget_text_features
r""" Returns: text_outputs (`CausalLMOutputWithPast`, or `tuple(torch.FloatTensor)` if `return_dict=False`): Th
robohusky/model/modeling_husky_embody2.py:1453
Methodget_text_features
r""" Returns: text_outputs (`CausalLMOutputWithPast`, or `tuple(torch.FloatTensor)` if `return_dict=False`): The l
robohusky/model/modeling_husky_embody2_ori.py:1312
Methodget_video_embeddings
(self)
robohusky/model/modeling_husky.py:618
Methodget_video_embeddings
(self)
robohusky/model/modeling_husky_embody2.py:694
Methodget_video_embeddings
(self)
robohusky/model/modeling_husky_embody2_ori.py:622
Functionhusky_processor
(examples)
robohusky/train/train.py:511
Functionhusky_processor
(examples)
robohusky/train/train_uni.py:510
Functionis_image
(image_file)
robohusky/base_dataset.py:29
Functionis_video
(image_file)
robohusky/base_dataset.py:35
Functioniter_over_async
Convert async generator to sync generator :param async_gen: the AsyncGenerator to convert :param event_loop: the event loop to run o
robohusky/utils.py:199
Functionload_compress_model
(model_path, device, torch_dtype, use_fast=False)
robohusky/compression.py:102
Methodmerge_box
(self,dict1,dict2,dict3)
demo/script.py:409
Methodmodel_input_names
(self)
robohusky/model/processing_husky.py:175
← previousnext →301–400 of 424, ranked by callers