Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/bytedance/Shot2Story
/ functions
Functions
1,483 in github.com/bytedance/Shot2Story
⨍
Functions
1,483
◇
Types & classes
348
↳
Endpoints
10
Function
adaptive_pool_feat_mult
(pool_type="avg")
code/lavis/models/timesformer/vit_utils.py:154
Function
add_model_config
add model config path or file and update registry
code/lavis/models/clip_models/model.py:1037
Method
after_evaluation
(self, val_result, **kwargs)
code/lavis/tasks/retrieval.py:49
Method
after_evaluation
(self, val_result, split_name, epoch, **kwargs)
code/lavis/tasks/captioning_custom.py:69
Method
after_evaluation
(self, val_result, split_name, epoch, **kwargs)
code/lavis/tasks/multimodal_classification.py:51
Method
after_evaluation
(self, val_result, split_name, epoch, **kwself)
code/lavis/tasks/video_text_pretrain.py:171
Method
after_evaluation
(self, val_result, split_name, epoch, **kwargs)
code/lavis/tasks/dialogue.py:57
Method
after_evaluation
(self, val_result, split_name, **kwargs)
code/lavis/tasks/vqa_reading_comprehension.py:93
Method
after_evaluation
(self, **kwargs)
code/lavis/tasks/base_task.py:78
Method
after_evaluation
(self, val_result, split_name, epoch, **kwargs)
code/lavis/tasks/captioning.py:65
Function
app
()
code/app/classification.py:63
Function
app
()
code/app/text_localization.py:20
Function
app
()
code/app/image_text_match.py:19
Function
app
()
code/app/multimodal_search.py:72
Function
app
()
code/app/vqa.py:15
Function
app
()
code/app/caption.py:15
Method
apply
(answer)
code/lavis/models/blip2_models/blip2_t5_instruct.py:699
Method
apply
(answer)
code/lavis/models/blip2_models/blip2_t5.py:315
Method
apply
(answer)
code/lavis/models/blip2_models/blip2_opt.py:357
Method
apply
(answer)
code/lavis/models/blip2_models/blip2_vicuna_instruct.py:652
Function
apply_rot_embed_list
(x: List[torch.Tensor], sin_emb, cos_emb)
code/lavis/models/clip_models/timm_model.py:438
Function
apply_rot_embed_split
(x: torch.Tensor, emb)
code/lavis/models/clip_models/timm_model.py:444
Method
auto_resume
(self)
code/lavis/runners/runner_base.py:355
Function
autocontrast_func
same output as PIL.ImageOps.autocontrast
code/lavis/processors/randaugment.py:19
Method
avg
(self)
code/lavis/common/logger.py:56
Method
before_evaluation
(self, **kwargs)
code/lavis/models/base_model.py:105
Method
before_evaluation
(self, dataset, task_type, **kwargs)
code/lavis/models/clip_models/model.py:651
Function
brightness_func
same output as PIL.ImageEnhance.Contrast
code/lavis/processors/randaugment.py:129
Method
build
(self)
code/lavis/datasets/builders/video_qa_builder.py:18
Method
build
(self)
code/lavis/datasets/builders/image_text_pair_builder.py:60
Method
build
(self)
code/lavis/datasets/builders/imagefolder_builder.py:25
Method
build
(self)
code/lavis/datasets/builders/caption_builder.py:107
Method
build
(self)
code/lavis/datasets/builders/caption_builder.py:119
Method
build_datasets
Build a dictionary of datasets, keyed by split 'train', 'valid', 'test'. Download dataset and annotations automatically if not exist.
code/lavis/tasks/base_task.py:35
Method
build_nlgEvalObj
()
code/lavis/tasks/captioning_custom.py:88
Method
build_nlgEvalObj
()
code/lavis/tasks/video_text_pretrain.py:190
Function
build_sincos2d_pos_embed
Args: feat_shape: dim: temperature: reverse_coord: stack grid order W, H instead of H, W interleave_sin_c
code/lavis/models/clip_models/timm_model.py:280
Function
cache_url
This implementation downloads the remote resource and caches it locally. The resource will only be downloaded if not previously requested.
code/lavis/common/utils.py:242
Function
center_crop
(clip, crop_size)
code/lavis/processors/functional_video.py:63
Method
channels
feature channels accessor
code/lavis/models/timesformer/features.py:66
Function
check_backward_validity
(inputs)
code/lavis/models/timesformer/helpers.py:396
Function
check_download
(row)
code/lavis/datasets/download_scripts/DownloadConceptualCaptions/download_data_cc3m.py:106
Function
check_download
(row)
code/lavis/datasets/download_scripts/DownloadConceptualCaptions/download_data_cc12m.py:106
Function
check_mimetype
(row)
code/lavis/datasets/download_scripts/DownloadConceptualCaptions/download_data_cc3m.py:97
Function
check_mimetype
(row)
code/lavis/datasets/download_scripts/DownloadConceptualCaptions/download_data_cc12m.py:97
Method
collater
(self, samples)
code/lavis/datasets/datasets/base_dataset.py:53
Method
collater
(self, samples)
code/lavis/datasets/datasets/avsd_dialogue_datasets.py:45
Method
collater
(self, samples)
code/lavis/datasets/datasets/avsd_dialogue_datasets.py:122
Method
collater
(self, samples)
code/lavis/datasets/datasets/vqa_datasets.py:17
Method
collater
(self, samples)
code/lavis/datasets/datasets/aok_vqa_datasets.py:96
Function
color_func
same output as PIL.ImageEnhance.Color
code/lavis/processors/randaugment.py:97
Method
compute_itc
()
code/tests/models/test_blip.py:276
Method
compute_itm
()
code/tests/models/test_blip.py:267
Method
compute_sim_matrix
Compute similarity i2t, t2i matrix for the given data loader.
code/lavis/models/blip_models/blip_retrieval.py:390
Method
compute_sim_matrix
Compute similarity i2t, t2i matrix for the given data loader.
code/lavis/models/albef_models/albef_retrieval.py:338
Method
compute_sim_matrix
Compute similarity i2t, t2i matrix for the given data loader.
code/lavis/models/blip2_models/blip2_qformer.py:512
Method
compute_sim_matrix
(self, data_loader, task_cfg)
code/lavis/models/alpro_models/alpro_retrieval.py:242
Function
contrast_func
same output as PIL.ImageEnhance.Contrast
code/lavis/processors/randaugment.py:115
Function
create_conv2d_pad
(in_chs, out_chs, kernel_size, **kwargs)
code/lavis/models/timesformer/conv2d_same.py:109
Method
create_custom_forward
(module)
code/lavis/models/med.py:576
Method
create_custom_forward
(module)
code/lavis/models/blip_models/nlvr_encoder.py:536
Method
create_custom_forward
(module)
code/lavis/models/blip2_models/Qformer.py:533
Method
create_custom_forward
(module)
code/lavis/models/blip2_models/modeling_llama.py:567
Method
create_custom_forward
(module)
code/lavis/models/blip2_models/modeling_t5.py:1192
Method
create_custom_forward
(module)
code/lavis/models/blip2_models/modeling_opt.py:757
Function
create_file_symlink
Simply create the symlinks for a given file1 to file2. Useful during model checkpointing to symlinks to the latest successful checkpoint.
code/lavis/common/utils.py:261
Function
create_model_and_transforms
( model_name: str, pretrained: str = "", precision: str = "fp32", device: torch.device = torch
code/lavis/models/clip_models/model.py:1009
Method
cuda_enabled
(self)
code/lavis/runners/runner_base.py:284
Method
cur_epoch
(self)
code/lavis/runners/runner_iter.py:61
Method
custom_forward
(*inputs)
code/lavis/models/med.py:577
Method
custom_forward
(*inputs)
code/lavis/models/blip_models/nlvr_encoder.py:537
Method
custom_forward
(*inputs)
code/lavis/models/blip2_models/Qformer.py:534
Method
custom_forward
(*inputs)
code/lavis/models/blip2_models/modeling_llama.py:568
Method
custom_forward
(*inputs)
code/lavis/models/blip2_models/modeling_t5.py:1193
Method
custom_forward
(*inputs)
code/lavis/models/blip2_models/modeling_opt.py:758
Function
cutout_func
(img, pad_size, replace=(0, 0, 0))
code/lavis/processors/randaugment.py:209
Function
cutout_level_to_args
(cutout_const, MAX_LEVEL, replace_value)
code/lavis/processors/randaugment.py:250
Method
dataloaders
A property to get and create dataloaders by split just in need. If no train_dataset_ratio is provided, concatenate map-style dataset
code/lavis/runners/runner_iter.py:196
Method
dataloaders
A property to get and create dataloaders by split just in need. If no train_dataset_ratio is provided, concatenate map-style dataset
code/lavis/runners/runner_base.py:182
Method
datasets_cfg
(self)
code/lavis/common/config.py:136
Method
default_config_path
(cls, model_type="base")
code/lavis/models/clip_models/model.py:675
Method
deparallelize
(self)
code/lavis/models/blip2_models/modeling_t5.py:1494
Method
deparallelize
(self)
code/lavis/models/blip2_models/modeling_t5.py:1700
Method
deparallelize
(self)
code/lavis/models/blip2_models/modeling_t5.py:1994
Function
detach_variable
(inputs)
code/lavis/models/timesformer/helpers.py:381
Method
device
(self)
code/lavis/runners/runner_base.py:77
Method
device
(self)
code/lavis/tasks/video_text_pretrain.py:145
Method
device
(self)
code/lavis/models/base_model.py:136
Method
dict
(self)
code/lavis/conversation/conversation.py:102
Function
disabled_train
Overwrite model.train with this function to make sure train/eval mode does not change anymore.
code/lavis/models/blip2_models/blip2.py:190
Method
displ_item
(self, index)
code/lavis/datasets/datasets/snli_ve_datasets.py:18
Method
displ_item
(self, index)
code/lavis/datasets/datasets/retrieval_datasets.py:16
Method
displ_item
(self, index)
code/lavis/datasets/datasets/image_text_pair_datasets.py:16
Method
displ_item
(self, index)
code/lavis/datasets/datasets/imagefolder_dataset.py:50
Method
displ_item
(self, index)
code/lavis/datasets/datasets/dialogue_datasets.py:20
Method
displ_item
(self, index)
code/lavis/datasets/datasets/coco_vqa_datasets.py:19
Method
displ_item
(self, index)
code/lavis/datasets/datasets/caption_datasets.py:16
Method
displ_item
(self, index)
code/lavis/datasets/datasets/aok_vqa_datasets.py:19
Method
displ_item
(self, index)
code/lavis/datasets/datasets/nlvr_datasets.py:20
Method
displ_item
(self, index)
code/lavis/datasets/datasets/video_vqa_datasets.py:18
← previous
next →
901–1,000 of 1,483, ranked by callers