MCPcopy Create free account

hub / github.com/boheumd/MA-LMM / functions

Functions1,238 in github.com/boheumd/MA-LMM

⨍ Functions 1,238◇ Types & classes 310↳ Endpoints 9
Functionmain_process
(func)
lavis/common/dist_utils.py:107
Methodmax_epoch
(self)
lavis/runners/runner_iter.py:57
Methodmax_epoch
(self)
lavis/runners/runner_base.py:277
Methodmedian
(self)
lavis/common/logger.py:53
Methodmin_lr
(self)
lavis/runners/runner_base.py:290
Methodmodel_cfg
(self)
lavis/common/config.py:141
Methodno_weight_decay
(self)
lavis/models/vit.py:262
Functionnode_to_dict
(node)
lavis/common/config.py:170
Functionnone_level_to_args
(level)
lavis/processors/randaugment.py:266
Functionnormalize
Args: clip (torch.tensor): Video clip to be normalized. Size is (C, T, H, W) mean (tuple): pixel RGB mean. Size is (3) st
lavis/processors/functional_video.py:93
Methodoptimizer
(self)
lavis/runners/runner_base.py:100
Methodpadding
(self, seq)
lavis/processors/gpt_processors.py:128
Methodparallelize
(self, device_map=None)
lavis/models/blip2_models/modeling_t5.py:1482
Methodparallelize
(self, device_map=None)
lavis/models/blip2_models/modeling_t5.py:1687
Methodparallelize
(self, device_map=None)
lavis/models/blip2_models/modeling_t5.py:1983
Functionparse
(x)
lavis/models/clip_vit.py:191
Functionposterize_func
same output as PIL.ImageOps.posterize
lavis/processors/randaugment.py:192
Methodpredict
(self, samples)
lavis/models/blip_models/blip_nlvr.py:128
Methodpredict
(self, samples)
lavis/models/blip_models/blip_classification.py:142
Methodpredict
(self, samples)
lavis/models/albef_models/albef_classification.py:149
Methodpredict
(self, samples)
lavis/models/albef_models/albef_nlvr.py:213
Methodpredict_answers
Args: samples (dict): A dictionary containing the following keys: - image (torch.Tensor): A tensor of shape (batc
lavis/models/albef_models/albef_vqa.py:228
Methodpredict_answers
( self, samples, num_beams=5, inference_method="generate", max_len=10,
lavis/models/blip2_models/blip2_t5_instruct.py:415
Methodpredict_answers
( self, samples, num_beams=5, inference_method="generate", max_len=10,
lavis/models/blip2_models/blip2_t5.py:247
Methodpredict_answers
( self, samples, num_beams=5, inference_method="generate", max_len=10,
lavis/models/blip2_models/blip2_vicuna_instruct.py:486
Methodpredict_class
( self, samples, candidates, n_segments=1, )
lavis/models/blip2_models/blip2_t5_instruct.py:463
Methodpredict_class
( self, samples, candidates, n_segments=1, )
lavis/models/blip2_models/blip2_vicuna_instruct.py:535
Methodprepare_decoder_input_ids_from_labels
(self, labels: torch.Tensor)
lavis/models/blip2_models/modeling_t5.py:1923
Methodprepare_inputs_for_generation
( self, input_ids, attention_mask=None, **model_kwargs )
lavis/models/med.py:1106
Methodprepare_inputs_for_generation
( self, input_ids, past=None, attention_mask=None, **model_kwargs )
lavis/models/med.py:1266
Methodprepare_inputs_for_generation
( self, input_ids, query_embeds, past=None, attention_mask=None, **model_kwargs )
lavis/models/blip2_models/Qformer.py:1097
Methodprepare_inputs_for_generation
( self, input_ids, past_key_values=None, attention_mask=None, inputs_embeds=None, **kwargs )
lavis/models/blip2_models/modeling_llama.py:733
Methodprepare_inputs_for_generation
( self, input_ids, past=None, attention_mask=None, head_mask=None,
lavis/models/blip2_models/modeling_t5.py:1895
Methodprint_help
(self)
lavis/common/config.py:257
Methodproject
projects hidden states correctly to key/query states
lavis/models/blip2_models/modeling_t5.py:520
Methodregister_builder
r"""Register a dataset builder to registry with key 'name' Args: name: Key with which the builder will be registered. Us
lavis/common/registry.py:22
Methodregister_lr_scheduler
r"""Register a model to registry with key 'name' Args: name: Key with which the task will be registered. Usage:
lavis/common/registry.py:141
Methodregister_model
r"""Register a task to registry with key 'name' Args: name: Key with which the task will be registered. Usage:
lavis/common/registry.py:83
Methodregister_processor
r"""Register a processor to registry with key 'name' Args: name: Key with which the task will be registered. Usage:
lavis/common/registry.py:112
Methodregister_runner
r"""Register a model to registry with key 'name' Args: name: Key with which the task will be registered. Usage:
lavis/common/registry.py:165
Methodregister_task
r"""Register a task to registry with key 'name' Args: name: Key with which the task will be registered. Usage:
lavis/common/registry.py:54
Methodrescale
(param, layer_id)
lavis/models/eva_vit.py:304
Functionresized_crop
Do spatial cropping and resizing to the video clip Args: clip (torch.tensor): Video clip to be cropped. Size is (C, T, H, W)
lavis/processors/functional_video.py:43
Methodresume_ckpt_path
(self)
lavis/runners/runner_base.py:333
Functionrotate_func
like PIL, rotate by degree, not radians
lavis/processors/randaugment.py:76
Methodrun_cfg
(self)
lavis/common/config.py:133
Methodsave_attn_gradients
(self, attn_gradients)
lavis/models/vit.py:76
Methodsave_attn_gradients
(self, attn_gradients)
lavis/models/med.py:164
Methodsave_attn_gradients
(self, attn_gradients)
lavis/models/blip_models/nlvr_encoder.py:128
Methodsave_attn_gradients
(self, attn_gradients)
lavis/models/blip2_models/Qformer.py:149
Functionsave_file
Common i/o utility to handle saving data to various file formats. Supported: .pkl, .pickle, .npy, .json Specifically for .json, u
lavis/common/utils.py:275
Functionsave_frames_grid
(img_array, out_path)
lavis/datasets/data_utils.py:260
Methodscaler
(self)
lavis/runners/runner_base.py:132
Methodset_decoder
(self, decoder)
lavis/models/blip2_models/modeling_llama.py:635
Methodset_input_embeddings
(self, value)
lavis/models/med.py:743
Methodset_input_embeddings
(self, value)
lavis/models/blip_models/nlvr_encoder.py:703
Methodset_input_embeddings
(self, value)
lavis/models/blip2_models/Qformer.py:702
Methodset_input_embeddings
(self, value)
lavis/models/blip2_models/modeling_llama.py:456
Methodset_input_embeddings
(self, value)
lavis/models/blip2_models/modeling_llama.py:626
Methodset_input_embeddings
(self, value)
lavis/models/blip2_models/modeling_llama.py:801
Methodset_input_embeddings
(self, new_embeddings)
lavis/models/blip2_models/modeling_t5.py:1506
Methodset_input_embeddings
(self, new_embeddings)
lavis/models/blip2_models/modeling_t5.py:1713
Methodset_input_embeddings
(self, new_embeddings)
lavis/models/blip2_models/modeling_t5.py:2004
Methodset_output_embeddings
(self, new_embeddings)
lavis/models/med.py:1021
Methodset_output_embeddings
(self, new_embeddings)
lavis/models/med.py:1147
Methodset_output_embeddings
(self, new_embeddings)
lavis/models/blip2_models/Qformer.py:984
Methodset_output_embeddings
(self, new_embeddings)
lavis/models/blip2_models/Qformer.py:1147
Methodset_output_embeddings
(self, new_embeddings)
lavis/models/blip2_models/modeling_llama.py:632
Methodset_output_embeddings
(self, new_embeddings)
lavis/models/blip2_models/modeling_t5.py:1718
Methodset_processors
(self, vis_processor, text_processor)
lavis/datasets/datasets/base_dataset.py:40
Functionsetup_task
(cfg)
lavis/tasks/__init__.py:22
Methodsetup_task
(cls, cfg)
lavis/tasks/retrieval.py:27
Methodsetup_task
(cls, cfg)
lavis/tasks/classification.py:41
Methodsetup_task
(cls, cfg)
lavis/tasks/dialogue.py:33
Methodsetup_task
(cls, cfg)
lavis/tasks/vqa_reading_comprehension.py:39
Methodsetup_task
(cls, **kwargs)
lavis/tasks/base_task.py:26
Methodsetup_task
(cls, cfg)
lavis/tasks/captioning.py:31
Methodshape
projection
lavis/models/blip2_models/modeling_t5.py:508
Functionsharpness_func
The differences the this result and PIL are all on the 4 boundaries, the center areas are same
lavis/processors/randaugment.py:138
Functionshear_x_func
(img, factor, fill=(0, 0, 0))
lavis/processors/randaugment.py:159
Functionshear_y_func
(img, factor, fill=(0, 0, 0))
lavis/processors/randaugment.py:200
MethodshowQA
Display the specified annotations. :param anns (array of object): annotations to display :return: None
lavis/common/vqa_tools/vqa.py:159
Methodshow_n_params
(self, return_str=True)
lavis/models/base_model.py:110
Functionsolarize_func
same output as PIL.ImageOps.posterize
lavis/processors/randaugment.py:87
Methodstep
(self, cur_epoch, cur_step)
lavis/common/optims.py:77
Methodsynchronize_between_processes
Warning: does not synchronize the deque!
lavis/common/logger.py:39
Functiontarget
(full_id_list)
data/extract_frames.py:28
Methodtest_blip2_flant5xl
(self)
tests/models/test_blip2.py:111
Methodtest_blip2_flant5xxl
(self)
tests/models/test_blip2.py:131
Methodtest_blip2_opt2p7b
(self)
tests/models/test_blip2.py:25
Methodtest_blip2_opt2p7b_coco
(self)
tests/models/test_blip2.py:45
Methodtest_blip2_opt6p7b
(self)
tests/models/test_blip2.py:68
Methodtest_blip2_opt6p7b_coco
(self)
tests/models/test_blip2.py:88
Methodtest_caption
(self)
tests/models/test_pnp_vqa.py:76
Methodtest_caption
(self)
tests/models/test_blip.py:27
Methodtest_caption_forward
(self)
tests/models/test_blip.py:69
Methodtest_caption_large
(self)
tests/models/test_blip.py:48
Methodtest_feature_extractor
(self)
tests/models/test_blip.py:213
Methodtest_itm
(self)
tests/models/test_pnp_vqa.py:57
Methodtest_itm
(self)
tests/models/test_blip.py:263
← previousnext →1,101–1,200 of 1,238, ranked by callers