MCPcopy Create free account

hub / github.com/bronyayang/Law_of_Vision_Representation_in_MLLMs / functions

Functions12,826 in github.com/bronyayang/Law_of_Vision_Representation_in_MLLMs

↓ 8 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/hunyuan_dit/test_hunyuan_dit.py:91
↓ 8 callersMethodget_dummy_inputs
(self, device, seed=0, img_res=64)
diffusers/tests/pipelines/controlnet/test_controlnet_inpaint_sdxl.py:187
↓ 8 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/stable_diffusion/test_stable_diffusion_img2img.py:169
↓ 8 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/pixart_alpha/test_pixart.py:90
↓ 8 callersMethodget_original
Restores the original order of elements from the reordered list. Parameters: - newarr (List): The reordered array.
llava/eval/lmms-eval/lmms_eval/utils.py:829
↓ 8 callersMethodget_scheduler_config
(self, **kwargs)
diffusers/tests/schedulers/test_scheduler_ddpm.py:11
↓ 8 callersMethodget_scheduler_config
(self, **kwargs)
diffusers/tests/schedulers/test_scheduler_deis.py:19
↓ 8 callersMethodget_scheduler_config
(self, **kwargs)
diffusers/tests/schedulers/test_scheduler_flax.py:350
↓ 8 callersMethodget_scheduler_config
(self, **kwargs)
diffusers/tests/schedulers/test_scheduler_flax.py:635
↓ 8 callersMethodget_sd_image
(self, seed=0, shape=(4, 3, 512, 512), fp16=False)
diffusers/tests/models/autoencoders/test_models_vae.py:570
↓ 8 callersMethodget_sd_vae_model
(self, model_id="CompVis/stable-diffusion-v1-4", fp16=False)
diffusers/tests/models/autoencoders/test_models_vae.py:575
↓ 8 callersMethodload_attn_procs
r""" Load pretrained attention processor layers into [`UNet2DConditionModel`]. Attention processor layers have to be defined in
diffusers/src/diffusers/loaders/unet.py:75
↓ 8 callersFunctionload_hf_numpy
(path)
diffusers/src/diffusers/utils/testing_utils.py:586
↓ 8 callersFunctionload_img_and_kps
(idx, files, kps, img_size=224, edge=False)
C_score/utils/utils_correspondence.py:339
↓ 8 callersMethodload_lora_into_unet
This will load the LoRA layers specified in `state_dict` into `unet`. Parameters: state_dict (`dict`): A
diffusers/src/diffusers/loaders/lora.py:371
↓ 8 callersFunctionnocaps_aggregation_result
(results, metric, args=None)
llava/eval/lmms-eval/lmms_eval/tasks/nocaps/utils.py:44
↓ 8 callersMethodnormalize
(self, x_in, key)
diffusers/src/diffusers/experimental/rl/value_guided_sampling.py:71
↓ 8 callersMethodpost_init
(self, results: Dict[str, Any])
llava/eval/lmms-eval/lmms_eval/logging_utils.py:103
↓ 8 callersFunctionrefcoco_aggregation_result
(results, metric)
llava/eval/lmms-eval/lmms_eval/tasks/refcoco+/utils.py:51
↓ 8 callersFunctionrefcoco_aggregation_result
(results, metric)
llava/eval/lmms-eval/lmms_eval/tasks/refcoco/utils.py:51
↓ 8 callersFunctionrefcoco_aggregation_result
(results, metric)
llava/eval/lmms-eval/lmms_eval/tasks/refcocog/utils.py:51
↓ 8 callersFunctionrenew_resnet_paths
(old_list, n_shave_prefix_segments=0)
diffusers/scripts/convert_ddpm_original_checkpoint_to_diffusers.py:19
↓ 8 callersFunctionrun_test_in_subprocess
To run a test in a subprocess. In particular, this can avoid (GPU) memory issue. Args: test_case (`unittest.TestCase`):
diffusers/src/diffusers/utils/testing_utils.py:787
↓ 8 callersMethodsample
Draw the first `n` samples in order from the specified split. Used for tasks with "canonical" ordered fewshot examples, such as MMLU
llava/eval/lmms-eval/lmms_eval/api/samplers.py:59
↓ 8 callersMethodsave_attn_procs
r""" Save attention processor layers to a directory so that it can be reloaded with the [`~loaders.UNet2DConditionLoadersMixin.load_at
diffusers/src/diffusers/loaders/unet.py:400
↓ 8 callersFunctionscreenspot_aggregation_result
(results, metric)
llava/eval/lmms-eval/lmms_eval/tasks/screenspot/utils.py:41
↓ 8 callersMethodset_scheduler
(self, scheduler_type: str)
diffusers/examples/community/sd_text2img_k_diffusion.py:118
↓ 8 callersMethodstep_pred
Predict the sample from the previous timestep by reversing the SDE. This function propagates the diffusion process from the learned m
diffusers/src/diffusers/schedulers/scheduling_sde_ve.py:160
↓ 8 callersFunctiontextcaps_aggregation_result
(results, metric, args=None)
llava/eval/lmms-eval/lmms_eval/tasks/textcaps/utils.py:40
↓ 8 callersMethodto
(self, device)
diffusers/tests/pipelines/semantic_stable_diffusion/test_semantic_diffusion.py:112
↓ 7 callersMethod__init__
( self, conditioning_channels: int = 3, conditioning_channel_order: str = "rgb",
diffusers/src/diffusers/models/controlnet_xs.py:292
↓ 7 callersMethod__init__
(self, dim, eps: float, elementwise_affine: bool = True)
diffusers/src/diffusers/models/normalization.py:219
↓ 7 callersMethod__init__
( self, inp_channels: int, out_channels: int, kernel_size: Union[int, Tuple[in
diffusers/src/diffusers/models/resnet.py:400
↓ 7 callersMethod__init__
Construct a layernorm module in the T5 style. No bias and no subtraction of mean.
diffusers/src/diffusers/models/transformers/t5_film_transformer.py:383
↓ 7 callersMethod__init__
( self, in_channels: int = 3, out_channels: int = 3, down_block_types: Tuple[s
diffusers/src/diffusers/models/autoencoders/vae.py:71
↓ 7 callersMethod__init__
( self, prompts: List[str], words: [List[List[str]]], tokenizer, devic
diffusers/examples/community/pipeline_prompt2prompt.py:1026
↓ 7 callersMethod__init__
(self, args)
diffusers/benchmarks/base_classes.py:52
↓ 7 callersMethod_shape
(self, tensor: torch.Tensor, seq_len: int, bsz: int)
diffusers/src/diffusers/pipelines/latent_diffusion/pipeline_latent_diffusion.py:331
↓ 7 callersFunctionassign_to_checkpoint
This does the final conversion step: take locally converted weights and apply a global renaming to them. It splits attention layers, and take
diffusers/scripts/convert_ldm_original_checkpoint_to_diffusers.py:78
↓ 7 callersFunctionbackend_empty_cache
(device: str)
diffusers/src/diffusers/utils/testing_utils.py:969
↓ 7 callersMethodbenchmark
(self, args)
diffusers/benchmarks/base_classes.py:58
↓ 7 callersMethodcheck_over_configs
(self, time_step=0, **config)
diffusers/tests/schedulers/test_scheduler_deis.py:31
↓ 7 callersFunctiondevice_view
(t)
diffusers/examples/community/stable_diffusion_tensorrt_inpaint.py:91
↓ 7 callersFunctiondevice_view
(t)
diffusers/examples/community/stable_diffusion_tensorrt_img2img.py:91
↓ 7 callersMethoddoc_to_choice
(self, doc: Any)
llava/eval/lmms-eval/lmms_eval/api/task.py:914
↓ 7 callersFunctiondownload_diffusers_config
(repo_id, tmpdir)
diffusers/tests/single_file/single_file_testing_utils.py:29
↓ 7 callersFunctiondownload_original_config
(config_url, tmpdir)
diffusers/tests/single_file/single_file_testing_utils.py:20
↓ 7 callersMethodforward
Args: img_tensor: should be a batch of torch tensors in the shape of [B, C, H, W] prompt: the prompt to use, a string
llava/model/multimodal_encoder/diffLVLM/src/models/dift_sd.py:240
↓ 7 callersMethodforward
(self, x)
C_score/model_utils/resnet.py:139
↓ 7 callersMethodfrom_pretrained
r""" Instantiate a pretrained MultiAdapter model from multiple pre-trained adapter models. The model is set in evaluation mode by def
diffusers/src/diffusers/models/adapter.py:146
↓ 7 callersMethodfrom_unet2d
( cls, unet: UNet2DConditionModel, motion_adapter: Optional[MotionAdapter] = None,
diffusers/src/diffusers/models/unets/unet_motion_model.py:432
↓ 7 callersMethodfull_loop
(self, scheduler=None, **config)
diffusers/tests/schedulers/test_scheduler_dpm_multi_inverse.py:95
↓ 7 callersMethodget_dummy_components
(self)
diffusers/tests/pipelines/stable_diffusion_2/test_stable_diffusion.py:80
↓ 7 callersMethodget_dummy_components
(self)
diffusers/tests/pipelines/audioldm/test_audioldm.py:66
↓ 7 callersMethodget_dummy_components
(self, skip_first_text_encoder=False)
diffusers/tests/pipelines/controlnet/test_controlnet_sdxl_img2img.py:67
↓ 7 callersMethodget_dummy_components
(self)
diffusers/tests/pipelines/stable_diffusion_panorama/test_stable_diffusion_panorama.py:60
↓ 7 callersMethodget_dummy_components
(self, time_cond_proj_dim=None)
diffusers/tests/pipelines/stable_diffusion/test_stable_diffusion_inpaint.py:118
↓ 7 callersMethodget_dummy_components
(self)
diffusers/tests/pipelines/animatediff/test_animatediff.py:53
↓ 7 callersMethodget_dummy_components
(self)
diffusers/tests/pipelines/pia/test_pia.py:56
↓ 7 callersMethodget_dummy_components
(self)
diffusers/tests/pipelines/controlnet_xs/test_controlnetxs_sdxl.py:75
↓ 7 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/lora/test_lora_layers_sd3.py:115
↓ 7 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/stable_diffusion_xl/test_stable_diffusion_xl_img2img.py:600
↓ 7 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/musicldm/test_musicldm.py:159
↓ 7 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/audioldm/test_audioldm.py:138
↓ 7 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/controlnet/test_controlnet.py:385
↓ 7 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/kandinsky2_2/test_kandinsky_combined.py:68
↓ 7 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/stable_diffusion_panorama/test_stable_diffusion_panorama.py:109
↓ 7 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/pixart_sigma/test_pixart.py:90
↓ 7 callersMethodget_dummy_inputs
(self, seed=0)
diffusers/tests/pipelines/stable_diffusion/test_onnx_stable_diffusion_img2img.py:48
↓ 7 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/kandinsky/test_kandinsky_combined.py:63
↓ 7 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/audioldm2/test_audioldm2.py:193
↓ 7 callersMethodget_input_embeddings
(self)
llava/model/language_model/mpt/modeling_mpt.py:81
↓ 7 callersMethodget_inputs
(self, device, generator_device="cpu", dtype=torch.float32, seed=0)
diffusers/tests/pipelines/audioldm/test_audioldm.py:386
↓ 7 callersMethodget_scheduler_config
(self, **kwargs)
diffusers/tests/schedulers/test_scheduler_pndm.py:14
↓ 7 callersMethodget_scheduler_config
(self, **kwargs)
diffusers/tests/schedulers/test_scheduler_tcd.py:12
↓ 7 callersMethodget_scheduler_config
(self, **kwargs)
diffusers/tests/schedulers/test_scheduler_dpm_multi_inverse.py:14
↓ 7 callersMethodget_scheduler_config
(self, **kwargs)
diffusers/tests/schedulers/test_scheduler_consistency_model.py:12
↓ 7 callersFunctionis_peft_version
Args: Compares the current PEFT version to a given reference with an operation. operation (`str`): A string representatio
diffusers/src/diffusers/utils/import_utils.py:707
↓ 7 callersMethodpost_process_latents
(self, prior_latents)
diffusers/src/diffusers/models/transformers/prior_transformer.py:378
↓ 7 callersFunctionrefcoco_bbox_rec_aggregation_result
Aggregate the results of the RefCOCO evaluation task using the specified metric. Args: - results (list of dict): List of result dictiona
llava/eval/lmms-eval/lmms_eval/tasks/refcoco+/utils_rec.py:164
↓ 7 callersFunctionrefcoco_bbox_rec_aggregation_result
Aggregate the results of the RefCOCO evaluation task using the specified metric. Args: - results (list of dict): List of result dictiona
llava/eval/lmms-eval/lmms_eval/tasks/refcoco/utils_rec.py:164
↓ 7 callersFunctionrefcoco_bbox_rec_aggregation_result
Aggregate the results of the RefCOCO evaluation task using the specified metric. Args: - results (list of dict): List of result dictiona
llava/eval/lmms-eval/lmms_eval/tasks/refcocog/utils_rec.py:164
↓ 7 callersFunctionrenew_attention_paths
Updates paths inside attentions to the new naming scheme (local renaming)
diffusers/scripts/convert_i2vgen_to_diffusers.py:79
↓ 7 callersFunctionrenew_attention_paths
Updates paths inside attentions to the new naming scheme (local renaming)
diffusers/scripts/convert_ms_text_to_video_to_diffusers.py:75
↓ 7 callersFunctionscreenspot_rec_aggregation_result
Aggregate the results of the screenspot evaluation task using the specified metric. Args: - results (list of dict): List of result dicti
llava/eval/lmms-eval/lmms_eval/tasks/screenspot/utils_rec.py:128
↓ 7 callersFunctionsegment
(a, n)
diffusers/src/diffusers/pipelines/deprecated/spectrogram_diffusion/midi_utils.py:339
↓ 7 callersFunctionshave_segments
Removes segments. Positive values shave the first segments, negative shave the last segments.
diffusers/src/diffusers/pipelines/stable_diffusion/convert_from_ckpt.py:69
↓ 7 callersMethodsigma_to_t
Gets scaled timesteps from the Karras sigmas for input to the consistency model. Args: sigmas (`float` or `np.ndarray`):
diffusers/src/diffusers/schedulers/scheduling_consistency_models.py:154
↓ 7 callersMethodstep_correct
Correct the predicted sample based on the `model_output` of the network. This is often run repeatedly after making the prediction for
diffusers/src/diffusers/schedulers/scheduling_sde_ve.py:228
↓ 7 callersMethodtest_docs
:return: Iterable[obj] A iterable of any object, that doc_to_text can handle
llava/eval/lmms-eval/lmms_eval/api/task.py:295
↓ 7 callersFunctiontokenize_prompt
(tokenizer, prompt)
diffusers/examples/dreambooth/train_dreambooth_lora_sdxl.py:922
↓ 7 callersFunctiontokenize_prompt
(tokenizer, prompt, add_special_tokens=False)
diffusers/examples/advanced_diffusion_training/train_dreambooth_lora_sdxl_advanced.py:1155
↓ 7 callersFunctiontokenize_prompt
(tokenizer, prompt)
diffusers/examples/research_projects/scheduled_huber_loss_training/dreambooth/train_dreambooth_lora_sdxl.py:941
↓ 7 callersMethodunfuse_lora
r""" Reverses the effect of [`pipe.fuse_lora()`](https://huggingface.co/docs/diffusers/main/en/api/loaders#diffusers.loaders.LoraLoade
diffusers/src/diffusers/loaders/lora.py:828
↓ 7 callersMethodupcast_vae
(self)
diffusers/examples/community/pipeline_demofusion_sdxl.py:610
↓ 7 callersMethodvalidation_docs
:return: Iterable[obj] A iterable of any object, that doc_to_text can handle
llava/eval/lmms-eval/lmms_eval/api/task.py:288
↓ 6 callersMethod__init__
(self, in_dim, out_dim, hidden_dim, drop_p=0.1, eps=1e-12)
diffusers/src/diffusers/pipelines/blip_diffusion/modeling_blip2.py:340
↓ 6 callersMethod__init__
(self)
diffusers/src/diffusers/pipelines/shap_e/renderer.py:490
↓ 6 callersMethod__init__
(self, in_channels, out_channels, mode, enabled=True)
diffusers/src/diffusers/models/unets/unet_stable_cascade.py:114
↓ 6 callersMethod__init__
(self, in_channels=1024)
diffusers/scripts/convert_consistency_decoder.py:308
← previousnext →401–500 of 12,826, ranked by callers