MCPcopy Create free account

hub / github.com/bronyayang/Law_of_Vision_Representation_in_MLLMs / functions

Functions12,826 in github.com/bronyayang/Law_of_Vision_Representation_in_MLLMs

↓ 18 callersMethodget_inputs
(self, device, generator_device="cpu", dtype=torch.float32, seed=0)
diffusers/tests/pipelines/stable_diffusion/test_stable_diffusion.py:851
↓ 18 callersMethodset_begin_index
Sets the begin index for the scheduler. This function should be run from pipeline before the inference. Args: begin_inde
diffusers/src/diffusers/schedulers/scheduling_lcm.py:289
↓ 18 callersMethodset_ip_adapter_scale
Set IP-Adapter scales per-transformer block. Input `scale` could be a single config or a list of configs for granular control over ea
diffusers/src/diffusers/loaders/ip_adapter.py:248
↓ 17 callersFunctionassign_to_checkpoint
This does the final conversion step: take locally converted weights and apply a global renaming to them. It splits attention layers, and take
diffusers/scripts/convert_svd_to_diffusers.py:117
↓ 17 callersMethodcheck_over_forward
(self, time_step=0, **forward_kwargs)
diffusers/tests/schedulers/test_schedulers.py:431
↓ 17 callersMethodget_dummy_components
(self, skip_first_text_encoder=False, time_cond_proj_dim=None)
diffusers/tests/pipelines/stable_diffusion_xl/test_stable_diffusion_xl_inpaint.py:75
↓ 17 callersMethodget_dummy_components
(self, time_cond_proj_dim=None)
diffusers/tests/pipelines/stable_diffusion_xl/test_stable_diffusion_xl.py:79
↓ 17 callersMethodget_processor
r""" Get the attention processor in use. Args: return_deprecated_lora (`bool`, *optional*, defaults to `False`):
diffusers/src/diffusers/models/attention_processor.py:431
↓ 17 callersMethodrestore
r""" Args: Restore the parameters stored with the `store` method. Useful to validate the model with EMA parameters without: af
diffusers/src/diffusers/training_utils.py:484
↓ 17 callersMethodstep_plms
Predict the sample from the previous timestep by reversing the SDE. This function propagates the sample with the linear multistep met
diffusers/src/diffusers/schedulers/scheduling_pndm.py:319
↓ 17 callersMethodstep_prk
Predict the sample from the previous timestep by reversing the SDE. This function propagates the sample with the Runge-Kutta method.
diffusers/src/diffusers/schedulers/scheduling_pndm.py:259
↓ 16 callersMethod__init__
(self, in_channels: int, out_channels: int, mid_channels: Optional[int] = None)
diffusers/src/diffusers/models/unets/unet_1d_blocks.py:562
↓ 16 callersMethod__init__
( self, in_channels: int, prev_output_channel: int, out_channels: int,
diffusers/src/diffusers/models/unets/unet_3d_blocks.py:833
↓ 16 callersMethod_load_ip_adapter_weights
(self, state_dicts, low_cpu_mem_usage=False)
diffusers/src/diffusers/loaders/unet.py:1017
↓ 16 callersFunctionassign_to_checkpoint
This does the final conversion step: take locally converted weights and apply a global renaming to them. It splits attention layers, and take
diffusers/scripts/convert_if.py:649
↓ 16 callersMethodencode_prompt
( self, tokenizers, text_encoders, prompt: str, num_images_per_prompt: int = 1, negative_prompt: str =
diffusers/tests/pipelines/test_pipelines_common.py:1966
↓ 16 callersMethodget_dummy_input
( self, include_temb=True, include_res_hidden_states_tuple=False, include_enco
diffusers/tests/models/unets/test_unet_blocks_common.py:46
↓ 16 callersMethodget_image_encoder
(self, repo_id, subfolder)
diffusers/tests/pipelines/ip_adapters/test_ip_adapter_stable_diffusion.py:65
↓ 16 callersFunctionget_timestep_embedding
This matches the implementation in Denoising Diffusion Probabilistic Models: Create sinusoidal timestep embeddings. :param timesteps: a 1-D
diffusers/src/diffusers/models/embeddings.py:27
↓ 16 callersFunctionis_bs4_available
()
diffusers/src/diffusers/utils/import_utils.py:414
↓ 16 callersFunctionis_ftfy_available
()
diffusers/src/diffusers/utils/import_utils.py:410
↓ 16 callersFunctionis_transformers_version
Args: Compares the current Transformers version to a given reference with an operation. operation (`str`): A string repre
diffusers/src/diffusers/utils/import_utils.py:679
↓ 16 callersFunctionmake_zero_conv
(in_channels, out_channels=None)
diffusers/src/diffusers/models/controlnet_xs.py:1924
↓ 15 callersFunction_get_model_file
( pretrained_model_name_or_path: Union[str, Path], *, weights_name: str, subfolder: Optional[s
diffusers/src/diffusers/utils/hub_utils.py:281
↓ 15 callersFunction_get_task_class
(mapping, pipeline_class_name, throw_error_if_not_exist: bool = True)
diffusers/src/diffusers/pipelines/auto_pipeline.py:160
↓ 15 callersMethod_sigma_to_alpha_sigma_t
(self, sigma)
diffusers/src/diffusers/schedulers/scheduling_dpmsolver_multistep_inverse.py:356
↓ 15 callersMethod_sigma_to_alpha_sigma_t
(self, sigma)
diffusers/src/diffusers/schedulers/scheduling_dpmsolver_multistep.py:468
↓ 15 callersMethod_test_save_load_optional_components
(self)
diffusers/tests/pipelines/deepfloyd_if/__init__.py:152
↓ 15 callersFunctionassign_to_checkpoint
This does the final conversion step: take locally converted weights and apply a global renaming to them. It splits attention layers, and take
diffusers/scripts/convert_i2vgen_to_diffusers.py:28
↓ 15 callersFunctionassign_to_checkpoint
This does the final conversion step: take locally converted weights and apply a global renaming to them. It splits attention layers, and take
diffusers/scripts/convert_ms_text_to_video_to_diffusers.py:24
↓ 15 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/stable_diffusion_xl/test_stable_diffusion_xl_img2img.py:184
↓ 15 callersFunctionis_peft_available
()
diffusers/src/diffusers/utils/import_utils.py:426
↓ 15 callersMethodprepare_inputs
(self, prompt: Union[str, List[str]])
diffusers/src/diffusers/pipelines/stable_diffusion/pipeline_flax_stable_diffusion.py:167
↓ 15 callersFunctionrank0_print
(*args)
llava/train/train.py:47
↓ 15 callersFunctionunwrap_model
(model)
diffusers/examples/text_to_image/train_text_to_image_lora_sdxl.py:713
↓ 15 callersFunctionunwrap_model
(model)
diffusers/examples/research_projects/scheduled_huber_loss_training/text_to_image/train_text_to_image_lora_sdxl.py:696
↓ 14 callersMethod_modify_inputs_for_ip_adapter_test
(self, inputs: Dict[str, Any])
diffusers/tests/pipelines/test_pipelines_common.py:253
↓ 14 callersMethod_sigma_to_alpha_sigma_t
(self, sigma)
diffusers/src/diffusers/schedulers/scheduling_dpmsolver_singlestep.py:422
↓ 14 callersFunctionadd_state_dict
(prefix, mod)
diffusers/scripts/convert_consistency_decoder.py:1047
↓ 14 callersFunctionassign_to_checkpoint
( paths, checkpoint, old_checkpoint, attention_paths_to_split=None, additional_replacements=None, config=N
diffusers/scripts/convert_ddpm_original_checkpoint_to_diffusers.py:56
↓ 14 callersMethodcheck_over_configs
(self, time_step=0, **config)
diffusers/tests/schedulers/test_scheduler_dpm_multi.py:41
↓ 14 callersFunctionconvert_unet_state_dict_to_peft
r""" Converts a state dict from UNet format to diffusers format - i.e. by removing some keys
diffusers/src/diffusers/utils/state_dict_utils.py:248
↓ 14 callersMethodget_dummy_components
(self)
diffusers/tests/pipelines/stable_video_diffusion/test_stable_video_diffusion.py:59
↓ 14 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/stable_diffusion_2/test_stable_diffusion_depth.py:163
↓ 14 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/controlnet/test_controlnet_sdxl.py:166
↓ 14 callersMethodget_dummy_inputs
(self, device, seed=0, img_res=64, output_pil=True)
diffusers/tests/pipelines/stable_diffusion/test_stable_diffusion_inpaint.py:168
↓ 14 callersMethodget_generator
(self, device, seed=0)
diffusers/tests/pipelines/text_to_video_synthesis/test_text_to_video_zero_sdxl.py:153
↓ 14 callersFunctionis_safetensors_compatible
Checking for safetensors compatibility: - By default, all models are saved with the default pytorch serialization, so we use the list of defa
diffusers/src/diffusers/pipelines/pipeline_loading_utils.py:92
↓ 14 callersMethodprepare_latents
( self, image: Image.Image, text_embeds: torch.Tensor, timesteps: torch.Tensor
diffusers/examples/community/edict_pipeline.py:138
↓ 14 callersMethodset_attn_processor
r""" Sets the attention processor to use to compute attention. Parameters: processor (`dict` of `AttentionProcessor` or o
diffusers/src/diffusers/pipelines/wuerstchen/modeling_wuerstchen_prior.py:91
↓ 14 callersMethodto_dict
dumps the current config as a dictionary object, as a printable format. null fields will not be printed. Used for dumping results alon
llava/eval/lmms-eval/lmms_eval/api/task.py:131
↓ 14 callersFunctionunwrap_model
(model)
diffusers/examples/dreambooth/train_dreambooth_sd3.py:1150
↓ 13 callersFunction_get_library_root_logger
()
diffusers/src/diffusers/utils/logging.py:73
↓ 13 callersMethod_get_signature_keys
(cls, obj)
diffusers/src/diffusers/pipelines/pipeline_utils.py:1555
↓ 13 callersFunctionassign_to_checkpoint
This does the final conversion step: take locally converted weights and apply a global renaming to them. It splits attention layers, and take
diffusers/scripts/convert_original_audioldm2_to_diffusers.py:156
↓ 13 callersFunctionassign_to_checkpoint
This does the final conversion step: take locally converted weights and apply a global renaming to them. It splits attention layers, and take
diffusers/scripts/convert_versatile_diffusion_to_diffusers.py:195
↓ 13 callersFunctionassign_to_checkpoint
This does the final conversion step: take locally converted weights and apply a global renaming to them. It splits attention layers, and take
diffusers/scripts/convert_original_audioldm_to_diffusers.py:149
↓ 13 callersFunctionassign_to_checkpoint
This does the final conversion step: take locally converted weights and apply a global renaming to them. It splits attention layers, and take
diffusers/scripts/convert_zero123_to_diffusers.py:143
↓ 13 callersFunctionassign_to_checkpoint
This does the final conversion step: take locally converted weights and apply a global renaming to them. It splits attention layers, and take
diffusers/scripts/convert_original_musicldm_to_diffusers.py:149
↓ 13 callersFunctionassign_to_checkpoint
This does the final conversion step: take locally converted weights and apply a global renaming to them. It splits attention layers, and take
diffusers/examples/research_projects/promptdiffusion/convert_original_promptdiffusion_to_diffusers.py:170
↓ 13 callersMethoddevice
r""" Returns: `torch.device`: The torch device on which the pipeline is located.
diffusers/src/diffusers/pipelines/pipeline_utils.py:449
↓ 13 callersMethodencode_prompt
r""" Encodes the prompt into text encoder hidden states. Args: prompt (`str` or `List[str]`, *optional*):
diffusers/examples/community/fresco_v2v.py:1416
↓ 13 callersMethodfull_loop
(self, scheduler=None, **config)
diffusers/tests/schedulers/test_scheduler_unipc.py:91
↓ 13 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/text_to_video_synthesis/test_text_to_video_zero_sdxl.py:135
↓ 13 callersMethodget_scheduler_config
(self)
diffusers/tests/schedulers/test_schedulers.py:355
↓ 13 callersFunctionis_torch_npu_available
()
diffusers/src/diffusers/utils/import_utils.py:346
↓ 13 callersMethodtransform
(example)
diffusers/examples/consistency_distillation/train_lcm_distill_sd_wds.py:164
↓ 12 callersMethod_maybe_convert_prompt
r""" Maybe convert a prompt into a "multi vector"-compatible prompt. If the prompt includes a token that corresponds to a multi-vector
diffusers/src/diffusers/loaders/textual_inversion.py:145
↓ 12 callersFunction_set_state_dict_into_text_encoder
Sets the `lora_state_dict` into `text_encoder` coming from `transformers`. Args: lora_state_dict: The state dictionary to be set.
diffusers/src/diffusers/training_utils.py:205
↓ 12 callersMethodcheck_dims
(self, batch_size, image_height, image_width)
diffusers/examples/community/stable_diffusion_tensorrt_inpaint.py:273
↓ 12 callersMethodcheck_dims
(self, batch_size, image_height, image_width)
diffusers/examples/community/stable_diffusion_tensorrt_img2img.py:273
↓ 12 callersMethodcheck_over_configs
(self, time_step=0, **config)
diffusers/tests/schedulers/test_scheduler_dpm_multi_inverse.py:34
↓ 12 callersMethodcreate
( cls, common: CommonSchedulerState, final_alpha_cumprod: jnp.ndarray, init_no
diffusers/src/diffusers/schedulers/scheduling_pndm_flax.py:53
↓ 12 callersMethoddownsample
Downsamples the provided mask tensor to match the expected dimensions for scaled dot-product attention. If the aspect ratio of the ma
diffusers/src/diffusers/image_processor.py:970
↓ 12 callersMethodget_dummy_components
(self, skip_first_text_encoder=False, time_cond_proj_dim=None)
diffusers/tests/pipelines/stable_diffusion_xl/test_stable_diffusion_xl_img2img.py:76
↓ 12 callersMethodget_dummy_inputs_with_latents
(self, device, seed=0)
diffusers/tests/pipelines/unidiffuser/test_unidiffuser.py:181
↓ 12 callersFunctionis_note_seq_available
()
diffusers/src/diffusers/utils/import_utils.py:394
↓ 12 callersFunctionload_pretrained_model
(model_path, model_base, model_name, load_8bit=False, load_4bit=False, device_map="auto", device="cuda")
llava/model/builder.py:27
↓ 12 callersMethodpush_to_hub
Upload model, scheduler, or pipeline files to the 🤗 Hugging Face Hub. Parameters: repo_id (`str`): The n
diffusers/src/diffusers/utils/hub_utils.py:531
↓ 12 callersFunctionrenew_resnet_paths
Updates paths inside resnets to the new naming scheme (local renaming)
diffusers/src/diffusers/pipelines/stable_diffusion/convert_from_ckpt.py:79
↓ 12 callersFunctionrenew_resnet_paths
Updates paths inside resnets to the new naming scheme (local renaming)
diffusers/scripts/convert_if.py:549
↓ 12 callersFunctionrenew_vae_resnet_paths
Updates paths inside resnets to the new naming scheme (local renaming)
diffusers/src/diffusers/pipelines/stable_diffusion/convert_from_ckpt.py:101
↓ 11 callersMethod__init__
( self, in_channels: int, prev_output_channel: int, out_channels: int,
diffusers/src/diffusers/pipelines/deprecated/versatile_diffusion/modeling_text_unet.py:1789
↓ 11 callersMethod_sigma_to_alpha_sigma_t
(self, sigma)
diffusers/src/diffusers/schedulers/scheduling_deis_multistep.py:337
↓ 11 callersMethod_test_inference_batch_consistent
( self, batch_sizes=[2], additional_params_copy_to_batched_inputs=["num_inference_steps"], batch_gener
diffusers/tests/pipelines/test_pipelines_common.py:1032
↓ 11 callersMethod_test_marigold_depth
( self, generator_seed: int = 0, expected_slice: np.ndarray = None, atol: floa
diffusers/tests/pipelines/marigold/test_marigold_depth.py:142
↓ 11 callersMethod_test_marigold_normals
( self, generator_seed: int = 0, expected_slice: np.ndarray = None, atol: floa
diffusers/tests/pipelines/marigold/test_marigold_normals.py:142
↓ 11 callersMethodcheck_over_configs
(self, time_step=0, **config)
diffusers/tests/schedulers/test_scheduler_dpm_single.py:39
↓ 11 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/controlnet/test_controlnet_sdxl_img2img.py:154
↓ 11 callersMethodget_encoder_hidden_states
(self, seed=0, shape=(4, 77, 768), fp16=False)
diffusers/tests/models/unets/test_models_unet_2d_condition.py:1245
↓ 11 callersMethodget_latents
(self, seed=0, shape=(4, 4, 64, 64), fp16=False)
diffusers/tests/models/unets/test_models_unet_2d_condition.py:1147
↓ 11 callersFunctionget_model_name_from_path
(model_path)
llava/mm_utils.py:120
↓ 11 callersMethodget_scheduler_config
(self, **kwargs)
diffusers/tests/schedulers/test_scheduler_lcm.py:16
↓ 11 callersMethodget_unet_model
(self, fp16=False, model_id="CompVis/stable-diffusion-v1-4")
diffusers/tests/models/unets/test_models_unet_2d_condition.py:1152
↓ 11 callersFunctionis_accelerate_version
Args: Compares the current Accelerate version to a given reference with an operation. operation (`str`): A string represe
diffusers/src/diffusers/utils/import_utils.py:693
↓ 11 callersFunctionis_torch_xla_available
()
diffusers/src/diffusers/utils/import_utils.py:342
↓ 11 callersMethodpostprocess_video
r""" Converts a video tensor to a list of frames for export. Args: video (`torch.Tensor`): The video as a tensor.
diffusers/src/diffusers/video_processor.py:89
↓ 11 callersMethodpreprocess
(self, img, return_tensors: Optional[str] = None, **kwargs)
llava/model/multimodal_encoder/diffLVLM/diffusion_encoder.py:36
↓ 11 callersMethodprogress_bar
(self, iterable=None, total=None)
diffusers/src/diffusers/pipelines/kandinsky2_2/pipeline_kandinsky2_2_combined.py:193
↓ 11 callersMethodset_attention_slice
r""" Enable sliced attention computation. When this option is enabled, the attention module splits the input tensor in slices to comp
diffusers/src/diffusers/models/controlnet.py:597
← previousnext →201–300 of 12,826, ranked by callers