MCPcopy Create free account

hub / github.com/bronyayang/Law_of_Vision_Representation_in_MLLMs / functions

Functions12,826 in github.com/bronyayang/Law_of_Vision_Representation_in_MLLMs

↓ 3 callersMethodencode_prompt
r""" Encodes the prompt into text encoder hidden states. Args: prompt (`str` or `List[str]`, *optional*):
diffusers/src/diffusers/pipelines/deprecated/stable_diffusion_variants/pipeline_stable_diffusion_pix2pix_zero.py:406
↓ 3 callersMethodencode_prompt
r""" Encodes the prompt into text encoder hidden states. Args: prompt (`str` or `List[str]`, *optional*):
diffusers/src/diffusers/pipelines/deprecated/stable_diffusion_variants/pipeline_cycle_diffusion.py:284
↓ 3 callersMethodeval_result
(self, results, eval_method)
llava/eval/lmms-eval/lmms_eval/tasks/mmbench/mmbench_evals.py:242
↓ 3 callersFunctionexpand_first
(feat: torch.Tensor, scale: float = 1.0)
diffusers/examples/community/pipeline_sdxl_style_aligned.py:138
↓ 3 callersMethodextract_descriptors
extract descriptors from the model :param batch: batch to extract descriptors for. Has shape BxCxHxW. :param layers: layer to
C_score/model_utils/extractor_dino.py:316
↓ 3 callersMethodfreeze_base_params
Freeze the weights of the parts belonging to the base UNet2DConditionModel, and leave everything else unfrozen for fine tuning.
diffusers/src/diffusers/models/controlnet_xs.py:1818
↓ 3 callersFunctionfreeze_params
(params)
diffusers/examples/research_projects/intel_opts/textual_inversion/textual_inversion_bf16.py:358
↓ 3 callersMethodfrom_modules
(cls, base_upblock: CrossAttnUpBlock2D, ctrl_upblock: UpBlockControlNetXSAdapter)
diffusers/src/diffusers/models/controlnet_xs.py:1760
↓ 3 callersMethodfull_loop
(self, **config)
diffusers/tests/schedulers/test_scheduler_heun.py:44
↓ 3 callersMethodfull_loop
(self, **config)
diffusers/tests/schedulers/test_scheduler_flax.py:361
↓ 3 callersMethodfull_loop
(self, **config)
diffusers/tests/schedulers/test_scheduler_flax.py:767
↓ 3 callersFunctiongenerate_images
(pipeline, prompt="", guidance_scale=7.5, num_inference_steps=50, num_images_per_prompt=1, seed=42)
diffusers/examples/research_projects/intel_opts/textual_inversion_dfq/textual_inversion.py:421
↓ 3 callersMethodgenerate_mask
r""" Generate a latent mask given a mask prompt, a target prompt, and an image. Args: image (`PIL.Image.Image`):
diffusers/src/diffusers/pipelines/stable_diffusion_diffedit/pipeline_stable_diffusion_diffedit.py:831
↓ 3 callersFunctionget_2d_sincos_pos_embed
grid_size: int of the grid height and width return: pos_embed: [grid_size*grid_size, embed_dim] or [1+grid_size*grid_size, embed_dim] (w/ or
diffusers/src/diffusers/models/embeddings.py:70
↓ 3 callersMethodget_active_adapters
Gets the list of the current active adapters. Example: ```python from diffusers import DiffusionPipeline p
diffusers/src/diffusers/loaders/lora.py:1073
↓ 3 callersFunctionget_discretization_steps
Calculates the current discretization steps at global step k using the discretization curriculum N(k).
diffusers/examples/research_projects/consistency_training/train_cm_ct_unconditional.py:91
↓ 3 callersMethodget_dummy_components
(self)
diffusers/tests/pipelines/stable_diffusion_3/test_pipeline_stable_diffusion_3_img2img.py:40
↓ 3 callersMethodget_dummy_components
(self)
diffusers/tests/pipelines/controlnet/test_controlnet.py:294
↓ 3 callersMethodget_dummy_components
(self, skip_first_text_encoder=False, time_cond_proj_dim=None)
diffusers/tests/pipelines/ledits_pp/test_ledits_pp_stable_diffusion_xl.py:58
↓ 3 callersMethodget_dummy_components
(self)
diffusers/tests/pipelines/ledits_pp/test_ledits_pp_stable_diffusion.py:49
↓ 3 callersMethodget_dummy_components
(self)
diffusers/tests/pipelines/stable_cascade/test_stable_cascade_prior.py:140
↓ 3 callersMethodget_dummy_components
(self)
diffusers/tests/pipelines/stable_diffusion_ldm3d/test_stable_diffusion_ldm3d.py:45
↓ 3 callersMethodget_dummy_components
(self)
diffusers/tests/pipelines/wuerstchen/test_wuerstchen_prior.py:128
↓ 3 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/kandinsky2_2/test_kandinsky_inpaint.py:205
↓ 3 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/kandinsky2_2/test_kandinsky_combined.py:192
↓ 3 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/kandinsky2_2/test_kandinsky_combined.py:313
↓ 3 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/kandinsky2_2/test_kandinsky_prior.py:193
↓ 3 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/stable_cascade/test_stable_cascade_combined.py:162
↓ 3 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/stable_cascade/test_stable_cascade_decoder.py:154
↓ 3 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/kandinsky/test_kandinsky_inpaint.py:227
↓ 3 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/kandinsky/test_kandinsky.py:211
↓ 3 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/kandinsky/test_kandinsky_img2img.py:233
↓ 3 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/kandinsky/test_kandinsky_combined.py:171
↓ 3 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/kandinsky/test_kandinsky_combined.py:280
↓ 3 callersMethodget_dummy_inputs
(self, device="cpu", seed=0)
diffusers/tests/pipelines/paint_by_example/test_paint_by_example.py:101
↓ 3 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/wuerstchen/test_wuerstchen_combined.py:154
↓ 3 callersMethodget_dummy_inputs
(self, device, seed=0)
diffusers/tests/pipelines/controlnet_xs/test_controlnetxs.py:208
↓ 3 callersMethodget_dummy_inversion_inputs
(self, device, seed=0)
diffusers/tests/pipelines/ledits_pp/test_ledits_pp_stable_diffusion_xl.py:160
↓ 3 callersMethodget_dummy_inversion_inputs
(self, device, seed=0)
diffusers/tests/pipelines/ledits_pp/test_ledits_pp_stable_diffusion.py:110
↓ 3 callersMethodget_dummy_sample
(self, input_type)
diffusers/tests/others/test_video_processor.py:31
↓ 3 callersMethodget_dummy_unet
For some tests we also need the underlying UNet. For these, we'll build the UNetControlNetXSModel from the UNet and ControlNetXS-Adapter
diffusers/tests/models/unets/test_models_unet_controlnetxs.py:87
↓ 3 callersMethodget_empty_store
()
diffusers/src/diffusers/pipelines/stable_diffusion_attend_and_excite/pipeline_stable_diffusion_attend_and_excite.py:84
↓ 3 callersMethodget_empty_store
()
diffusers/examples/community/pipeline_prompt2prompt.py:969
↓ 3 callersMethodget_extended_attention_mask
Makes broadcastable attention and causal masks so that future and masked tokens are ignored. Arguments: attention_mask (
diffusers/src/diffusers/pipelines/blip_diffusion/modeling_blip2.py:468
↓ 3 callersMethodget_generator
(self, seed=0)
diffusers/tests/models/autoencoders/test_models_vae.py:589
↓ 3 callersMethodget_inputs
(self, device, seed=0, generate_latents=False)
diffusers/tests/pipelines/unidiffuser/test_unidiffuser.py:714
↓ 3 callersMethodget_inputs
(self, generator_device="cpu", seed=0)
diffusers/tests/pipelines/stable_diffusion/test_stable_diffusion.py:1474
↓ 3 callersMethodget_inputs
(self, device, generator_device="cpu", dtype=torch.float32, seed=0)
diffusers/tests/pipelines/stable_diffusion_image_variation/test_stable_diffusion_image_variation.py:177
↓ 3 callersMethodget_inputs
(self, device, generator_device="cpu", dtype=torch.float32, seed=0)
diffusers/tests/pipelines/audioldm2/test_audioldm2.py:506
↓ 3 callersFunctionget_length_grouped_indices
(lengths, batch_size, world_size, generator=None, merge=True)
llava/train/llava_trainer.py:104
↓ 3 callersMethodget_minmax_dims
(self, batch_size, image_height, image_width, static_batch, static_shape)
diffusers/examples/community/stable_diffusion_tensorrt_txt2img.py:267
↓ 3 callersFunctionget_model_modules
Get the model modules inside the transformers library.
diffusers/utils/check_repo.py:231
↓ 3 callersFunctionget_models
Get the objects in module that are models.
diffusers/utils/check_repo.py:270
↓ 3 callersFunctionget_params_to_save
(params)
diffusers/examples/dreambooth/train_dreambooth_flax.py:320
↓ 3 callersFunctionget_params_to_save
(params)
diffusers/examples/text_to_image/train_text_to_image_flax.py:257
↓ 3 callersMethodget_pipeline_components
(self)
diffusers/tests/pipelines/test_pipelines_common.py:1833
↓ 3 callersFunctionget_pred_idx
Get the index (e.g. 2) from the prediction (e.g. 'C')
llava/eval/eval_science_qa_gpt4_requery.py:30
↓ 3 callersMethodget_sd_vae_model
(self, model_id="hf-internal-testing/taesd-diffusers", fp16=False)
diffusers/tests/models/autoencoders/test_models_vae.py:498
↓ 3 callersMethodget_timesteps
(self, num_inference_steps, strength, device)
diffusers/examples/community/rerender_a_video.py:521
↓ 3 callersMethodget_vision_tower
(self)
llava/model/llava_arch.py:257
↓ 3 callersMethodhas_training_docs
Whether the task has a training set
llava/eval/lmms-eval/lmms_eval/api/task.py:267
↓ 3 callersFunctionhash_args
(attr, args)
llava/eval/lmms-eval/lmms_eval/api/model.py:113
↓ 3 callersFunctionhb_aggregation_result
(results, metric, args)
llava/eval/lmms-eval/lmms_eval/tasks/hallusion_bench/evaluate_hb.py:36
↓ 3 callersFunctionhb_aggregation_result_intern
(results, metric)
llava/eval/lmms-eval/lmms_eval/tasks/hallusion_bench/evaluate_hb.py:81
↓ 3 callersFunctionimport_model_class_from_model_name_or_path
( pretrained_model_name_or_path: str, revision: str, subfolder: str = "text_encoder" )
diffusers/examples/dreambooth/train_dreambooth_sd3.py:193
↓ 3 callersFunctionimport_model_class_from_model_name_or_path
( pretrained_model_name_or_path: str, revision: str, subfolder: str = "text_encoder" )
diffusers/examples/dreambooth/train_dreambooth_lora_sd3.py:197
↓ 3 callersMethodindex_for_timestep
(self, timestep, schedule_timesteps=None)
diffusers/src/diffusers/schedulers/scheduling_euler_discrete.py:471
↓ 3 callersFunctioninfer_diffusers_model_type
(checkpoint)
diffusers/src/diffusers/loaders/single_file_utils.py:433
↓ 3 callersMethodinit_index
(self)
diffusers/examples/research_projects/rdm/retriever.py:80
↓ 3 callersMethodinvert
r""" The function to the pipeline for image inversion as described by the [LEDITS++ Paper](https://arxiv.org/abs/2301.12247). If the s
diffusers/src/diffusers/pipelines/ledits_pp/pipeline_leditspp_stable_diffusion_xl.py:1433
↓ 3 callersFunctionis_clip_sdxl_model
(checkpoint)
diffusers/src/diffusers/loaders/single_file_utils.py:372
↓ 3 callersFunctionis_higher_better
(metric_name)
llava/eval/lmms-eval/lmms_eval/api/registry.py:135
↓ 3 callersMethodis_none
(self, value)
llava/eval/lmms-eval/lmms_eval/tasks/mmupd/mmupd_evals.py:111
↓ 3 callersFunctionis_tensorboard_available
()
diffusers/src/diffusers/utils/import_utils.py:402
↓ 3 callersFunctionis_valid_image
(image)
diffusers/src/diffusers/image_processor.py:41
↓ 3 callersFunctionis_valid_image_imagelist
(images)
diffusers/src/diffusers/image_processor.py:45
↓ 3 callersFunctionload
(module: torch.nn.Module, prefix: str = "")
diffusers/src/diffusers/models/model_loading_utils.py:173
↓ 3 callersMethodload_motion_modules
(self, motion_adapter: Optional[MotionAdapter])
diffusers/src/diffusers/models/unets/unet_motion_model.py:582
↓ 3 callersFunctionload_pt
(url: str)
diffusers/src/diffusers/utils/testing_utils.py:427
↓ 3 callersFunctionmaybe_zero_3
(param, ignore_status=False, name=None)
llava/train/train.py:172
↓ 3 callersFunctionmaybe_zero_3
(param, ignore_status=False, name=None)
llava/train/train_switch.py:109
↓ 3 callersMethodmerge
Returns a new pipeline object of the class 'DiffusionPipeline' with the merged checkpoints(weights) of the models passed in the argum
diffusers/examples/community/checkpoint_merger.py:62
↓ 3 callersMethodnormalize_normals
(normals: torch.Tensor, eps: float = 1e-6)
diffusers/src/diffusers/pipelines/marigold/pipeline_marigold_normals.py:637
↓ 3 callersFunctionnormalize_str
Normalize the str to lower case and make them float numbers if possible. https://github.com/MMMU-Benchmark/MMMU/blob/51ce7f3e829c16bb44bc5445
llava/eval/lmms-eval/lmms_eval/tasks/mmmu/utils.py:357
↓ 3 callersFunctionnormalize_str
Normalize the str to lower case and make them float numbers if possible. https://github.com/MMMU-Benchmark/MMMU/blob/51ce7f3e829c16bb44bc5445
llava/eval/lmms-eval/lmms_eval/tasks/mmmu/utils_group_img.py:477
↓ 3 callersFunctionnumpy_to_pil
Convert a numpy image or a batch of images to a PIL image.
diffusers/src/diffusers/utils/pil_utils.py:37
↓ 3 callersFunctionposenc_nerf
Concatenate x and its positional encodings, following NeRF. Reference: https://arxiv.org/pdf/2210.04628.pdf
diffusers/src/diffusers/pipelines/shap_e/renderer.py:53
↓ 3 callersMethodprepare_image
( self, image, width, height, batch_size, num_images_per_promp
diffusers/examples/research_projects/promptdiffusion/pipeline_prompt_diffusion.py:760
↓ 3 callersMethodprepare_image_inputs
(self, image: Union[Image.Image, List[Image.Image]])
diffusers/src/diffusers/pipelines/controlnet/pipeline_flax_controlnet.py:194
↓ 3 callersMethodprepare_inputs_labels_for_multimodal
( self, input_ids, position_ids, attention_mask, past_key_values, labels, images, image_sizes=
llava/model/llava_arch.py:293
↓ 3 callersMethodprepare_latents
(self, shape, dtype, device, generator, latents, scheduler)
diffusers/src/diffusers/pipelines/unclip/pipeline_unclip.py:109
↓ 3 callersMethodprepare_latents
(self, shape, dtype, device, generator, latents, scheduler)
diffusers/examples/community/unclip_text_interpolation.py:111
↓ 3 callersMethodprepare_text_inputs
(self, prompt: Union[str, List[str]])
diffusers/src/diffusers/pipelines/controlnet/pipeline_flax_controlnet.py:180
↓ 3 callersFunctionpreprocess
Given a list of sources, each is a conversation list. This transform: 1. Add signal '### ' at the beginning each sentence, with end signal '\
llava/train/train.py:641
↓ 3 callersFunctionpreprocess_multimodal
( sources: Sequence[str], data_args: DataArguments )
llava/train/train.py:363
↓ 3 callersMethodpreprocess_pil
Preprocesses an image before extraction. :param image_path: path to image to be extracted. :param load_size: optional. Size t
C_score/model_utils/extractor_dino.py:182
↓ 3 callersMethodprocess_digit_article
(self, in_text)
llava/eval/lmms-eval/lmms_eval/tasks/_task_utils/vqa_eval_metric.py:193
↓ 3 callersFunctionprocess_features_and_mask
(model, aug, image, category=None, input_text=None, mask=False, raw=True)
C_score/model_utils/extractor_sd.py:230
↓ 3 callersFunctionprocess_image
(image, size)
diffusers/examples/amused/train_amused.py:379
↓ 3 callersMethodprocess_punctuation
(self, in_text)
llava/eval/lmms-eval/lmms_eval/tasks/_task_utils/vqa_eval_metric.py:183
← previousnext →1,001–1,100 of 12,826, ranked by callers