Functions — github.com/BAAI-DCAI/SpatialBot

CodeHub MCPcopy Create free account

hub / github.com/BAAI-DCAI/SpatialBot / functions

Functions594 in github.com/BAAI-DCAI/SpatialBot

⨍ Functions 594◇ Types & classes 135↳ Endpoints 13

bunny/model/multimodal_encoder/siglip/siglip_encoder.py:184

(self, config: SigLipVisionConfig)

bunny/model/multimodal_encoder/siglip/siglip_encoder.py:274

(self, config: SigLipVisionConfig)

bunny/model/multimodal_encoder/siglip/siglip_encoder.py:347

(self, config: SigLipVisionConfig)

bunny/model/multimodal_encoder/siglip/siglip_encoder.py:427

(self, config: SigLipVisionConfig)

bunny/model/multimodal_encoder/siglip/siglip_encoder.py:482

(self, config: SigLipVisionConfig)

bunny/model/multimodal_encoder/siglip/siglip_encoder.py:508

(self, vision_tower, vision_tower_cfg, delay_load=False)

bunny/model/multimodal_encoder/siglip/siglip_encoder.py:559

(self, vision_tower, args, delay_load=False)

bunny/model/multimodal_encoder/eva_clip/eva_clip_encoder.py:9

(self, mean=None, std=None)

bunny/model/multimodal_encoder/eva_clip/eva_clip_processors.py:22

(self, image_size=224, mean=None, std=None, min_scale=0.5, max_scale=1.0)

bunny/model/multimodal_encoder/eva_clip/eva_clip_processors.py:34

( self, dim, pt_seq_len, ft_seq_len=None, custom_f

bunny/model/multimodal_encoder/eva_clip/eva_vit.py:38

(self, prob, exclude_first_token=True)

bunny/model/multimodal_encoder/eva_clip/eva_vit.py:112

(self, drop_prob=None)

bunny/model/multimodal_encoder/eva_clip/eva_vit.py:180

(self, in_features, hidden_features=None, out_features=None, act_layer=nn.SiLU, drop=0., norm

bunny/model/multimodal_encoder/eva_clip/eva_vit.py:227

( self, dim, num_heads=8, qkv_bias=False, qk_scale=None, attn_drop=0., proj_drop=0., w

bunny/model/multimodal_encoder/eva_clip/eva_vit.py:253

(self, dim, num_heads, mlp_ratio=4., qkv_bias=False, qk_scale=None, drop=0., attn_drop=0., dr

bunny/model/multimodal_encoder/eva_clip/eva_vit.py:395

(self, img_size=224, patch_size=16, in_chans=3, embed_dim=768)

bunny/model/multimodal_encoder/eva_clip/eva_vit.py:458

(self, window_size, num_heads)

bunny/model/multimodal_encoder/eva_clip/eva_vit.py:481

(self, img_size=224, patch_size=16, in_chans=3, num_classes=1000, embed_dim=768, depth=12, nu

bunny/model/multimodal_encoder/eva_clip/eva_vit.py:520

(self, vision_tower_path)

bunny/model/multimodal_encoder/eva_clip/eva_vit.py:815

(self, questions, image_folder, tokenizer, image_processor, model_config)

bunny/eval/model_vqa_loader.py:32

(self, questions, image_folder, tokenizer, image_processor, model_config)

bunny/eval/model_vqa_loader_depth.py:35

(self, *args, **kwargs)

bunny/eval/m4c_evaluator.py:178

bunny/eval/m4c_evaluator.py:222

bunny/eval/m4c_evaluator.py:261

bunny/eval/m4c_evaluator.py:277

bunny/eval/m4c_evaluator.py:302

( self, batch_size: int, world_size: int, lengths: Optional[Li

bunny/train/bunny_trainer.py:100

(self, logger, log_level=logging.INFO)

bunny/util/utils.py:71

(self, data_path: str, tokenizer: transformers.PreTrainedTokenizer, data_arg

bunny/util/data_utils.py:798

(self, keywords, tokenizer, input_ids)

bunny/util/mm_utils.py:114

bunny/train/bunny_trainer.py:120

bunny/eval/model_vqa_loader.py:62

bunny/eval/model_vqa_loader_depth.py:87

bunny/train/bunny_trainer.py:117

bunny/util/data_utils.py:817

Method__setstate__

bunny/model/language_model/llama/tokenization_llama.py:216

Method_convert_id_to_token

Converts an index (integer) in a token (str) using the vocab.

bunny/model/language_model/qwen2/tokenization_qwen2.py:284

Method_convert_id_to_token

Converts an index (integer) in a token (str) using the vocab.

bunny/model/language_model/llama/tokenization_llama.py:275

Method_convert_token_to_id

Converts a token (str) in an id using the vocab.

bunny/model/language_model/qwen2/tokenization_qwen2.py:279

Method_convert_token_to_id

Converts a token (str) in an id using the vocab.

bunny/model/language_model/llama/tokenization_llama.py:271

Method_get_train_sampler

bunny/train/bunny_trainer.py:132

Method_init_weights

bunny/model/language_model/qwen2/modeling_qwen2.py:831

Method_init_weights

bunny/model/language_model/phi/modeling_phi.py:719

Method_init_weights

bunny/model/language_model/llama/modeling_llama.py:1077

Method_init_weights

bunny/model/language_model/phi3/modeling_phi3.py:934

Method_init_weights

Initialize the weights

bunny/model/multimodal_encoder/siglip/siglip_encoder.py:332

Method_init_weights

bunny/model/multimodal_encoder/eva_clip/eva_vit.py:608

Method_reorder_cache

(past_key_values, beam_idx)

bunny/model/language_model/qwen2/modeling_qwen2.py:1274

Method_reorder_cache

(past_key_values, beam_idx)

bunny/model/language_model/phi/modeling_phi.py:1153

Method_reorder_cache

(past_key_values, beam_idx)

bunny/model/language_model/llama/modeling_llama.py:1616

Method_reorder_cache

(past_key_values, beam_idx)

bunny/model/language_model/phi3/modeling_phi3.py:1377

Method_reset_cache

bunny/model/language_model/llama/modeling_llama.py:1105

Method_save_checkpoint

(self, model, trial, metrics=None)

bunny/train/bunny_trainer.py:232

Method_set_cos_sin_cache

(self, seq_len, device, dtype)

bunny/model/language_model/phi/modeling_phi.py:126

Method_set_cos_sin_cache

(self, seq_len, device, dtype)

bunny/model/language_model/phi/modeling_phi.py:146

Method_setup_cache

(self, cache_cls, max_batch_size, max_cache_len: Optional[int] = None)

bunny/model/language_model/llama/modeling_llama.py:1088

Method_tokenize

Tokenize a string.

bunny/model/language_model/qwen2/tokenization_qwen2.py:268

Method_tokenize

Returns a tokenized string. We de-activated the `add_dummy_prefix` option, thus the sentencepiece internals will always strip any

bunny/model/language_model/llama/tokenization_llama.py:252

Methodadd_bos_token

bunny/model/language_model/llama/tokenization_llama_fast.py:177

Methodadd_eos_token

bunny/model/language_model/llama/tokenization_llama_fast.py:173

Functionadd_text

(state, text, image, image_process_mode, request: gr.Request)

bunny/serve/gradio_web_server.py:156

Functionbelongs

(element, group, question)

eval/gqa/eval_gqa.py:238

Methodbuild_inputs_with_special_tokens

(self, token_ids_0, token_ids_1=None)

bunny/model/language_model/llama/tokenization_llama_fast.py:272

Methodbuild_inputs_with_special_tokens

(self, token_ids_0, token_ids_1=None)

bunny/model/language_model/llama/tokenization_llama.py:332

Functioncall_bunny_engine_df

(args, sample, model, tokenizer=None, processor=None)

bunny/serve/calvin_infer.py:31

Functioncall_bunny_engine_df

(args, sample, model, tokenizer=None, processor=None)

bunny/serve/rtx_infer.py:30

Functioncall_bunny_engine_df

(args, sample, model, tokenizer=None, processor=None)

bunny/eval/eval_spatialbench.py:27

Functioncall_bunny_engine_df

(args, sample, model, tokenizer=None, processor=None)

bunny/eval/eval_rtx.py:27

Methodcan_save_slow_tokenizer

bunny/model/language_model/llama/tokenization_llama_fast.py:143

Functionclear_history

(request: gr.Request)

bunny/serve/gradio_web_server.py:122

FunctioncomputeGroundingScore

(question, sceneGraph, attentionMap)

eval/gqa/eval_gqa.py:321

bunny/model/multimodal_projector/builder.py:18

bunny/model/multimodal_encoder/clip/clip_encoder.py:64

Methodconvert_tokens_to_string

Converts a sequence of tokens (string) in a single string.

bunny/model/language_model/qwen2/tokenization_qwen2.py:289

Methodconvert_tokens_to_string

Converts a sequence of tokens (string) in a single string.

bunny/model/language_model/llama/tokenization_llama.py:280

Methodcos_cached

bunny/model/language_model/llama/modeling_llama.py:400

Methodcreate_optimizer

Setup the optimizer. We provide a reasonable default that works well. If you want to use something else, you can pass a tuple in the

bunny/train/bunny_trainer.py:147

Methodcreate_token_type_ids_from_sequences

Creates a mask from the two sequences passed to be used in a sequence-pair classification task. An ALBERT sequence pair mask has the

bunny/model/language_model/llama/tokenization_llama.py:380

Methodcrop_size

bunny/model/multimodal_encoder/eva_clip/eva_clip_processors.py:67

Methoddefault_chat_template

LLaMA uses [INST] and [/INST] to indicate user messages, and <<SYS>> and <</SYS>> to indicate system messages. Assistant messages do

bunny/model/language_model/llama/tokenization_llama_fast.py:211

Methoddefault_chat_template

LLaMA uses [INST] and [/INST] to indicate user messages, and <<SYS>> and <</SYS>> to indicate system messages. Assistant messages do

bunny/model/language_model/llama/tokenization_llama.py:414

bunny/model/multimodal_encoder/siglip/siglip_encoder.py:616

bunny/model/multimodal_encoder/eva_clip/eva_clip_encoder.py:47

bunny/model/multimodal_encoder/eva_clip/eva_vit.py:850

Functiondownvote_last_response

(state, model_selector, request: gr.Request)

bunny/serve/gradio_web_server.py:100

bunny/model/multimodal_encoder/clip/clip_encoder.py:56

bunny/model/multimodal_encoder/siglip/siglip_encoder.py:611

bunny/model/multimodal_encoder/eva_clip/eva_clip_encoder.py:43

bunny/model/multimodal_encoder/eva_clip/eva_vit.py:846

Methoddummy_feature

bunny/model/multimodal_encoder/clip/clip_encoder.py:52

Methoddummy_feature

bunny/model/multimodal_encoder/siglip/siglip_encoder.py:607

Methodeval_pred_list

(self, pred_list)

bunny/eval/m4c_evaluator.py:248

Methodeval_pred_list

(self, pred_list)

bunny/eval/m4c_evaluator.py:264

Methodeval_pred_list

(self, pred_list)

bunny/eval/m4c_evaluator.py:289

Methodeval_pred_list

(self, pred_list)

bunny/eval/m4c_evaluator.py:321

Methodexpand2square

(pil_img, background_color=(122, 116, 104))

bunny/conversation.py:145

Methodexpand2square

(pil_img, background_color)

bunny/util/data_utils.py:915

Methodextra_repr

bunny/model/multimodal_encoder/eva_clip/eva_vit.py:187

Functionfetch_images_parallel

eval/seed-bench/extract_video_frames.py:99

← previous next →301–400 of 594, ranked by callers