MCPcopy Create free account

hub / github.com/apple/ml-ferret / functions

Functions522 in github.com/apple/ml-ferret

⨍ Functions 522◇ Types & classes 68↳ Endpoints 20
Functionadd_text
(state, text, image, image_process_mode, request: gr.Request)
ferretui/ferretui/serve/gradio_web_server.py:128
Functionclear_history
(request: gr.Request)
ferret/serve/gradio_web_server.py:215
Functionclear_history
(request: gr.Request)
ferretui/ferretui/serve/gradio_web_server.py:122
Methodconfig
(self)
ferret/model/multimodal_encoder/clip_encoder.py:111
Methodconfig
(self)
ferretui/ferretui/model/multimodal_projector/builder.py:14
Methodconfig
(self)
ferretui/ferretui/model/multimodal_encoder/clip_encoder.py:120
Methodcreate_optimizer
Setup the optimizer. We provide a reasonable default that works well. If you want to use something else, you can pass a tuple in the
ferretui/ferretui/train/ferret_trainer.py:157
Methoddevice
(self)
ferret/model/multimodal_encoder/clip_encoder.py:107
Methoddevice
(self)
ferretui/ferretui/model/multimodal_encoder/clip_encoder.py:116
Functiondownvote_last_response
(state, model_selector, request: gr.Request)
ferret/serve/gradio_web_server.py:193
Functiondownvote_last_response
(state, model_selector, request: gr.Request)
ferretui/ferretui/serve/gradio_web_server.py:100
Functiondraw
(input_mode, input, refer_input_state, refer_text_show, imagebox_refer)
ferret/serve/gradio_web_server.py:533
Methoddtype
(self)
ferret/model/multimodal_encoder/clip_encoder.py:103
Methoddtype
(self)
ferretui/ferretui/model/multimodal_encoder/clip_encoder.py:112
Methoddummy_feature
(self)
ferret/model/multimodal_encoder/clip_encoder.py:99
Methoddummy_feature
(self)
ferretui/ferretui/model/multimodal_encoder/clip_encoder.py:108
Methodevaluate
(self, annotation_file: str, prediction_file: str, verbose
ferret/eval/eval_flickr_entities.py:462
Methodexpand2square
(pil_img, background_color=(122, 116, 104))
ferret/conversation.py:123
Methodexpand2square
(pil_img, background_color)
ferret/train/train.py:963
Methodexpand2square
(pil_img, background_color=(122, 116, 104))
ferretui/ferretui/conversation.py:134
Methodexpand2square
(pil_img, background_color)
ferretui/ferretui/train/train.py:1684
Functionextract_coors
(s)
ferret/train/train.py:629
Functionextract_coors
(s)
ferretui/ferretui/train/train.py:1020
Functionfind_bbox_template
(text, img_w, img_h)
ferret/eval/model_flickr.py:90
Functionfind_bbox_template
(text, img_w, img_h)
ferret/eval/model_refcoco.py:86
Functionfind_bbox_template_v3
(text, img_w, img_h)
ferret/eval/model_pope.py:74
Functionflag_last_response
(state, model_selector, request: gr.Request)
ferret/serve/gradio_web_server.py:199
Functionflag_last_response
(state, model_selector, request: gr.Request)
ferretui/ferretui/serve/gradio_web_server.py:106
Functionforward
Input shape: Batch x Time x Channel attention_mask: [bsz, q_len]
ferret/train/llama_flash_attn_monkey_patch.py:15
Functionforward
( self, hidden_states: torch.Tensor, attention_mask: Optional[torch.Tensor] = None, position_i
ferretui/ferretui/train/llama_flash_attn_monkey_patch.py:16
Methodforward
(self, x)
ferret/model/ferret_arch.py:161
Methodforward
(self, feature_map, region_masks, original_dtype,
ferret/model/ferret_arch.py:221
Methodforward
( self, input_ids: torch.LongTensor = None, attention_mask: Optional[torch.Tensor] = N
ferret/model/language_model/ferret_llama.py:54
Methodforward
(self, images)
ferret/model/multimodal_encoder/clip_encoder.py:85
Methodforward
(self, x)
ferretui/ferretui/model/ferret_arch.py:170
Methodforward
(self, feature_map, region_masks, original_dtype,
ferretui/ferretui/model/ferret_arch.py:235
Methodforward
( self, input_ids: torch.LongTensor = None, attention_mask: Optional[torch.Tensor] = N
ferretui/ferretui/model/language_model/ferret_llama.py:57
Methodforward
( self, input_ids: torch.LongTensor = None, attention_mask: Optional[torch.Tensor] = N
ferretui/ferretui/model/language_model/ferret_gemma.py:60
Methodforward
( self, input_ids: Optional[torch.LongTensor] = None, past_key_values: Optional[Tuple[
ferretui/ferretui/model/language_model/ferret_mpt.py:60
Methodforward
(self, x, *args, **kwargs)
ferretui/ferretui/model/multimodal_projector/builder.py:10
Methodforward
(self, x)
ferretui/ferretui/model/multimodal_projector/builder.py:28
Methodforward
(self, images)
ferretui/ferretui/model/multimodal_encoder/clip_encoder.py:94
Methodforward
(self, images)
ferretui/ferretui/model/multimodal_encoder/clip_encoder.py:182
Methodforward_feature
(self, images)
ferretui/ferretui/model/multimodal_encoder/clip_encoder.py:176
Methodgenerate
( self, inputs: Optional[torch.Tensor] = None, images: Optional[torch.Tensor] = None,
ferretui/ferretui/model/language_model/ferret_gemma.py:114
Functiongenerate_stream
(request: Request)
ferret/serve/model_worker.py:305
Functiongenerate_stream
(request: Request)
ferretui/ferretui/serve/model_worker.py:232
Functiongenerate_stream
(request: Request)
ferretui/ferretui/serve/sglang_worker.py:202
Functionget_chunk
(lst, n, k)
ferret/eval/model_gpt4eval_3newclass.py:42
Methodget_model
(self)
ferret/model/language_model/ferret_llama.py:51
Methodget_model
(self)
ferretui/ferretui/model/language_model/ferret_mpt.py:53
Functionget_status
(request: Request)
ferret/serve/model_worker.py:321
Functionget_status
(request: Request)
ferretui/ferretui/serve/model_worker.py:248
Functionget_status
(request: Request)
ferretui/ferretui/serve/sglang_worker.py:218
Functionget_vision_tower_state_maybe_zero_3
(named_params, keys_to_match=[''])
ferretui/ferretui/train/train.py:205
Functionget_vision_tower_state_maybe_zero_3
(named_params, keys_to_match=[''])
ferretui/ferretui/train/ferret_trainer.py:19
Methodget_w
(weights, keyword)
ferret/model/ferret_arch.py:405
Methodget_w
(weights, keyword)
ferretui/ferretui/model/ferret_arch.py:471
Functionget_worker_address
(request: Request)
ferret/serve/controller.py:262
Functionget_worker_address
(request: Request)
ferretui/ferretui/serve/controller.py:262
Functionheart_beat_controller
(controller)
ferret/serve/controller.py:51
Functionheart_beat_controller
(controller)
ferretui/ferretui/serve/controller.py:51
Functionheart_beat_worker
(controller)
ferret/serve/model_worker.py:44
Functionheart_beat_worker
(controller)
ferretui/ferretui/serve/model_worker.py:37
Functionheart_beat_worker
(controller)
ferretui/ferretui/serve/sglang_worker.py:38
Methodhidden_size
(self)
ferret/model/multimodal_encoder/clip_encoder.py:118
Methodhidden_size
(self)
ferretui/ferretui/model/multimodal_encoder/clip_encoder.py:127
Methodhidden_size
(self)
ferretui/ferretui/model/multimodal_encoder/clip_encoder.py:194
Functionhttp_bot
(state, model_selector, temperature, top_p, max_new_tokens, refer_input_state, request: gr.Request)
ferret/serve/gradio_web_server.py:349
Functionhttp_bot
(state, model_selector, temperature, top_p, max_new_tokens, request: gr.Request)
ferretui/ferretui/serve/gradio_web_server.py:154
Methodids
(self)
ferret/eval/model_lvis.py:156
Methodids
(self)
ferret/eval/model_gpt4eval_3newclass.py:159
Methodids
(self)
ferret/eval/model_pope.py:116
Methodids
(self)
ferretui/ferretui/eval/model_UI.py:90
Methodlengths
(self)
ferretui/ferretui/train/train.py:1637
Functionlist_models
()
ferret/serve/controller.py:256
Functionlist_models
()
ferretui/ferretui/serve/controller.py:256
Functionload_demo
(url_params, request: gr.Request)
ferret/serve/gradio_web_server.py:141
Functionload_demo
(url_params, request: gr.Request)
ferretui/ferretui/serve/gradio_web_server.py:58
Functionload_demo_refresh_model_list
(request: gr.Request)
ferret/serve/gradio_web_server.py:161
Functionload_demo_refresh_model_list
(request: gr.Request)
ferretui/ferretui/serve/gradio_web_server.py:71
Methodload_model
(self, device_map=None)
ferretui/ferretui/model/multimodal_encoder/clip_encoder.py:161
Functionmake_inputs_require_grad
(module, input, output)
ferret/train/train.py:1215
Functionmake_inputs_require_grad
(module, input, output)
ferretui/ferretui/train/train.py:2035
Methodmodality_lengths
(self)
ferretui/ferretui/train/train.py:1646
Methodnum_patches
(self)
ferret/model/multimodal_encoder/clip_encoder.py:122
Methodnum_patches
(self)
ferretui/ferretui/model/multimodal_encoder/clip_encoder.py:135
Methodnum_patches_per_side
(self)
ferretui/ferretui/model/multimodal_encoder/clip_encoder.py:131
Functionpipeline
(s, prompt, max_tokens)
ferretui/ferretui/serve/sglang_worker.py:45
Functionplot_flickr
(img, boxes, entities, mode='pred')
ferret/eval/model_flickr.py:59
Functionplot_pope
(img, boxes, text)
ferret/eval/model_pope.py:57
Functionplot_refexp
(img, boxes, entities, mode='pred')
ferret/eval/model_refcoco.py:58
FunctionpopulateModels
(models)
ferretui/ferretui/eval/webpage/script.js:70
FunctionpopulateQuestions
(questions)
ferretui/ferretui/eval/webpage/script.js:81
Methodprepare_inputs_for_generation
( self, input_ids, past_key_values=None, attention_mask=None, inputs_embeds=None, **kwargs )
ferret/model/language_model/ferret_llama.py:116
Methodprepare_inputs_for_generation
(self, input_ids, past_key_values=None, inputs_embeds=None, **kwargs)
ferretui/ferretui/model/language_model/ferret_llama.py:150
Methodprepare_inputs_for_generation
(self, input_ids, past_key_values=None, inputs_embeds=None, **kwargs)
ferretui/ferretui/model/language_model/ferret_gemma.py:155
Methodprepare_inputs_for_generation
(self, input_ids, past_key_values=None, inputs_embeds=None, **kwargs)
ferretui/ferretui/model/language_model/ferret_mpt.py:87
Functionpretty_print_semaphore
(semaphore)
ferret/utils.py:123
Functionreceive_heart_beat
(request: Request)
ferret/serve/controller.py:269
← previousnext →401–500 of 522, ranked by callers