MCPcopy Create free account

hub / github.com/apple/ml-ferret / functions

Functions522 in github.com/apple/ml-ferret

⨍ Functions 522◇ Types & classes 68↳ Endpoints 20
↓ 2 callersFunctionpoint_sample
A wrapper around :function:`torch.nn.functional.grid_sample` to support 3D point_coords tensors. Unlike :function:`torch.nn.functional.grid_s
ferretui/ferretui/model/ferret_arch.py:56
↓ 2 callersFunctionpretty_print_semaphore
(semaphore)
ferretui/ferretui/utils.py:123
↓ 2 callersFunctionprocess_anyres_image
Process an image with variable resolutions. Args: image (PIL.Image.Image): The input image to be processed. processor: The i
ferretui/ferretui/mm_utils.py:121
↓ 2 callersFunctionrank0_print
(*args)
ferret/train/train.py:55
↓ 2 callersMethodregister_to_controller
(self)
ferret/serve/model_worker.py:90
↓ 2 callersMethodregister_to_controller
(self)
ferretui/ferretui/serve/model_worker.py:75
↓ 2 callersMethodregister_to_controller
(self)
ferretui/ferretui/serve/sglang_worker.py:85
↓ 2 callersMethodregister_worker
(self, worker_name: str, check_heart_beat: bool, worker_status: dict)
ferret/serve/controller.py:69
↓ 2 callersMethodregister_worker
(self, worker_name: str, check_heart_beat: bool, worker_status: dict)
ferretui/ferretui/serve/controller.py:69
↓ 2 callersMethodremove_worker
(self, worker_name: str)
ferret/serve/controller.py:101
↓ 2 callersMethodremove_worker
(self, worker_name: str)
ferretui/ferretui/serve/controller.py:101
↓ 2 callersMethodreport
Return a condensed report of the results as a dict of dict. report[k][cat] is the recall@k for the given category
ferret/eval/eval_flickr_entities.py:312
↓ 2 callersFunctionselect_best_resolution
Selects the best resolution from a list of possible resolutions based on the original size. Args: original_size (tuple): The origina
ferretui/ferretui/mm_utils.py:13
↓ 2 callersMethodsend_heart_beat
(self)
ferret/serve/model_worker.py:102
↓ 2 callersMethodsend_heart_beat
(self)
ferretui/ferretui/serve/model_worker.py:87
↓ 2 callersMethodsend_heart_beat
(self)
ferretui/ferretui/serve/sglang_worker.py:97
↓ 2 callersFunctionsmart_tokenizer_and_embedding_resize
Resize tokenizer and embedding. Note: This is the unoptimized version that may make your embedding size not be divisible by 64.
ferretui/ferretui/train/train.py:275
↓ 2 callersFunctionswitchQuestionAndCategory
()
ferretui/ferretui/eval/webpage/script.js:203
↓ 2 callersFunctiontrain
()
ferret/train/train.py:1160
↓ 2 callersFunctionupdateExpandButtonVisibility
(card)
ferretui/ferretui/eval/webpage/script.js:226
↓ 2 callersFunctionupdateModelSelect
()
ferretui/ferretui/eval/webpage/script.js:64
↓ 1 callersMethod__init__
(self, config: LlamaConfig)
ferret/model/language_model/ferret_llama.py:35
↓ 1 callersMethod__init__
(self, config: LlamaConfig)
ferretui/ferretui/model/language_model/ferret_llama.py:37
↓ 1 callersMethod__init__
(self, config: GemmaConfig)
ferretui/ferretui/model/language_model/ferret_gemma.py:41
↓ 1 callersMethod__init__
(self, config: MptConfig)
ferretui/ferretui/model/language_model/ferret_mpt.py:32
↓ 1 callersMethod__init__
(self)
ferretui/ferretui/model/multimodal_projector/builder.py:7
↓ 1 callersMethod__init__
(self, vision_tower, args, delay_load=False)
ferretui/ferretui/model/multimodal_encoder/clip_encoder.py:51
↓ 1 callersFunction_add_speaker_and_signal
Add speaker and start/end signal on each round.
ferret/train/train.py:318
↓ 1 callersFunction_add_speaker_and_signal
Add speaker and start/end signal on each round.
ferretui/ferretui/train/train.py:338
↓ 1 callersFunction_box_inter_union
(boxes1: np.array, boxes2: np.array)
ferret/eval/eval_flickr_entities.py:239
↓ 1 callersFunction_mask_targets
(target, tokenized_lens, speakers)
ferret/train/train.py:307
↓ 1 callersFunction_mask_targets
(target, tokenized_lens, speakers)
ferretui/ferretui/train/train.py:327
↓ 1 callersFunction_merge_boxes
Return the boxes corresponding to the smallest enclosing box containing all the provided boxes The boxes are expected in [x1, y1, x2, y2] for
ferret/eval/eval_flickr_entities.py:275
↓ 1 callersMethod_save
(self, output_dir: Optional[str] = None, state_dict=None)
ferret/train/ferret_trainer.py:62
↓ 1 callersMethod_save
(self, output_dir: Optional[str] = None, state_dict=None)
ferretui/ferretui/train/ferret_trainer.py:306
↓ 1 callersFunctionapply_delta
(base_model_path, target_model_path, delta_path)
ferret/model/apply_delta.py:35
↓ 1 callersFunctionapply_delta
(base_model_path, target_model_path, delta_path)
ferretui/ferretui/model/apply_delta.py:13
↓ 1 callersFunctionare_phrases_similar
(phrase1, phrase2)
ferret/eval/eval_refexp.py:71
↓ 1 callersFunctionare_phrases_similar
(phrase1, phrase2)
ferret/eval/eval_flickr_entities.py:71
↓ 1 callersFunctionbuild_demo
(embed_mode)
ferret/serve/gradio_web_server.py:611
↓ 1 callersFunctionbuild_demo
(embed_mode, cur_dir=None, concurrency_count=10)
ferretui/ferretui/serve/gradio_web_server.py:315
↓ 1 callersMethodcall_for_batch
(self, output_ids: torch.LongTensor, scores: torch.FloatTensor, **kwargs)
ferretui/ferretui/mm_utils.py:243
↓ 1 callersFunctioncapitalizeFirstChar
(str)
ferretui/ferretui/eval/webpage/script.js:41
↓ 1 callersFunctionconsolidate_ckpt
(src_path, dst_path)
ferret/model/consolidate.py:13
↓ 1 callersFunctionconsolidate_ckpt
(src_path, dst_path)
ferretui/ferretui/model/consolidate.py:13
↓ 1 callersFunctiondecode_bbox_from_caption
(text, img_w, img_h, verbose=False)
ferret/eval/eval_refexp.py:38
↓ 1 callersFunctiondecode_bbox_from_caption
(text, img_w, img_h, verbose=False)
ferret/eval/eval_flickr_entities.py:38
↓ 1 callersFunctiondivide_to_patches
Divides an image into patches of a specified size. Args: image (PIL.Image.Image): The input image. patch_size (int): The siz
ferretui/ferretui/mm_utils.py:79
↓ 1 callersFunctiondraw_box
(coor, region_mask, region_ph, img, input_mode)
ferret/serve/gradio_web_server.py:80
↓ 1 callersFunctioneval_model
(args)
ferret/eval/model_point_cls_single_image.py:59
↓ 1 callersFunctioneval_model
(args)
ferret/eval/model_lvis.py:164
↓ 1 callersFunctioneval_model
(args)
ferret/eval/model_gpt4eval_3newclass.py:167
↓ 1 callersFunctioneval_model
(args)
ferretui/ferretui/eval/model_UI.py:129
↓ 1 callersFunctioneval_model_flickr
(args)
ferret/eval/model_flickr.py:156
↓ 1 callersFunctioneval_model_pope
(args)
ferret/eval/model_pope.py:120
↓ 1 callersFunctioneval_model_refexp
(args)
ferret/eval/model_refcoco.py:149
↓ 1 callersMethodevaluate
(self, predictions: List[Dict])
ferret/eval/eval_flickr_entities.py:391
↓ 1 callersFunctionevaluate_pope
(prediction_file, annotation_file)
ferret/eval/eval_pope.py:20
↓ 1 callersFunctionextend_list
(original_list, multiplier)
ferret/train/train.py:610
↓ 1 callersFunctionextend_list
(original_list, multiplier)
ferretui/ferretui/train/train.py:1001
↓ 1 callersMethodextract_region_feature
(self, region_feature_map, region_masks, original_dtype, return_dtype)
ferret/model/ferret_arch.py:435
↓ 1 callersFunctionfarthest_point_sample
Input: xyz: pointcloud data, [B, N, 2] npoint: number of samples Return: centroids: sampled pointcloud index, [B, npo
ferret/model/ferret_arch.py:73
↓ 1 callersFunctionfarthest_point_sample
Input: xyz: pointcloud data, [B, N, 2] npoint: number of samples Return: centroids: sampled pointcloud index, [B, npo
ferretui/ferretui/model/ferret_arch.py:82
↓ 1 callersMethodfetch_data
(self, id)
ferret/eval/model_lvis.py:159
↓ 1 callersMethodfetch_data
(self, id)
ferret/eval/model_gpt4eval_3newclass.py:162
↓ 1 callersFunctionfind_all_linear_names
(model)
ferret/train/train.py:186
↓ 1 callersFunctionfind_all_linear_names
(model, qv_proj_only=False)
ferretui/ferretui/train/train.py:213
↓ 1 callersFunctionfind_indices_in_order
(str_list, STR)
ferret/serve/gradio_web_server.py:324
↓ 1 callersMethodflush
(self)
ferretui/ferretui/utils.py:87
↓ 1 callersFunctionformat_region_prompt
(prompt, refer_input_state)
ferret/serve/gradio_web_server.py:337
↓ 1 callersMethodformat_unicode_filenames
(filename)
ferretui/ferretui/train/train.py:1656
↓ 1 callersMethodfrom_str
(cls, name)
ferret/serve/controller.py:33
↓ 1 callersMethodfrom_str
(cls, name)
ferretui/ferretui/serve/controller.py:33
↓ 1 callersFunctiongenerate_mask_for_feature
(coor,raw_w, raw_h)
ferret/eval/model_point_cls_single_image.py:39
↓ 1 callersFunctiongenerate_mask_for_feature
(coor, raw_w, raw_h, mask=None)
ferret/eval/model_lvis.py:55
↓ 1 callersFunctiongenerate_mask_for_feature
(coor, raw_w, raw_h, mask=None)
ferret/eval/model_gpt4eval_3newclass.py:47
↓ 1 callersFunctiongenerate_mask_for_feature
(coor, raw_w, raw_h, mask=None)
ferretui/ferretui/eval/model_UI.py:30
↓ 1 callersMethodgenerate_mask_for_feature
(self, coor, box, mask, raw_w, raw_h)
ferret/train/train.py:908
↓ 1 callersMethodgenerate_mask_for_feature
(self, coor, box, mask, raw_w, raw_h)
ferretui/ferretui/train/train.py:1595
↓ 1 callersMethodgenerate_stream
(self, params)
ferret/serve/model_worker.py:138
↓ 1 callersMethodgenerate_stream
(self, params)
ferretui/ferretui/serve/model_worker.py:123
↓ 1 callersMethodgenerate_stream
(self, params)
ferretui/ferretui/serve/sglang_worker.py:132
↓ 1 callersMethodgenerate_stream_gate
(self, params)
ferret/serve/model_worker.py:268
↓ 1 callersMethodgenerate_stream_gate
(self, params)
ferretui/ferretui/serve/model_worker.py:195
↓ 1 callersMethodgenerate_stream_gate
(self, params)
ferretui/ferretui/serve/sglang_worker.py:172
↓ 1 callersFunctionget_annotations
Parses the xml files in the Flickr30K Entities dataset input: filename - full file path to the annotations file to parse output:
ferret/eval/eval_flickr_entities.py:159
↓ 1 callersFunctionget_anyres_image_grid_shape
Calculate the shape of the image patch grid after the preprocessing for images of any resolution. Args: image_size (tuple): The size
ferretui/ferretui/mm_utils.py:101
↓ 1 callersFunctionget_args
()
ferret/eval/eval_lvis.py:19
↓ 1 callersFunctionget_bbox_coor
(box, ratio_w, ratio_h)
ferretui/ferretui/eval/model_UI.py:70
↓ 1 callersMethodget_bbox_coor
(self, box, ratio_w, ratio_h)
ferret/train/train.py:904
↓ 1 callersMethodget_bbox_coor
(self, box, ratio_w, ratio_h)
ferretui/ferretui/train/train.py:1592
↓ 1 callersFunctionget_chunk
(lst, n, k)
ferret/eval/model_lvis.py:50
↓ 1 callersFunctionget_chunk
(lst, n, k)
ferret/eval/model_flickr.py:54
↓ 1 callersFunctionget_chunk
(lst, n, k)
ferret/eval/model_pope.py:52
↓ 1 callersFunctionget_chunk
(lst, n, k)
ferret/eval/model_refcoco.py:53
↓ 1 callersFunctionget_chunk
(lst, n, k)
ferretui/ferretui/eval/model_UI.py:26
↓ 1 callersFunctionget_eval
(content: str, max_tokens: int)
ferret/eval/eval_gpt_review_3newclass.py:15
↓ 1 callersFunctionget_mm_adapter_state_maybe_zero_3
(named_params, keys_to_match)
ferret/train/train.py:180
↓ 1 callersFunctionget_mm_adapter_state_maybe_zero_3
(named_params, keys_to_match)
ferret/train/ferret_trainer.py:22
↓ 1 callersFunctionget_mm_adapter_state_maybe_zero_3
(named_params, keys_to_match)
ferretui/ferretui/train/train.py:197
← previousnext →101–200 of 522, ranked by callers