MCPcopy Create free account

hub / github.com/huggingface/smollm / functions

Functions1,907 in github.com/huggingface/smollm

⨍ Functions 1,907◇ Types & classes 810↳ Endpoints 7
↓ 1 callersMethodformat_model_outputs_to_predictions
(self, outputs)
vision/m4/models/vgpt2/evaluation_image_caption_matching_vgpt2.py:232
↓ 1 callersMethodformat_model_outputs_to_predictions
(self, outputs: ModelOutput)
vision/m4/models/vgpt2/evaluation_classification_in_context_vgpt2.py:470
↓ 1 callersFunctionformat_relative_to_absolute_path
(page_url, relative_path)
vision/m4/sourcing/data_collection/utils/simplification_utils.py:145
↓ 1 callersFunctionformat_sampling
Convert a fraction (0 to 1) into a sampling_strategy string. For example, 0.33 becomes "random:33.0%".
vision/smolvlm2/scripts/create_mixture.py:66
↓ 1 callersMethodformat_tokens_to_texts
(self, tokens)
vision/m4/models/vgpt2/evaluation_captioning_in_context_vgpt2.py:378
↓ 1 callersMethodformat_tokens_to_texts
(self, tokens)
vision/m4/models/vgpt2/evaluation_open_ended_vqa_in_context_vgpt2.py:500
↓ 1 callersFunctionformat_value_to_list
(value)
vision/data/datasets_processing_scripts/create_evaluation_datasets/create_mmmu_mcq.py:43
↓ 1 callersMethodforward
(self, x)
vision/m4/models/vllama3/modeling_vllama3.py:347
↓ 1 callersMethodfreeze_text_layers
(self, module_exceptions)
vision/m4/models/vmistral/modeling_vmistral.py:1064
↓ 1 callersMethodfreeze_text_layers
(self)
vision/m4/models/vgpt2/modeling_vgpt2.py:780
↓ 1 callersMethodfreeze_text_layers
(self, module_exceptions)
vision/m4/models/idefics/modeling_idefics.py:741
↓ 1 callersMethodfreeze_text_layers
(self, module_exceptions)
vision/m4/models/vllama3/modeling_vllama3.py:1157
↓ 1 callersMethodfrom_pretrained_models
Use this method when creating a new vloom model that hasn't been yet trained and it'll be composed of 2 pre-trained models - hence `p
vision/m4/models/custom_modules.py:55
↓ 1 callersFunctiongenerate_image_conditioned_text_from_pretrained
( model_paths, image_paths, prompt, tokenizer_infos, max_len=50, num_beams=None, n
vision/m4/evaluation/generation/deprecated_generation/generate.py:24
↓ 1 callersMethodgenerate_improved_text
(self, text, improved_text_widget)
tools/smol_tools/demo_tkinter.py:402
↓ 1 callersFunctiongenerate_random_string
(length=8)
vision/data/datasets_processing_scripts/build_laion_dataset/python_scripts/merge_1_4_laion_big_shards.py:33
↓ 1 callersFunctiongenerate_response
(model, processor, video_path: str, question: str, max_frames: int = 50)
tools/smolvlm_local_inference/SmolVLM_video_inference.py:93
↓ 1 callersMethodgenerate_summary_direct
(self, text)
tools/smol_tools/demo_tkinter.py:56
↓ 1 callersMethodgenerate_tokens
(self, **kwargs)
vision/m4/models/vgpt2/evaluation_captioning_in_context_vgpt2.py:320
↓ 1 callersMethodgenerate_tokens
(self, **kwargs)
vision/m4/models/vgpt2/evaluation_open_ended_vqa_in_context_vgpt2.py:442
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/01_tar_datasets_with_jpeg/python_scripts/06_convert_lrv_per_shard_idx.py:22
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/01_tar_datasets_with_jpeg/python_scripts/12_convert_llavar_per_shard_idx.py:22
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/01_tar_datasets_with_jpeg/python_scripts/07_convert_llava_per_shard_idx.py:22
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/01_tar_datasets_with_jpeg/python_scripts/19_convert_websight_mix_per_shard_idx.py:22
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/01_tar_datasets_with_jpeg/python_scripts/13_convert_vqav2_task_finetuning_per_shard_idx.py:22
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/01_tar_datasets_with_jpeg/python_scripts/17_convert_websight_v02_per_shard_idx.py:22
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/01_tar_datasets_with_jpeg/python_scripts/02_convert_cm4_per_shard_idx.py:22
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/01_tar_datasets_with_jpeg/python_scripts/09_convert_ultrachat_per_shard_idx.py:22
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/01_tar_datasets_with_jpeg/python_scripts/16_convert_image_website_code_per_shard_idx.py:22
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/01_tar_datasets_with_jpeg/python_scripts/01_convert_coco_per_shard_idx.py:22
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/01_tar_datasets_with_jpeg/python_scripts/08_convert_svit_per_shard_idx.py:22
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/01_tar_datasets_with_jpeg/python_scripts/10_convert_m3it_per_shard_idx.py:22
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/01_tar_datasets_with_jpeg/python_scripts/18_convert_sft_per_shard_idx.py:22
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/01_tar_datasets_with_jpeg/python_scripts/03_convert_laoin_per_shard_idx.py:22
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/01_tar_datasets_with_jpeg/python_scripts/15_convert_docvqa_per_shard_idx.py:22
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/01_tar_datasets_with_jpeg/python_scripts/04_convert_cm4_per_shard_idx.py:22
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/01_tar_datasets_with_jpeg/python_scripts/14_convert_tikz_per_shard_idx.py:22
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/01_tar_datasets_with_jpeg/python_scripts/11_convert_spot_difference_per_shard_idx.py:22
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/01_tar_datasets_with_jpeg/python_scripts/05_convert_scaled_laion_per_shard_idx.py:22
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/clean_m4_prelimenary_experiments/python_scripts/02_add_html_back.py:44
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/clean_m4_prelimenary_experiments/python_scripts/04_get_banned_urls.py:20
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/clean_m4_prelimenary_experiments/python_scripts/05_filter_cm4.py:44
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/clean_m4_prelimenary_experiments/python_scripts/03_clean_v2.py:24
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/enwiki/python_scripts/01_extract_text_and_urls_from_wikipedia_web_documents.py:22
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/build_webdocs_dataset/python_scripts/02_bis_extract_html_get_image_urls_new_rules.py:26
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/build_webdocs_dataset/python_scripts/05_filtering_web_docs.py:36
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/build_webdocs_dataset/python_scripts/06_01_create_set_image_urls_in_webdocs.py:21
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/build_webdocs_dataset/python_scripts/01_download_warc.py:20
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/build_webdocs_dataset/python_scripts/06_03_remove_image_duplicates.py:24
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/build_webdocs_dataset/python_scripts/03_dl_images_create_dataset.py:18
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/build_webdocs_dataset/python_scripts/04_merge_web_docs_with_images.py:27
↓ 1 callersFunctionget_args
()
vision/data/datasets_processing_scripts/build_webdocs_dataset/python_scripts/02_extract_html_get_image_urls.py:25
↓ 1 callersFunctionget_args
()
vision/experiments/pretraining/vloom/tr_343_smolvlm_05b_1st_stage/resize_embed_for_eou.py:10
↓ 1 callersFunctionget_args
()
vision/experiments/pretraining/vloom/tr_341_smolvlm_025b_1st_stage/resize_embed_for_eou.py:10
↓ 1 callersFunctionget_args
()
vision/experiments/pretraining/vloom/tr_347_smolvlm_500M_2nd_stage/resize_embed_for_eou.py:10
↓ 1 callersFunctionget_args
()
vision/experiments/pretraining/vloom/tr_348_smolvlm_2B/resize_embed_for_eou.py:10
↓ 1 callersFunctionget_args
()
vision/experiments/pretraining/vloom/tr_345_vsmollm2_256M_2nd_stage/resize_embed_for_eou.py:10
↓ 1 callersFunctionget_args
()
vision/experiments/pretraining/vloom/tr_349_vsmollm2_500M_3rd_stage/resize_embed_for_eou.py:10
↓ 1 callersFunctionget_args
()
vision/experiments/pretraining/vloom/tr_350_smolvlm_2B_2nd_stage/resize_embed_for_eou.py:10
↓ 1 callersFunctionget_args
()
vision/experiments/pretraining/vloom/tr_346_vsmollm2_256M_3rd_stage/resize_embed_for_eou.py:10
↓ 1 callersFunctionget_args
()
vision/m4/utils/datasets/get_self_contained_ds.py:16
↓ 1 callersFunctionget_args
()
vision/m4/scripts/s3-upload-checkpoints.py:60
↓ 1 callersFunctionget_args
()
vision/m4/scripts/resize_embed_for_eou.py:10
↓ 1 callersFunctionget_args
()
vision/m4/scripts/convert-checkpoints.py:50
↓ 1 callersFunctionget_args
()
vision/m4/scripts/s3_checkpoint_download_convert_upload.py:61
↓ 1 callersFunctionget_args
()
vision/m4/scripts/schedule-evals.py:45
↓ 1 callersFunctionget_args
()
vision/m4/scripts/behead_unused_params.py:12
↓ 1 callersFunctionget_args
()
vision/m4/scripts/merge_lora_and_save.py:18
↓ 1 callersFunctionget_args
()
vision/m4/scripts/cleanup-checkpoints.py:59
↓ 1 callersFunctionget_args
()
vision/m4/evaluation/scripts/sync_evaluations_on_wandb.py:18
↓ 1 callersFunctionget_args
()
vision/m4/sourcing/data_collection/callers/extract_html.py:19
↓ 1 callersFunctionget_args
()
vision/m4/sourcing/data_collection/callers/filter_laion_pairs.py:28
↓ 1 callersFunctionget_args
()
vision/m4/sourcing/data_collection/callers/download_warc.py:19
↓ 1 callersFunctionget_args
()
vision/m4/sourcing/data_collection/callers/filter_web_documents.py:34
↓ 1 callersFunctionget_args
()
vision/m4/sourcing/data_collection/callers/extract_web_documents.py:24
↓ 1 callersFunctionget_args
()
vision/m4/sourcing/data_collection/callers/line_deduplicate_web_documents.py:12
↓ 1 callersFunctionget_args
()
vision/m4/sourcing/data_collection/callers/deduplicate_images_web_documents.py:14
↓ 1 callersFunctionget_args
()
text/finetuning/train.py:24
↓ 1 callersMethodget_auto_remove_tmp_dir
Args: tmp_dir (:obj:`string`, `optional`): if :obj:`None`: - a unique temporary path will be
vision/m4/testing_utils.py:712
↓ 1 callersMethodget_batch_metadata_columns
(batch: Dict)
vision/m4/sourcing/pmd/loader_builder.py:203
↓ 1 callersMethodget_current_chat_id
Get the ID of the current chat
tools/smol_tools/smol_tools/chatter.py:153
↓ 1 callersMethodget_data_collator
(self, **kwargs)
vision/m4/models/vgpt2/evaluation_perplexity_in_context_vgpt2.py:72
↓ 1 callersFunctionget_dataloader
( tokenizer, image_transforms, seed, num_workers=1, pin_memory=False, batch_size=10,
vision/m4/training/dataset.py:362
↓ 1 callersFunctionget_dataset
( dataset_config: DatasetParams, tokenizer=None, image_transform=None, is_train: bool = True,
vision/m4/training/dataset.py:336
↓ 1 callersFunctionget_dataset
()
text/data/smoltalk/rewrite/pipeline/dataset.py:21
↓ 1 callersFunctionget_dataset
()
text/data/smoltalk/constraints/filter_ifeval_data.py:324
↓ 1 callersFunctionget_dataset_hf
( dataset_config: DatasetParams, tokenizer, image_transform, is_train: bool = True, realti
vision/m4/training/dataset.py:231
↓ 1 callersFunctionget_dataset_webdataset
( dataset_config: DatasetParams, is_train: bool = True, realtime_processing: bool = True, )
vision/m4/training/dataset.py:292
↓ 1 callersFunctionget_deepspeed_engine
(accelerator)
vision/m4/training/utils.py:813
↓ 1 callersFunctionget_deepspeed_stage
()
vision/m4/training/utils.py:757
↓ 1 callersFunctionget_domain_to_duplicated_texts
(domain_to_positions)
vision/data/datasets_processing_scripts/build_webdocs_dataset/python_scripts/09_04_get_domain_to_duplicated_texts.py:42
↓ 1 callersFunctionget_domain_to_positions
()
vision/data/datasets_processing_scripts/build_webdocs_dataset/python_scripts/09_02_get_domain_to_positions.py:34
↓ 1 callersFunctionget_evaluations_values_from_json
Load all values from the json file
vision/m4/evaluation/scripts/sync_evaluations_on_wandb.py:113
↓ 1 callersFunctionget_exs_and_stats
(web_document_dataset, type_exs, funcs_compute_stats, text_node_level=True)
vision/m4/sourcing/data_collection/visualization/choose_filtering_parameters_web_documents_node_level.py:30
↓ 1 callersMethodget_extracted_pairs
(num_docs, should_compute_clip_scores)
vision/m4/sourcing/data_collection/visualization/pair_visualization.py:52
↓ 1 callersFunctionget_extraction_evaluation_metrics
_summary_ Args: num_docs_to_consider (int, optional): _description_. Defaults to 100. use_clip_scores (bool, optional): _descript
vision/m4/sourcing/data_collection/visualization/pair_stat_dashboard.py:128
↓ 1 callersFunctionget_finepersonas_tweets
( n: int | None = None, system_prompt: str = REWRITE_CONCISE_SYSTEM_PROMPT )
text/data/smoltalk/rewrite/pipeline/dataset.py:92
↓ 1 callersFunctionget_from_cache
Given a URL, look for the corresponding file in the local cache. If it's not there, download it. Then return the path to the cached file.
vision/m4/sourcing/pmd/cache_path.py:172
↓ 1 callersMethodget_html_from_warc
(self, warc)
vision/m4/sourcing/data_collection/processors/html_extractor.py:29
↓ 1 callersFunctionget_image_columns
(ds: Dataset)
vision/m4/utils/datasets/get_self_contained_ds.py:62
← previousnext →601–700 of 1,907, ranked by callers