Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/allenai/molmo
/ functions
Functions
893 in github.com/allenai/molmo
⨍
Functions
893
◇
Types & classes
198
↓ 1 callers
Function
freeze_module
(module: torch.nn.Module, exclude_params: Optional[List[str]] = None)
olmo/torch_util.py:164
↓ 1 callers
Method
from_checkpoint
Load an OLMo model from a checkpoint.
olmo/model.py:2364
↓ 1 callers
Method
generate
Generate token IDs using beam search. Note that by default ``beam_size`` is set to 1, which is greedy decoding. :param inpu
olmo/model.py:2189
↓ 1 callers
Method
get
(self, idx, epoch=0)
olmo/data/dataset.py:55
↓ 1 callers
Method
get
(self, item, rng)
olmo/data/dataset.py:88
↓ 1 callers
Method
get_abc_image
(self, image, annotations)
olmo/hf_datasets/ai2d.py:118
↓ 1 callers
Function
get_chat_response
Run a query through an OpenAI model
olmo/eval/api_utils.py:10
↓ 1 callers
Function
get_device_batch
(_worker_its)
tests/data/test_data_iterator.py:97
↓ 1 callers
Function
get_evaluator
Gets the default evaluator for task `name`
launch_scripts/utils.py:33
↓ 1 callers
Method
get_file_name
(step, process_index)
olmo/eval/evaluators.py:154
↓ 1 callers
Function
get_float_dtype_by_name
(dtype)
scripts/mm_eval.py:45
↓ 1 callers
Function
get_font_size
Get the font size based on the size of the image.
olmo/hf_datasets/ai2d.py:22
↓ 1 callers
Function
get_gcs_url
(output_file)
scripts/mm_eval.py:64
↓ 1 callers
Method
get_html
(self)
olmo/eval/evaluators.py:54
↓ 1 callers
Function
get_key_subresponses
(response)
olmo/eval/mmmu_eval_utils.py:133
↓ 1 callers
Method
get_labels
(self, batch: Dict[str, Any])
olmo/train.py:740
↓ 1 callers
Method
get_level_text
(self, record: logging.LogRecord)
olmo/util.py:282
↓ 1 callers
Method
get_location_text
(self, record: logging.LogRecord)
olmo/util.py:289
↓ 1 callers
Function
get_most_similar
Use the Levenshtein distance (or edit distance) to determine which of the choices is most similar to the given prediction
olmo/eval/math_vista_utils.py:45
↓ 1 callers
Function
get_multimodal_param_groups
Separate parameters into connector/vit/llm weight decay and non weight decay groups.
olmo/optim.py:711
↓ 1 callers
Function
get_node_rank
()
olmo/torch_util.py:35
↓ 1 callers
Function
get_param_groups
Separate parameters into weight decay and non weight decay groups.
olmo/optim.py:886
↓ 1 callers
Function
get_parser
()
scripts/convert_hf_to_molmo.py:589
↓ 1 callers
Method
get_post_step_metrics
( self, module: nn.Module, process_group: Optional[dist.ProcessGroup] = None )
olmo/optim.py:456
↓ 1 callers
Function
get_progress_bar
()
olmo/util.py:319
↓ 1 callers
Method
get_state_for_param
(self, param: nn.Parameter)
olmo/optim.py:429
↓ 1 callers
Method
get_system_prompt
(self, style, for_inference, messages, rng)
olmo/data/data_formatter.py:409
↓ 1 callers
Method
get_time_text
(self, record: logging.LogRecord)
olmo/util.py:277
↓ 1 callers
Function
get_training_mixture
(submixture)
launch_scripts/train_multitask_model.py:60
↓ 1 callers
Method
get_transparent_abc_image
(self, image, annotations)
olmo/hf_datasets/ai2d.py:121
↓ 1 callers
Method
get_user_prompt
Build a list of strings of what a user might type in to the model for the given example, and its responses, by applying a prompt template to t
olmo/data/data_formatter.py:451
↓ 1 callers
Method
gumbel
Sample `Gumbel(phi)`. `phi` should have shape `(batch_size, num_classes)`.
olmo/beam_search.py:395
↓ 1 callers
Function
html_rect
Utility method to get a HTML rectangle element
olmo/html_utils.py:250
↓ 1 callers
Method
image_to_patches_and_tokens
( self, image: ImageInput, is_training=False, rng=None )
olmo/data/model_preprocessor.py:341
↓ 1 callers
Method
inference_eval
(self)
olmo/train.py:1158
↓ 1 callers
Method
init_state
( self, start_class_log_probabilities: torch.Tensor, batch_size: int, num_classes: int )
olmo/beam_search.py:305
↓ 1 callers
Method
init_state
( self, batch_size: int, )
olmo/beam_search.py:598
↓ 1 callers
Method
initialize_and_load_model
(self)
scripts/mm_eval.py:109
↓ 1 callers
Function
install_excepthook
()
olmo/util.py:177
↓ 1 callers
Function
is_in_coco_val2017
(image_id, _val2017=set())
olmo/data/academic_datasets_manual.py:42
↓ 1 callers
Function
is_valid_format
(input_string)
olmo/eval/evaluators.py:256
↓ 1 callers
Method
load_checkpoint
( self, load_path: PathOrStr, *, local_cache: Optional[PathOrStr] = None,
olmo/checkpoint.py:876
↓ 1 callers
Function
load_fsdp_model_and_optim_state
Use this to load a state dict for an FSDP model and its optimizer via :module:`torch.distributed.checkpoint` functions. This should be used d
olmo/checkpoint.py:151
↓ 1 callers
Function
load_image
(image_path)
olmo/data/model_preprocessor.py:34
↓ 1 callers
Function
load_olmo_config
Load an OLMo config file and convert it into a MM-OLMo config
scripts/unshard.py:21
↓ 1 callers
Method
log_batch
(self, batch)
olmo/train.py:77
↓ 1 callers
Function
main
()
launch_scripts/eval_downstream.py:25
↓ 1 callers
Function
main
()
launch_scripts/eval_captioner.py:23
↓ 1 callers
Function
main
(cfg: TrainConfig)
scripts/train.py:46
↓ 1 callers
Function
main
( input_dir: Union[str, Path], output_dir: Union[str, Path], sharded_checkpoint_type: ShardedCheck
scripts/unshard.py:39
↓ 1 callers
Function
main
(args: argparse.Namespace)
scripts/convert_hf_to_molmo.py:572
↓ 1 callers
Function
main
()
scripts/dataset_visualize.py:51
↓ 1 callers
Function
main
()
scripts/build_submission_file.py:8
↓ 1 callers
Function
main_llm
(args: argparse.Namespace)
scripts/convert_hf_to_molmo.py:541
↓ 1 callers
Function
main_vit
(args: argparse.Namespace)
scripts/convert_hf_to_molmo.py:509
↓ 1 callers
Method
map_coordinates_mmolmo
(self, action, dims)
olmo/hf_datasets/android_control.py:224
↓ 1 callers
Function
metaclip_resize
(image, desired_output_size)
olmo/data/model_preprocessor.py:121
↓ 1 callers
Function
mmmu_score
( target: List[str], response: str, metadata: dict, )
olmo/eval/vqa.py:213
↓ 1 callers
Method
preprocess
Preprocesses a single image Returns: crops: (n_crops, n_patches, patch_dim) individual crops, `n_crops` might
olmo/data/model_preprocessor.py:596
↓ 1 callers
Function
processDigitArticle
(inText)
olmo/eval/vqa.py:73
↓ 1 callers
Function
processPunctuation
(inText)
olmo/eval/vqa.py:62
↓ 1 callers
Function
process_action
(action)
olmo/hf_datasets/android_control.py:130
↓ 1 callers
Function
process_data
(data_files: Dict[str, str])
olmo/hf_datasets/android_control.py:33
↓ 1 callers
Function
real_world_qa_score
( target: str, prediction: str, metadata: dict, )
olmo/eval/vqa.py:232
↓ 1 callers
Function
reduce_a11y_tree
(a11y_tree)
olmo/hf_datasets/android_control_utils.py:157
↓ 1 callers
Function
relaxed_correctness
Calculates relaxed correctness. The correctness tolerates certain error ratio defined by max_relative_change. See https://arxiv.org/pdf/2203.
olmo/eval/vqa.py:171
↓ 1 callers
Function
remove_duplicates
(a11y_tree)
olmo/hf_datasets/android_control_utils.py:224
↓ 1 callers
Method
remove_sharded_checkpoint
(self, idx: int = 0)
olmo/train.py:604
↓ 1 callers
Method
remove_unsharded_checkpoint
(self, idx: int = 0)
olmo/train.py:639
↓ 1 callers
Method
render_message
(self, *, record: logging.LogRecord, message: str)
olmo/util.py:267
↓ 1 callers
Method
reset_metrics
(self)
olmo/train.py:182
↓ 1 callers
Method
reset_with_pretrained_weights
(self)
olmo/model.py:1671
↓ 1 callers
Function
resize_and_pad
Resize an image while padding to preserve uts aspect ratio.
olmo/data/model_preprocessor.py:55
↓ 1 callers
Method
restore_checkpoint
( self, load_path: PathOrStr, dist_model: nn.Module, optim: Optimizer,
olmo/checkpoint.py:682
↓ 1 callers
Method
restore_checkpoint
( self, load_path: PathOrStr, dist_model: nn.Module, optim: Optimizer,
olmo/checkpoint.py:1636
↓ 1 callers
Method
restore_rng_state
(self, rng_state: Dict[str, Any])
olmo/train.py:502
↓ 1 callers
Method
restore_sharded_checkpoint
( self, load_path: PathOrStr, local_cache: Optional[PathOrStr] = None, *,
olmo/train.py:610
↓ 1 callers
Method
restore_unsharded_checkpoint
( self, load_path: PathOrStr, local_cache: Optional[PathOrStr] = None, *,
olmo/train.py:649
↓ 1 callers
Method
rotate_half
(self, x: torch.Tensor)
olmo/model.py:375
↓ 1 callers
Method
sample_beams
Returns the beams with the highest perturbed log probabilities.
olmo/beam_search.py:356
↓ 1 callers
Method
sample_nodes
( self, log_probs: torch.Tensor, per_node_beam_size: int, state: StateType )
olmo/beam_search.py:89
↓ 1 callers
Method
sample_nodes
( self, log_probs: torch.Tensor, per_node_beam_size: int, state: StateType )
olmo/beam_search.py:135
↓ 1 callers
Method
sample_nodes
( self, log_probs: torch.Tensor, per_node_beam_size: int, state: StateType )
olmo/beam_search.py:171
↓ 1 callers
Method
save_checkpoint
( self, dir: PathOrStr, dist_model: nn.Module, optim: Optimizer, train
olmo/checkpoint.py:621
↓ 1 callers
Method
save_checkpoint
( self, dir: PathOrStr, dist_model: nn.Module, optim: Optimizer, train
olmo/checkpoint.py:1581
↓ 1 callers
Method
save_ephemeral_checkpoint
(self)
olmo/train.py:588
↓ 1 callers
Function
save_fsdp_model_and_optim_state
Use this to save a state dict for an FSDP model and its optimizer via :module:`torch.distributed.checkpoint` functions. This should be used d
olmo/checkpoint.py:100
↓ 1 callers
Method
save_sharded_checkpoint
(self)
olmo/train.py:582
↓ 1 callers
Method
save_unsharded_checkpoint
(self)
olmo/train.py:633
↓ 1 callers
Method
score
Score the final predictions found by beam search. Returns a tensor of the final sequence scores of shape `(batch_size, beam_size)`.
olmo/beam_search.py:435
↓ 1 callers
Function
select_tiling
Divide in image of size [w, h] in up to max_num_patches of size patch_size
olmo/data/model_preprocessor.py:203
↓ 1 callers
Method
select_vqa_answer
(self, answers, rng)
olmo/data/data_formatter.py:378
↓ 1 callers
Function
set_env_variables
()
olmo/util.py:206
↓ 1 callers
Method
set_grad_checkpointing
(self, enable=True)
olmo/image_vit.py:348
↓ 1 callers
Function
setup_logging
:param rank0_only: INFO and below messages will only be emitted on the rank0 process.
olmo/util.py:90
↓ 1 callers
Method
should_log_optim_metrics_this_step
(self)
olmo/train.py:1138
↓ 1 callers
Method
should_log_this_step
(self)
olmo/train.py:1150
↓ 1 callers
Function
siglip_resize_and_pad
( image: np.ndarray, desired_output_size: Tuple[int, int], )
olmo/data/model_preprocessor.py:139
↓ 1 callers
Method
split_batch
(self, batch: Dict[str, Any])
olmo/train.py:1076
↓ 1 callers
Function
split_list
(lst, split_size)
olmo/util.py:711
← previous
next →
301–400 of 893, ranked by callers