MCPcopy Create free account

hub / github.com/FunAudioLLM/ThinkSound / functions

Functions638 in github.com/FunAudioLLM/ThinkSound

↓ 1 callersFunction_build_spline
(video_feat, video_t, target_t)
ThinkSound/models/utils.py:129
↓ 1 callersMethod_get_closed_form_lr
(self)
ThinkSound/training/utils.py:56
↓ 1 callersMethod_validate_layout
Runs checks on the layout to ensure a valid pattern is defined. A pattern is considered invalid if: - Multiple timesteps for a sam
ThinkSound/models/codebook_patterns.py:54
↓ 1 callersFunctionadapt_input_conv
(in_chans, conv_weight, agg='sum')
data_utils/ext/synchformer/vit_helper.py:302
↓ 1 callersFunctionapply_reduction
Apply reduction to collection of losses.
ThinkSound/training/losses/auraloss.py:9
↓ 1 callersFunctionbuild_mask
(sample_size, mask_args)
ThinkSound/inference/generation.py:177
↓ 1 callersFunctioncheckpoint
(function, *args, **kwargs)
ThinkSound/models/transformer.py:25
↓ 1 callersFunctioncleanup
()
data_utils/extract_training_audio.py:24
↓ 1 callersFunctioncleanup
()
data_utils/extract_training_video.py:24
↓ 1 callersFunctioncombine_audio_video
(video_path, audio_path, output_path)
app.py:60
↓ 1 callersFunctioncompute_mmd
(latents)
ThinkSound/models/bottleneck.py:86
↓ 1 callersFunctionconvert_to_mp4
(original_path, converted_path)
app.py:47
↓ 1 callersFunctioncreate_demo_callback_from_config
(model_config, **kwargs)
ThinkSound/training/factory.py:30
↓ 1 callersFunctioncreate_diffAE_from_config
(config: Dict[str, Any])
ThinkSound/models/autoencoders.py:738
↓ 1 callersFunctioncreate_diffusion_cond_from_config
(config: tp.Dict[str, tp.Any])
ThinkSound/models/diffusion.py:828
↓ 1 callersFunctioncreate_diffusion_uncond_from_config
(config: tp.Dict[str, tp.Any])
ThinkSound/models/diffusion.py:728
↓ 1 callersFunctioncreate_loss_modules_from_bottleneck
(bottleneck, loss_config)
ThinkSound/training/autoencoders.py:473
↓ 1 callersFunctioncreate_multi_conditioner_from_conditioning_config
Create a MultiConditioner from a conditioning config dictionary Args: config: the conditioning config dictionary device: the
ThinkSound/models/conditioners.py:939
↓ 1 callersMethoddecode
(self, x)
ThinkSound/models/bottleneck.py:167
↓ 1 callersMethoddecode
(self, x)
ThinkSound/models/bottleneck.py:200
↓ 1 callersMethoddecode
(self, x)
ThinkSound/models/bottleneck.py:244
↓ 1 callersMethoddecode
(self, x)
ThinkSound/models/bottleneck.py:301
↓ 1 callersMethoddecode
(self, x)
ThinkSound/models/bottleneck.py:343
↓ 1 callersMethoddecode_audio
Decode latents to audio. If chunked is True, split the latents into chunks of a given maximum size chunk_size, with given overlap, b
ThinkSound/models/autoencoders.py:505
↓ 1 callersMethoddecode_tokens
(self, tokens)
ThinkSound/models/pretransforms.py:25
↓ 1 callersMethoddiff
(x)
ThinkSound/training/losses/auraloss.py:72
↓ 1 callersMethodencode_audio
Encode audios into latents. Audios should already be preprocesed by preprocess_audio_for_encoder. If chunked is True, split the audio
ThinkSound/models/autoencoders.py:430
↓ 1 callersMethodencode_audio
(self, x)
data_utils/v2a_utils/feature_utils_224.py:172
↓ 1 callersMethodencode_t5_text
(self, text: list[str])
extract_latents.py:118
↓ 1 callersMethodencode_text
(self, text: list[str])
data_utils/v2a_utils/feature_utils_224.py:152
↓ 1 callersMethodencode_video_with_clip
(self, x, batch_size=-1)
extract_latents.py:94
↓ 1 callersMethodencode_video_with_clip
(self, x: torch.Tensor, batch_size: int = -1)
data_utils/v2a_utils/feature_utils_224.py:105
↓ 1 callersMethodencode_video_with_sync
(self, x, batch_size=-1)
extract_latents.py:101
↓ 1 callersMethodencode_video_with_sync
(self, x: torch.Tensor, batch_size: int = -1)
data_utils/v2a_utils/feature_utils_224.py:124
↓ 1 callersMethodflash_attn
( self, q, k, v, mask = None, causal
ThinkSound/models/transformer.py:327
↓ 1 callersMethodforward
(self, t)
ThinkSound/models/transformer.py:127
↓ 1 callersMethodforward_features
(self, x)
data_utils/ext/synchformer/video_model_builder.py:171
↓ 1 callersMethodforward_segments
x is of shape (1, BS, C, T, H, W) where S is the number of segments.
data_utils/ext/synchformer/motionformer.py:218
↓ 1 callersFunctionget_all_s3_urls
get urls of shards (tar files) for multiple datasets in one s3 bucket
ThinkSound/data/dataset.py:850
↓ 1 callersMethodget_conditioning_inputs
(self, conditioning_tensors: tp.Dict[str, tp.Any], negative=False)
ThinkSound/models/diffusion.py:670
↓ 1 callersMethodget_empty_t5_sequence
(self, bs: int)
ThinkSound/models/mmdit.py:474
↓ 1 callersFunctionget_s3_contents
Returns a list of full S3 paths to files in a given S3 bucket and directory path.
ThinkSound/data/dataset.py:803
↓ 1 callersMethodget_sequence_coords_with_timestep
Get codebook coordinates in the layout that corresponds to the specified timestep t and optionally to the codebook q. Coordinates are returned
ThinkSound/models/codebook_patterns.py:95
↓ 1 callersMethodget_steps_with_timestep
(self, t: int, q: tp.Optional[int] = None)
ThinkSound/models/codebook_patterns.py:110
↓ 1 callersFunctionget_window
Return a window function. Args: win_type (str): Window type. Can either be one of the window function provided in PyTorch ['h
ThinkSound/training/losses/auraloss.py:23
↓ 1 callersMethodinitialize_weights
(self)
ThinkSound/models/mmdit.py:223
↓ 1 callersFunctioninpainting_callback
(args)
ThinkSound/inference/sampling.py:153
↓ 1 callersFunctionkeyword_scandir
very fast `glob` alternative. from https://stackoverflow.com/a/59803793/4259243
ThinkSound/data/dataset.py:58
↓ 1 callersFunctionlinear_geglu
(x, weight, bias=None)
ThinkSound/models/blocks.py:259
↓ 1 callersFunctionload
(filename,duration)
predict.py:82
↓ 1 callersMethodload_data_urls
(self)
ThinkSound/data/dataset.py:928
↓ 1 callersMethodload_file
(self, filename)
ThinkSound/data/dataset.py:187
↓ 1 callersMethodload_file
(self, filename, info)
ThinkSound/data/dataset.py:313
↓ 1 callersMethodload_file
(self, filename, info)
ThinkSound/data/dataset.py:401
↓ 1 callersMethodload_file
(self, filename, info)
ThinkSound/data/dataset.py:504
↓ 1 callersFunctionmain
()
predict.py:93
↓ 1 callersFunctionmain
()
train.py:56
↓ 1 callersFunctionmain
()
eval_batch.py:57
↓ 1 callersFunctionmain
()
unwrap.py:53
↓ 1 callersFunctionmain
(args)
extract_latents.py:36
↓ 1 callersFunctionmain
(args)
data_utils/extract_training_audio.py:32
↓ 1 callersFunctionmain
(args)
data_utils/extract_training_video.py:31
↓ 1 callersFunctionmask_from_start_end_indices
( seq_len: int, start: Tensor, end: Tensor )
ThinkSound/training/utils.py:137
↓ 1 callersFunctionmask_from_start_end_indices
( seq_len: int, start: Tensor, end: Tensor )
ThinkSound/models/utils.py:98
↓ 1 callersFunctionor_reduce
(masks)
ThinkSound/models/transformer.py:36
↓ 1 callersFunctionpad_to_square
(video_tensor)
data_utils/v2a_utils/audioset_224.py:52
↓ 1 callersFunctionpad_to_square
(video_tensor)
data_utils/v2a_utils/audioset_video_224.py:52
↓ 1 callersFunctionpad_to_square
(video_tensor)
data_utils/v2a_utils/vggsound_224_no_sync.py:52
↓ 1 callersFunctionpad_to_square
(video_tensor)
data_utils/v2a_utils/vggsound_224_no_audio.py:52
↓ 1 callersFunctionpad_to_square
(video_tensor)
data_utils/v2a_utils/vggsound_224.py:52
↓ 1 callersFunctionpad_to_target
(tensor, target_size, dim=1, pad_value=0)
ThinkSound/models/mmdit.py:555
↓ 1 callersFunctionpatch_clip
(clip_model)
data_utils/v2a_utils/feature_utils_224.py:21
↓ 1 callersFunctionpatch_clip
(clip_model)
data_utils/v2a_utils/feature_utils_224_audio.py:23
↓ 1 callersMethodpre_attention
( self, x: torch.Tensor, context: Optional[torch.Tensor])
ThinkSound/models/transformer_layers.py:109
↓ 1 callersMethodpre_attention
(self, x: torch.Tensor, c: torch.Tensor, rot: Optional[torch.Tensor])
ThinkSound/models/transformer_layers.py:170
↓ 1 callersMethodpredict_dataloader
(self)
ThinkSound/data/datamodule.py:188
↓ 1 callersMethodpredict_flow
for non-cacheable computations
ThinkSound/models/mmdit.py:320
↓ 1 callersFunctionpredict_step
(diffusion, batch, diffusion_objective, device='cuda:0')
predict.py:18
↓ 1 callersFunctionpredict_step
(diffusion, batch, diffusion_objective, device='cuda:0')
eval_batch.py:20
↓ 1 callersMethodpreprocess_audio_list_for_encoder
Preprocess a [list] of audio (Channels x Length) into a batch tensor to be compatable with the encoder. The audio in that list can b
ThinkSound/models/autoencoders.py:387
↓ 1 callersMethodrestore_spatio_temp_dims
feats are of shape (B*S, T, D) where T = 1 + (224 // 16) * (224 // 16) * 8 Our goal is to make them of shape (B*S, t, h, w, D
data_utils/ext/synchformer/motionformer.py:238
↓ 1 callersFunctionrotate_half
(x)
ThinkSound/models/transformer.py:146
↓ 1 callersMethodsample
(self, idx: int)
data_utils/v2a_utils/vggsound_text.py:76
↓ 1 callersMethodsample
(self, idx: int)
data_utils/v2a_utils/audioset_224.py:155
↓ 1 callersMethodsample
(self, idx: int)
data_utils/v2a_utils/audioset_video_224.py:147
↓ 1 callersMethodsample
(self, idx: int)
data_utils/v2a_utils/vggsound_224_no_sync.py:145
↓ 1 callersMethodsample
(self, idx: int)
data_utils/v2a_utils/vggsound_224_no_audio.py:155
↓ 1 callersMethodsample
(self, idx: int)
data_utils/v2a_utils/audio_text_dataset.py:89
↓ 1 callersMethodsample
(self, idx: int)
data_utils/v2a_utils/vggsound_224.py:155
↓ 1 callersFunctionsample_k
( model_fn, noise, init_data=None, mask=None, steps=100, sa
ThinkSound/inference/sampling.py:111
↓ 1 callersFunctionsample_rf
( model_fn, noise, init_data=None, steps=100, sigma_max=1,
ThinkSound/inference/sampling.py:200
↓ 1 callersFunctionsetup
(rank, world_size)
extract_latents.py:29
↓ 1 callersFunctionsetup
(rank, world_size)
data_utils/extract_training_audio.py:20
↓ 1 callersFunctionsetup
(rank, world_size)
data_utils/extract_training_video.py:20
↓ 1 callersMethodsetup
(self, stage: str)
ThinkSound/data/datamodule.py:128
↓ 1 callersFunctionsnake_beta
(x, alpha, beta)
ThinkSound/models/blocks.py:301
↓ 1 callersMethodstarts_with_special_token
(self)
ThinkSound/models/codebook_patterns.py:92
↓ 1 callersMethodtimestep_embedding
Create sinusoidal timestep embeddings. :param t: a 1-D Tensor of N indices, one per batch element. These ma
ThinkSound/models/embeddings.py:67
↓ 1 callersFunctiontruncate_to_target
(tensor, target_size, dim=1)
ThinkSound/models/mmdit.py:547
↓ 1 callersFunctionzero_init
(layer)
ThinkSound/models/blocks.py:197
← previousnext →101–200 of 638, ranked by callers