MCPcopy Create free account

hub / github.com/ALRhub/X_IL / functions

Functions1,241 in github.com/ALRhub/X_IL

↓ 2 callersMethodsetup_model
Use this method to setup (i.e. load & initialize) the model. Can improve the runtime of the benchmark. Note that this method is option
agents/backbones/xlstm/mlstm_kernels/utils/benchmark/benchmarks/interface.py:96
↓ 2 callersFunctionsim_framework_path
Abstraction from os.path.join() Builds absolute paths from relative path strings with SIM_FRAMEWORK/ as root. If args already contains an
agents/utils/sim_path.py:8
↓ 2 callersMethodsort
(a, b)
agents/models/beso/models/edm_diffusion/gc_sampling.py:130
↓ 2 callersMethodstart
(self)
agents/backbones/xlstm/mlstm_kernels/utils/time.py:42
↓ 2 callersFunctionstrip_to_first_chars_of_split
Strips a string to the sequence first characters after the `sep_str`. Args: s (str): The string to strip. sep_str (str, optional)
agents/backbones/xlstm/mlstm_kernels/utils/benchmark/param_handling.py:9
↓ 1 callersMethod__init__
( self, encoder: DictConfig, state_dim: int, action_dim: int,
agents/backbones/decoder_only.py:18
↓ 1 callersMethod__init__
( self, encoder: DictConfig, decoder: DictConfig, state_dim: i
agents/backbones/encoder_decoder.py:18
↓ 1 callersMethod__init__
( self, d_model: int, n_layer: int, d_intermediate: int, # vocab_size:
agents/backbones/mamba/mamba.py:132
↓ 1 callersMethod__init__
(self)
agents/encoders/multi_image_obs_encoder.py:11
↓ 1 callersMethod__init__
( self, use_pc_color: bool, out_channels: int, use_layer_norm: bool, u
agents/encoders/point_mlp_encoder.py:6
↓ 1 callersMethod__init__
Computes the spatial softmax of a convolutional feature map. Read more here: "Learning visual feature spaces for robotic mani
agents/encoders/resnets.py:63
↓ 1 callersMethod__init__
(self)
agents/models/ddpm/utils.py:64
↓ 1 callersMethod__init__
(self, shape=1000.0, rate=1000.0)
agents/models/beso/utils/transforms.py:55
↓ 1 callersMethod__init__
(self, cfg)
agents/models/beso/utils/automatic_lang_annotator_mp.py:48
↓ 1 callersMethod__init__
( self, resolution: int, patch_size: int, embed_dim: int, in_channels:
agents/models/beso/models/img_generation/masked_transformer_decoder.py:47
↓ 1 callersMethod__init__
( self, obs_dim: int, goal_dim: int, device: str, n_obs_token: int,
agents/models/beso/models/networks/mdtv_transformer.py:38
↓ 1 callersMethod__init__
( self, obs_dim: int, goal_dim: int, device: str, goal_conditioned: bo
agents/models/beso/models/networks/mdt_transformer.py:39
↓ 1 callersMethod__init__
( self, dim: int, depth: int, dim_head: int = 64, heads: int = 8,
agents/models/beso/models/networks/transformers/perceiver_resampler.py:83
↓ 1 callersMethod__init__
(self)
agents/models/beso/models/perceptual_encoders/multi_image_obs_encoder.py:13
↓ 1 callersMethod__init__
Computes the spatial softmax of a convolutional feature map. Read more here: "Learning visual feature spaces for robotic mani
agents/models/beso/models/perceptual_encoders/resnets.py:63
↓ 1 callersMethod__init__
( self, latent_dim: int = 512, model_type: str = 'v-cond', device: str = 'cuda
agents/models/beso/models/perceptual_encoders/voltron_encoder.py:23
↓ 1 callersMethod_decide_stage
(self)
agents/models/beso/utils/lr_schedulers/tri_stage_scheduler.py:111
↓ 1 callersFunction_download
(url: str, root: str)
agents/models/beso/models/networks/clip.py:518
↓ 1 callersFunction_get_chunkwise_fwbw_kernel
(autocast_kernel_dtype: torch.dtype)
agents/backbones/xlstm/mlstm_kernels/torch/chunkwise/triton_limit_chunk/fwbw.py:166
↓ 1 callersFunction_get_chunkwise_fwbw_kernel
(autocast_kernel_dtype: torch.dtype)
agents/backbones/xlstm/mlstm_kernels/torch/chunkwise/triton_xl_chunk/fwbw.py:233
↓ 1 callersFunction_get_chunkwise_fwbw_kernel
(autocast_kernel_dtype: torch.dtype)
agents/backbones/xlstm/mlstm_kernels/torch/chunkwise/native/fwbw.py:181
↓ 1 callersFunction_get_chunkwise_fwbw_kernel
Get the forward and backward pass function for the mLSTM kernels with chunkwise formulation. Args: autocast_kernel_dtype: The dtype
agents/backbones/xlstm/mlstm_kernels/jax/chunkwise/triton_limit_chunk/fwbw.py:198
↓ 1 callersFunction_get_chunkwise_fwbw_kernel
Get the forward and backward pass function for the mLSTM kernels with chunkwise formulation. Args: autocast_kernel_dtype: The dtype
agents/backbones/xlstm/mlstm_kernels/jax/chunkwise/triton_xl_chunk/fwbw.py:221
↓ 1 callersMethod_get_input_tensors
(self)
agents/backbones/xlstm/mlstm_kernels/utils/benchmark/benchmarks/training_kernel_benchmarks.py:285
↓ 1 callersMethod_get_input_tensors
(self)
agents/backbones/xlstm/mlstm_kernels/utils/benchmark/benchmarks/inference_kernel_benchmarks.py:29
↓ 1 callersMethod_get_input_tensors
(self)
agents/backbones/xlstm/mlstm_kernels/utils/benchmark/benchmarks/inference_kernel_benchmarks.py:99
↓ 1 callersMethod_get_input_tensors
(self)
agents/backbones/xlstm/mlstm_kernels/utils/benchmark/benchmarks/inference_kernel_benchmarks.py:168
↓ 1 callersMethod_get_input_tensors
(self)
agents/backbones/xlstm/mlstm_kernels/utils/benchmark/benchmarks/interface.py:118
↓ 1 callersMethod_get_kernel_fn
(self)
agents/backbones/xlstm/mlstm_kernels/utils/benchmark/benchmarks/training_kernel_benchmarks.py:382
↓ 1 callersMethod_get_kernel_fn
(self)
agents/backbones/xlstm/mlstm_kernels/utils/benchmark/benchmarks/inference_kernel_benchmarks.py:53
↓ 1 callersMethod_get_kernel_fn
(self)
agents/backbones/xlstm/mlstm_kernels/utils/benchmark/benchmarks/inference_kernel_benchmarks.py:126
↓ 1 callersMethod_get_kernel_fn
(self)
agents/backbones/xlstm/mlstm_kernels/utils/benchmark/benchmarks/inference_kernel_benchmarks.py:192
↓ 1 callersMethod_get_kernel_fn
Returns the kernel function to benchmark. The inputs to the kernel function are the tensors returned by `_get_input_tensors`.
agents/backbones/xlstm/mlstm_kernels/utils/benchmark/benchmarks/interface.py:121
↓ 1 callersMethod_get_meta
(self, attribute_name: str, meta: str, default: Optional[Any] = None)
agents/models/beso/utils/lr_schedulers/__init__.py:70
↓ 1 callersFunction_get_parallel_fwbw_kernel
(autocast_kernel_dtype: torch.dtype)
agents/backbones/xlstm/mlstm_kernels/torch/parallel/native_stablef/fwbw.py:77
↓ 1 callersFunction_get_parallel_fwbw_kernel
(autocast_kernel_dtype: torch.dtype)
agents/backbones/xlstm/mlstm_kernels/torch/parallel/triton_limit_headdim/fwbw.py:70
↓ 1 callersFunction_get_parallel_fwbw_kernel
(autocast_kernel_dtype: torch.dtype)
agents/backbones/xlstm/mlstm_kernels/torch/parallel/native/fwbw.py:77
↓ 1 callersFunction_get_parallel_fwbw_kernel
Get the forward and backward pass function for the mLSTM parallel formulation. Args: autocast_kernel_dtype: The dtype to use for the
agents/backbones/xlstm/mlstm_kernels/jax/parallel/native_stablef/fwbw.py:173
↓ 1 callersFunction_get_parallel_fwbw_kernel
Get the forward and backward pass function for the mLSTM parallel formulation. Args: autocast_kernel_dtype: The dtype to use for the
agents/backbones/xlstm/mlstm_kernels/jax/parallel/native/fwbw.py:173
↓ 1 callersMethod_get_vary_param_dicts
(self)
agents/backbones/xlstm/mlstm_kernels/utils/benchmark/param_handling.py:88
↓ 1 callersMethod_init_env
( self, env_name, img_width, img_height, render,
simulation/robocasa_pc_img_sim.py:232
↓ 1 callersMethod_init_env
( self, env_name, img_width, img_height, render, )
simulation/robocasa_sim.py:168
↓ 1 callersMethod_init_env
( self, env_name, img_width, img_height, render,
simulation/robocasa_pc_sim.py:221
↓ 1 callersMethod_load_clip
(self, model_name: str)
agents/encoders/clip_lang_encoder.py:20
↓ 1 callersMethod_loss
(self, pred, targ)
agents/models/ddpm/utils.py:78
↓ 1 callersFunction_mlstm_bw
( matDeltaHtilde: torch.Tensor, matQ: torch.Tensor, matK: torch.Tensor, matV: torch.Tensor,
agents/backbones/xlstm/mlstm_kernels/torch/parallel/_native_tiled.py:210
↓ 1 callersFunction_mlstm_chunkwise__parallel_bw_dQKV
( matQ: torch.Tensor, # (B, NH, S, DHQK) matK: torch.Tensor, # (B, NH, S, DHQK) matV: torch.Tens
agents/backbones/xlstm/mlstm_kernels/torch/chunkwise/native/bw.py:98
↓ 1 callersFunction_mlstm_chunkwise_fwbw_generator
Generate a forward and backward pass function for the mLSTM kernels with chunkwise formulation. Args: autocast_kernel_dtype: The dty
agents/backbones/xlstm/mlstm_kernels/jax/chunkwise/triton_limit_chunk/fwbw.py:14
↓ 1 callersFunction_mlstm_chunkwise_fwbw_generator
Generate a forward and backward pass function for the mLSTM kernels with chunkwise formulation. Args: autocast_kernel_dtype: The dty
agents/backbones/xlstm/mlstm_kernels/jax/chunkwise/triton_xl_chunk/fwbw.py:39
↓ 1 callersFunction_mlstm_fw
This is the core mLSTM operation in parallel form computed in tiles. This version is stabilized. We control the range of exp() arguments by en
agents/backbones/xlstm/mlstm_kernels/torch/parallel/_native_tiled.py:82
↓ 1 callersFunction_mlstm_parallel_fwbw_generator
Generate a forward and backward pass function for the mLSTM parallel formulation. Args: autocast_kernel_dtype: The dtype to use for
agents/backbones/xlstm/mlstm_kernels/jax/parallel/native_stablef/fwbw.py:67
↓ 1 callersFunction_mlstm_parallel_fwbw_generator
Generate a forward and backward pass function for the mLSTM parallel formulation. Args: autocast_kernel_dtype: The dtype to use for
agents/backbones/xlstm/mlstm_kernels/jax/parallel/native/fwbw.py:67
↓ 1 callersMethod_p_losses
Computes the training loss of the diffusion model given a batch of data. At every training sample of the batch we generate noisy samp
agents/models/ddpm/ddpm.py:135
↓ 1 callersMethod_p_mean_variance
Predicts the denoised x_{t-1} sample given the current diffusion model :param x: noisy input action :param t: batch of tim
agents/models/ddpm/ddpm.py:242
↓ 1 callersMethod_p_sample_loop
Main loop for generating samples using the learned model and the inverse diffusion step :param state: the current state observation
agents/models/ddpm/ddpm.py:184
↓ 1 callersMethod_predict_start_from_noise
Converts model output into prediction of x₀. If predict_epsilon=True: - model outputs predicted noise (ϵ) - w
agents/models/ddpm/ddpm.py:263
↓ 1 callersMethod_q_posterior
Computes the posterior mean and variance of the diffusion step at timestep t q( x_{t-1} | x_t, x_0)
agents/models/ddpm/ddpm.py:281
↓ 1 callersMethod_q_sample
Main Method to sample the forward diffusion start with random noise and get the required values for the desired noisy sample at q(x_{
agents/models/ddpm/ddpm.py:163
↓ 1 callersMethod_relative_position_bucket
(relative_position, causal = True, num_buckets = 32, max_distance = 128)
agents/models/beso/models/networks/transformers/position_embeddings.py:202
↓ 1 callersMethod_setup_forward_benchmark
(self)
agents/backbones/xlstm/mlstm_kernels/utils/benchmark/benchmarks/huggingface_model_benchmark.py:306
↓ 1 callersMethod_setup_generate_benchmark
(self)
agents/backbones/xlstm/mlstm_kernels/utils/benchmark/benchmarks/huggingface_model_benchmark.py:361
↓ 1 callersMethod_traverse_line
Return a (size, latent_size) latent sample, corresponding to a traversal of a latent variable indicated by idx. Parameters --
agents/utils/visualizer.py:95
↓ 1 callersMethod_update_trainable_state
(self, trainable: bool = True)
agents/models/beso/models/networks/transformers/perceiver_resampler.py:119
↓ 1 callersMethodallocate_inference_cache
(self, batch_size, max_seqlen, dtype=None, **kwargs)
agents/backbones/mamba/mamba.py:201
↓ 1 callersFunctionassert_size_at_dim_single
Ensure that array or tensor @x has size @size in dim @dim. Args: x (np.ndarray or torch.Tensor): input array or tensor size
agents/utils/tensor_util.py:824
↓ 1 callersMethodattention
(self, x: torch.Tensor)
agents/models/beso/models/networks/clip.py:245
↓ 1 callersMethodavailable_kernels
(self)
agents/backbones/xlstm/mlstm_kernels/utils/benchmark/benchmarks/inference_kernel_benchmarks.py:83
↓ 1 callersFunctionbasic_clean
(text)
agents/models/beso/utils/clip_tokenizer.py:50
↓ 1 callersMethodbatch_angle_between
(a, b)
agents/models/beso/utils/transforms.py:105
↓ 1 callersMethodbpe
(self, token)
agents/models/beso/utils/clip_tokenizer.py:83
↓ 1 callersMethodbuild_attention_mask
(self)
agents/models/beso/models/networks/clip.py:396
↓ 1 callersFunctionceildiv
(a: int, b: int)
agents/backbones/xlstm/mlstm_kernels/torch/parallel/_native_tiled.py:206
↓ 1 callersFunctionceildiv
(a, b)
agents/backbones/xlstm/mlstm_kernels/baselines/flash_linear_attention/gla/chunk_fuse.py:648
↓ 1 callersFunctioncheck_correctness
( test_specifier: str, baseline: np.ndarray, target: np.ndarray, atol: float = 1e-4, rtol:
agents/backbones/xlstm/mlstm_kernels/utils/test/checks.py:20
↓ 1 callersFunctionchunk_cumsum_bwd
( dz: torch.Tensor, dtype: torch.dtype | None = None, )
agents/backbones/xlstm/mlstm_kernels/baselines/flash_linear_attention/fla_utils.py:268
↓ 1 callersFunctionchunk_cumsum_fwd
( s: torch.Tensor, dtype: torch.dtype | None = None, )
agents/backbones/xlstm/mlstm_kernels/baselines/flash_linear_attention/fla_utils.py:253
↓ 1 callersFunctionchunk_reversed_cumsum_bwd
( dz: torch.Tensor, dtype: torch.dtype | None = None, )
agents/backbones/xlstm/mlstm_kernels/baselines/flash_linear_attention/fla_utils.py:448
↓ 1 callersFunctioncompute_chunkwise_log_gates_vecB
( vecF: torch.Tensor, # (B, NH, S) chunk_size: int, )
agents/backbones/xlstm/mlstm_kernels/torch/chunkwise/triton_xl_chunk/chunkwise_gates.py:51
↓ 1 callersFunctioncompute_chunkwise_log_gates_vecB_vecA
( vecI: torch.Tensor, # (B, NH, S) vecF: torch.Tensor, # (B, NH, S) chunk_size: int, )
agents/backbones/xlstm/mlstm_kernels/torch/chunkwise/triton_xl_chunk/chunkwise_gates.py:16
↓ 1 callersFunctioncompute_errors_per_batchhead
( baseline: np.ndarray, # (B, NH, S, ...) target: np.ndarray, # (B, NH, S, ...) )
agents/backbones/xlstm/mlstm_kernels/utils/plot/diff_lineplot.py:10
↓ 1 callersFunctioncompute_gate_grads_vecDeltaI_vecDeltaF
( matQ: torch.Tensor, matK: torch.Tensor, matDeltaQ: torch.Tensor, matDeltaK: torch.Tensor, vecF: torch.Te
agents/backbones/xlstm/mlstm_kernels/torch/chunkwise/triton_limit_chunk/chunkwise_gates.py:13
↓ 1 callersFunctioncompute_gate_grads_vecDeltaI_vecDeltaF
( matQ: torch.Tensor, matK: torch.Tensor, matDeltaQ: torch.Tensor, matDeltaK: torch.Tensor, vecF: torch.Te
agents/backbones/xlstm/mlstm_kernels/torch/chunkwise/triton_xl_chunk/chunkwise_gates.py:71
↓ 1 callersMethodcompute_input_embeddings
Compute the required embeddings for the visual ones and the latent goal.
agents/models/beso/beso.py:103
↓ 1 callersFunctioncompute_total_model_flops
( total_fw_block_flops: int = None, batch_size: int = None, num_blocks: int = None, vocab_size
agents/backbones/xlstm/mlstm_kernels/utils/flops/model_flops_computation.py:4
↓ 1 callersMethodcompute_val_embeddings
(self)
agents/models/beso/utils/automatic_lang_annotator_mp.py:84
↓ 1 callersMethodcontext_token_forward
(self, states, goals)
agents/backbones/encoder_decoder.py:153
↓ 1 callersMethodcontext_token_forward
( self, states, actions, goals, sigma )
agents/backbones/encoder_decoder.py:374
↓ 1 callersMethodconv_forward
(self, x: torch.Tensor)
agents/encoders/resnets.py:131
↓ 1 callersMethodconv_forward
(self, x: torch.Tensor)
agents/models/beso/models/perceptual_encoders/resnets.py:131
↓ 1 callersFunctionconvert_feedforward_weights
Modifies the state dict in place.
agents/backbones/xlstm/utils.py:83
↓ 1 callersFunctionconvert_mlstm_layer_weights_
Modifies the state dict in place.
agents/backbones/xlstm/utils.py:44
↓ 1 callersFunctionconvert_weights
Convert applicable model parameters to fp16
agents/models/beso/models/networks/clip.py:443
↓ 1 callersMethodcopy_to
Copy current parameters into given collection of parameters. Args: parameters: Iterable of `torch.nn.Parameter`; the parame
agents/utils/ema.py:54
↓ 1 callersFunctioncosine_beta_schedule
cosine schedule as proposed in https://openreview.net/forum?id=-NEXDKk8gZ
agents/models/beso/models/edm_diffusion/gc_sampling.py:47
↓ 1 callersFunctioncount_flops_ffn_layer_fw
(S, d, pf, factor_gelu=1, count_ln_flops: Callable[[int], int] = _count_ln_flops)
agents/backbones/xlstm/mlstm_kernels/utils/flops/mlstm_block_flop_counts.py:86
← previousnext →201–300 of 1,241, ranked by callers