Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/ReinFlow/ReinFlow
/ functions
Functions
864 in github.com/ReinFlow/ReinFlow
⨍
Functions
864
◇
Types & classes
170
↳
Endpoints
1
↓ 1 callers
Function
parse_column_name
(col)
agent/eval/visualize/compare_denoising_models_finetune.py:66
↓ 1 callers
Function
parse_column_name
(col)
agent/eval/visualize/sensitivity_sigma_entropy.py:70
↓ 1 callers
Function
plot_3d_eval_statistics
Plot 3D bar plots for evaluation statistics with (x, y, z) = (n_episodes, denoising_step, metric). Parameters: - eval_statistics_list: L
agent/eval/visualize/utils.py:354
↓ 1 callers
Function
plot_3d_eval_statistics_groups_same_color
Plot multiple 3D surface plots in a single figure to compare evaluation statistics across different groups, such as finetuned and pretrained
agent/eval/visualize/utils.py:719
↓ 1 callers
Function
plot_eval_statistics
Plot evaluation statistics for multiple models with filtered denoising steps. Parameters: - eval_statistics_list: List of tuples contain
agent/eval/visualize/utils.py:137
↓ 1 callers
Function
plot_eval_statistics
(eval_statistics_pretrain, eval_statistics_finetune, inferen
agent/eval/visualize/compare.py:29
↓ 1 callers
Function
plot_eval_statistics
(eval_statistics_, inference_steps, model_name = 'ReFlow',
agent/eval/visualize/plot_single.py:29
↓ 1 callers
Function
plot_eval_statistics
Plot evaluation statistics for multiple models. Parameters: - eval_statistics_list: List of tuples containing evaluation statistics for
agent/eval/visualize/compare_multiple.py:30
↓ 1 callers
Method
plot_eval_statistics
(self, eval_statistics, log_dir: str)
agent/eval/eval_agent_base.py:464
↓ 1 callers
Function
plot_reward_vs_denoising
Plot average episode reward vs. denoising steps for multiple models. Parameters: - eval_statistics_list: List of tuples containing evalu
agent/eval/visualize/compare_multiple.py:203
↓ 1 callers
Method
print_architecture
(self)
agent/finetune/reinflow/train_ppo_agent.py:228
↓ 1 callers
Method
print_architecture
(self)
agent/pretrain/train_diffusion_agent.py:48
↓ 1 callers
Method
prior_logp
Compute log-density of the prior distribution. Useful for computing the log-likelihood via probability flow ODE. Args: z:
model/diffusion/sde_lib.py:104
↓ 1 callers
Method
process_noise
input: torch.Tensor([B, Ta , Da]) log \sigma^2 output: torch.Tensor([B, 1, Ta * Da]), sigma, floating poin
model/flow/mlp_flow.py:203
↓ 1 callers
Function
quat2mat
Convert Quaternion to Euler Angles. See rotation.py for notes
agent/dataset/d3il_dataset/geo_transform.py:165
↓ 1 callers
Method
render
(self, mode="rgb_array", width:int=256, height:int=256)
env/gym_utils/wrapper/robomimic_lowdim.py:182
↓ 1 callers
Function
repeated_box
(box_space, n)
env/gym_utils/wrapper/multi_step.py:45
↓ 1 callers
Method
report_network_params
(self)
model/flow/ft_ppo/ppoflow.py:159
↓ 1 callers
Method
reset
Ignore passed-in arguments like seed
env/gym_utils/wrapper/mujoco_locomotion_lowdim.py:68
↓ 1 callers
Method
reset
Ignore passed-in arguments like seed
env/gym_utils/wrapper/d3il_lowdim.py:69
↓ 1 callers
Method
reset
Ignore passed-in arguments like seed
env/gym_utils/wrapper/robomimic_image.py:143
↓ 1 callers
Method
reset_env_all
(self, verbose=False, options_venv=None, **kwargs)
agent/eval/eval_agent_base.py:175
↓ 1 callers
Method
reset_env_all
(self, verbose=False, options_venv=None, **kwargs)
agent/pretrain/train_agent.py:535
↓ 1 callers
Method
resume_training
(self)
agent/finetune/reinflow/train_ppo_flow_agent.py:145
↓ 1 callers
Method
resume_training
(self)
agent/finetune/reinflow/train_ppo_shortcut_agent.py:141
↓ 1 callers
Method
reverse
Create the reverse-time SDE/ODE. Args: score_fn: A time-dependent score-based model that takes x and t and returns the score.
model/diffusion/sde_lib.py:135
↓ 1 callers
Function
sample_dataset
Collect an expert dataset from an SAC agent in the Humanoid-v3 environment and save it as an .npz file. Parameters: - sac: The train
util/sac_humanoid_sampler.py:45
↓ 1 callers
Method
sample_time
Sample time steps from a specified distribution in [0, 1). Args: batch_size: Number of time samples to generate. time
model/flow/reflow.py:106
↓ 1 callers
Method
save_best_model
(self)
agent/pretrain/train_agent.py:422
↓ 1 callers
Method
save_model
saves model to disk; no ema recorded because we are doing RLFT. for evaluation purpose, set ``only_save_policy`` to True. This option
agent/finetune/reinflow/train_ppo_flow_agent.py:218
↓ 1 callers
Method
save_model
saves model to disk; no ema recorded because we are doing RLFT. for evaluation purpose, set ``only_save_policy`` to True. This option
agent/finetune/reinflow/train_ppo_shortcut_agent.py:213
↓ 1 callers
Method
seed
(self, seed=None)
env/gym_utils/wrapper/mujoco_locomotion_lowdim.py:62
↓ 1 callers
Method
seed
(self, seed=None)
env/gym_utils/wrapper/robomimic_lowdim.py:113
↓ 1 callers
Method
set_betas
(self, betas, min_beta=0.01)
model/diffusion/sde_lib.py:191
↓ 1 callers
Function
set_seed_everywhere
(seed:int)
util/reproducibility.py:24
↓ 1 callers
Method
set_train_val_split
Not doing validation right now
agent/dataset/sequence.py:162
↓ 1 callers
Method
single_run
(self, num_denoising_steps, options_venv)
agent/eval/eval_agent_base.py:313
↓ 1 callers
Function
sort_handles_by_labels
Show the legends of your curves in desired order. **Use case** ```python handle, = ax.plot(..., label=xxx, ...) handles.app
util/process.py:58
↓ 1 callers
Method
step
Takes in a chunk of actions of length n_action_steps and steps the environment n_action_steps times and returns an aggregated
env/gym_utils/wrapper/furniture.py:133
↓ 1 callers
Method
step
(self, epoch=None)
util/scheduler_simple.py:46
↓ 1 callers
Method
stochastic_interpolate
(self,t)
model/flow/mlp_flow.py:329
↓ 1 callers
Function
take_last_n
(x, n)
env/gym_utils/wrapper/multi_step.py:66
↓ 1 callers
Function
to_device
(x, device=DEVICE)
agent/pretrain/utils.py:26
↓ 1 callers
Method
transform
(self, reward)
util/reward_scaling_ts.py:75
↓ 1 callers
Method
transform
(self, reward)
util/reward_scaling.py:91
↓ 1 callers
Method
unnormaliza_action
(self, action)
env/gym_utils/wrapper/d3il_lowdim.py:90
↓ 1 callers
Method
unnormalize_action
(self, action)
env/gym_utils/wrapper/mujoco_locomotion_lowdim.py:83
↓ 1 callers
Method
unnormalize_action
(self, action)
env/gym_utils/wrapper/robomimic_lowdim.py:103
↓ 1 callers
Method
unnormalize_action
(self, action)
env/gym_utils/wrapper/robomimic_image.py:113
↓ 1 callers
Function
unnormalize_obs
(obs)
env/plot_traj.py:66
↓ 1 callers
Method
update
(self, x)
util/reward_scaling_ts.py:36
↓ 1 callers
Method
update_adv_returns
obs_venv: dict containing numpy.ndarray
agent/finetune/reinflow/buffer.py:102
↓ 1 callers
Method
update_adv_returns
Do image augmentation on the whole buffer, and compute value, logprobabilities, adv, and return on those augmentated data. obs_venv:
agent/finetune/reinflow/buffer.py:572
↓ 1 callers
Method
update_adv_returns
obs_venv: dict containing numpy.ndarray
agent/finetune/reinflow/buffer.py:756
↓ 1 callers
Method
update_adv_returns
Do image augmentation on the whole buffer, and compute value, logprobabilities, adv, and return on those augmentated data. obs_venv:
agent/finetune/reinflow/buffer.py:1144
↓ 1 callers
Method
update_adv_returns
obs_venv: dict containing numpy.ndarray
agent/finetune/reinflow/buffer.py:1336
↓ 1 callers
Method
update_average
(self, old, new)
agent/pretrain/train_agent.py:717
↓ 1 callers
Method
update_from_moments
(self, batch_mean, batch_var, batch_count)
util/reward_scaling_ts.py:43
↓ 1 callers
Method
update_from_moments
(self, batch_mean, batch_var, batch_count)
util/reward_scaling.py:53
↓ 1 callers
Method
update_lr
(self, val_metric=None)
agent/finetune/reinflow/train_ppo_flow_agent.py:305
↓ 1 callers
Method
update_lr
(self, val_metric=None)
agent/finetune/reinflow/train_ppo_shortcut_agent.py:301
↓ 1 callers
Method
update_lr_adaptive_kl
(self, approx_kl)
agent/finetune/reinflow/train_ppo_shortcut_agent.py:307
↓ 1 callers
Method
update_model_average
(self, ma_model, current_model)
agent/pretrain/train_agent.py:711
↓ 1 callers
Method
update_step
(self, batch)
agent/finetune/reinflow/train_ppo_agent.py:392
↓ 1 callers
Method
update_value_logprob
bug fix
agent/finetune/reinflow/buffer.py:545
↓ 1 callers
Method
update_value_logprob
bug fix
agent/finetune/reinflow/buffer.py:734
↓ 1 callers
Method
update_value_logprob
bug fix
agent/finetune/reinflow/buffer.py:1111
↓ 1 callers
Method
update_value_logprob
bug fix
agent/finetune/reinflow/buffer.py:1309
↓ 1 callers
Function
upload_pkl_to_wandb
Loads .pkl file generated by training logs and pushes its entries to WandB.
util/pkl2wandb.py:30
↓ 1 callers
Method
visualize_lr
(self, cfg)
agent/finetune/reinflow/train_ppo_agent.py:199
Method
T
End time of the SDE.
model/diffusion/sde_lib.py:85
Method
T
(self)
model/diffusion/sde_lib.py:154
Method
T
(self)
model/diffusion/sde_lib.py:199
Method
__call__
Match input batch size, but do not depend on input
model/diffusion/eta.py:53
Method
__call__
Match input batch size, but do not depend on input
model/diffusion/eta.py:86
Method
__call__
(self, cond)
model/diffusion/eta.py:128
Method
__call__
(self, cond)
model/diffusion/eta.py:175
Method
__call__
(self, x)
model/common/modules.py:70
Method
__call__
(self, **kwargs)
env/plot_traj.py:44
Method
__call__
(self, reward, first)
util/reward_scaling_ts.py:65
Method
__call__
(self, reward, first)
util/reward_scaling.py:83
Method
__call__
(self, reset=True)
util/timer.py:54
Method
__del__
(self)
env/gym_utils/async_vector_env.py:680
Method
__del__
(self)
env/gym_utils/vector_env.py:239
Method
__getattr__
(self, name)
env/gym_utils/vector_env.py:291
Method
__getitem__
repeat states/images if using history observation at the beginning of the episode
agent/dataset/sequence.py:107
Method
__getitem__
(self, idx)
agent/dataset/sequence.py:272
Method
__getitem__
(self, idx)
agent/dataset/d3il_dataset/stacking_dataset.py:212
Method
__getitem__
(self, idx)
agent/dataset/d3il_dataset/stacking_dataset.py:387
Method
__getitem__
(self, idx)
agent/dataset/d3il_dataset/pushing_dataset.py:153
Method
__getitem__
(self, idx)
agent/dataset/d3il_dataset/sorting_dataset.py:276
Method
__getitem__
(self, idx)
agent/dataset/d3il_dataset/sorting_dataset.py:466
Method
__getitem__
(self, idx)
agent/dataset/d3il_dataset/avoiding_dataset.py:118
Method
__getitem__
(self, idx)
agent/dataset/d3il_dataset/aligning_dataset.py:158
Method
__getitem__
(self, idx)
agent/dataset/d3il_dataset/aligning_dataset.py:331
Method
__init__
( self, in_channels, out_channels, cond_dim, kernel_size=5, n_
model/diffusion/unet.py:51
Method
__init__
( self, backbone, action_dim, img_cond_steps=1, cond_dim=None,
model/diffusion/unet.py:354
Method
__init__
( self, network_path, ft_denoising_steps, # if running pre-trained model (not fine-tu
model/diffusion/diffusion_eval.py:42
Method
__init__
( self, backbone, action_dim, horizon_steps, cond_dim, img_con
model/diffusion/mlp_diffusion.py:44
Method
__init__
( self, use_ddim=False, # modifying denoising schedule min_sampling_denoising_
model/diffusion/diffusion_rwr.py:41
← previous
next →
301–400 of 864, ranked by callers