Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/EMI-Group/evorl
/ functions
Functions
1,203 in github.com/EMI-Group/evorl
⨍
Functions
1,203
◇
Types & classes
249
↳
Endpoints
1
Method
compute_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/sac.py:270
Method
compute_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/ppo.py:101
Method
compute_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/dqn.py:96
Method
compute_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/contrib/td3_v3.py:104
Method
compute_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/ec/ec_agent.py:71
Function
compute_centered_ranks
Get centered ranks in [-0.5, 0.5].
evorl/ec/optimizers/openes.py:27
Function
compute_std
(summed_variance: chex.Array, std: chex.Array)
evorl/utils/running_statistics.py:168
Method
contains
Determine whether the input is in the space. Returns: A boolean value about whether x is in the space.
evorl/envs/space.py:26
Method
contains
(self, x: chex.Array)
evorl/envs/space.py:79
Function
create_wrapped_mabrax_env
( env_name: str, episode_length: int = 1000, parallel: int = 1, autoreset_mode: AutoresetMode
evorl/envs/jaxmarl.py:176
Method
critic_loss
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/sac.py:337
Function
critic_loss_fn
(agent_state, sample_batch, key)
evorl/algorithms/contrib/td3_onpolicy.py:287
Function
critic_loss_fn
(agent_state, sample_batch, key)
evorl/algorithms/contrib/pop_episodic_td3.py:299
Function
critic_loss_fn
(agent_state, sample_batch, key)
evorl/algorithms/erl/cemrl_td3/cemrl_td3_workflow.py:191
Function
critic_loss_fn
(agent_state, sample_batch, key)
evorl/algorithms/erl/erl_td3/erl_td3_workflow.py:300
Function
critic_loss_fn
(agent_state, sample_batch, key)
evorl/algorithms/erl/erl_td3/erl_eda.py:445
Method
critic_loss_fn
(agent_state, sample_batch, key)
evorl/algorithms/ddpg.py:332
Method
critic_loss_fn
(params, agent_state, sample_batch, key)
evorl/algorithms/td7.py:623
Method
critic_loss_fn
(agent_state, sample_batch, key)
evorl/algorithms/td3.py:396
Method
critic_loss_fn
(agent_state, sample_batch, key)
evorl/algorithms/sac.py:564
Method
critic_loss_fn
(agent_state, sample_batch, key)
evorl/algorithms/contrib/pop_td3.py:253
Method
critic_loss_fn
(agent_state, sample_batch, key)
evorl/algorithms/contrib/td3_v2.py:73
Method
critic_loss_fn
(agent_state, sample_batch, key)
evorl/algorithms/meta/pbt_sac/param_sac.py:266
Method
custom_setattr
(self, name: str, value: Any)
evorl/types.py:266
Function
decentralized_rollout
Collect given rollout_length trajectory. Tips: when use jax.jit, use: jax.jit(partial(rollout, env, agent)) Args: env: vmapped env w
evorl/rollout_ma.py:69
Function
decentralized_rollout_with_shared_model
Centrialized Execution: Collect given rollout_length trajectory. Args: env: vmapped env w/ autoreset Returns: env_state: las
evorl/rollout_ma.py:154
Method
delete
(self, step: int)
evorl/utils/orbax_utils.py:103
Function
denormalize
Denormalizes values in a nested structure using the given mean/std. Only values of inexact types are denormalized. See https://numpy.org/doc/
evorl/utils/running_statistics.py:206
Function
denormalize_leaf
( data: chex.Array, mean: chex.Array, std: chex.Array )
evorl/utils/running_statistics.py:221
Method
directory
(self)
evorl/utils/orbax_utils.py:82
Function
disable_gpu_preallocation
Disable GPU memory preallocation for XLA. Call this method at the beginning of your script.
evorl/utils/jax_utils.py:13
Function
enable_deterministic_mode
Enable deterministic mode for JAX. Call this method at the beginning of your script.
evorl/utils/jax_utils.py:48
Method
enable_jit
(cls)
evorl/workflows/ec_workflow.py:350
Method
enable_jit
(cls)
evorl/algorithms/offpolicy_utils.py:246
Method
enable_jit
(cls)
evorl/algorithms/erl/cemrl_td3/cemrl_origin.py:264
Method
enable_jit
(cls)
evorl/algorithms/erl/erl_td3/erl_origin.py:234
Method
enable_jit
(cls)
evorl/algorithms/meta/pbt_workflow.py:736
Method
enable_jit
(cls)
evorl/algorithms/ec/so/es_workflow.py:99
Method
enable_multi_devices
Whether multi-devices training is enabled.
evorl/workflows/rl_workflow.py:38
Method
enable_multi_devices
Whether multi-devices training is enabled.
evorl/workflows/ec_workflow.py:56
Method
enable_shmap
(cls, axis_name)
evorl/workflows/ec_workflow.py:355
Method
enable_shmap
(cls, axis_name)
evorl/algorithms/ec/so/es_workflow.py:104
Method
encoder_loss_fn
(params, agent_state, sample_batch, key)
evorl/algorithms/td7.py:615
Method
epoch_step
(carry, _)
evorl/algorithms/impala.py:442
Method
epoch_step
(carry, _)
evorl/algorithms/ppo.py:435
Method
epoch_step
(carry, _)
evorl/algorithms/contrib/td3_onpolicy.py:193
Method
epoch_step
(carry, _)
evorl/algorithms/meta/pbt_ppo/param_ppo.py:317
Function
erl_mutate
Mutation used in the original ERL for MLP. Args: key: PRNGKey x: single individual, vec_relative_prob: probability of mut
evorl/ec/operators/mutation/erl_mutation.py:12
Function
eval_env_step
Collect one-step data in evaluation mode.
evorl/rollout.py:69
Function
eval_env_step
( env_fn: EnvStepFn, action_fn: AgentActionFn, env_state: EnvState, agent_state: AgentState,
evorl/evaluators/mo_brax_evaluator.py:117
Function
eval_rollout_episode
Evaulate a batch of episodic trajectories. It avoids unnecessary calls of `env_step()` when all environments are done. However, the agent's actio
evorl/rollout.py:144
Method
evaluate
(self, state: State)
evorl/workflows/rl_workflow.py:231
Method
evaluate
(self, state: State)
evorl/workflows/rl_workflow.py:380
Method
evaluate
( self, agent_state: chex.ArrayTree, key: chex.PRNGKey, num_episodes: int )
evorl/evaluators/mo_brax_evaluator.py:42
Method
evaluate
(self, state: State)
evorl/algorithms/erl/erl_workflow.py:238
Method
evaluate
(self, state: State)
evorl/algorithms/erl/cemrl_workflow.py:230
Method
evaluate_actions
Get the best action from the action distribution. This method is exclusively used for evaluation. Args: agent_state: the
evorl/agent.py:107
Method
evaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/agent.py:161
Method
evaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/ddpg.py:119
Method
evaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/impala.py:122
Method
evaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/a2c.py:115
Method
evaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/td7.py:255
Method
evaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/td3.py:124
Method
evaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/sac.py:117
Method
evaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/sac.py:282
Method
evaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/ppo.py:124
Method
evaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/dqn.py:113
Method
evaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/contrib/td3_v3.py:119
Method
evaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/ec/ec_agent.py:94
Method
evaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/ec/ec_agent.py:156
Method
evaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
tests/utils.py:127
Function
exp_uniform_init
Sample from exp(-x).
evorl/algorithms/meta/pbt_utils.py:72
Method
exploit_and_explore
( self, pbt_opt_state: PBTOptState, pop: chex.ArrayTree, pop_workflow_state: S
evorl/algorithms/meta/pbt_workflow.py:337
Method
exploit_and_explore
( self, pbt_opt_state: PBTOptState, pop: chex.ArrayTree, pop_workflow_state: S
evorl/algorithms/meta/pbt_workflow.py:362
Method
exploit_and_explore
( self, pbt_opt_state: PBTOptState, # shared pop: chex.ArrayTree, # sharding
evorl/algorithms/meta/pbt_ppo/pbt_cso_param_ppo.py:60
Function
explore
Define the exploration operation for PBT. Normally explore the local of an individual. i.e., mutation op in the context of EC. Here we us
evorl/algorithms/meta/pbt_operations.py:7
Function
f
(x)
evorl/utils/orbax_utils.py:56
Function
f
(opt_state, params, *args, **kwargs)
evorl/distributed/gradients.py:48
Method
f
(state, _)
evorl/envs/wrappers/action_wrapper.py:51
Function
get_1d_array
Get statistics of a 1D array. Similar to `get_1d_array_statistics`, but instead of recording histogram, WandB will record the raw data.
evorl/recorders/wandb_recorder.py:85
Function
get_ec_pop_statistics
(pop)
evorl/algorithms/erl/erl_td3/erl_origin.py:250
Method
get_space
(obs_size)
evorl/envs/mujoco_playground.py:103
Method
get_space
(obs_size)
evorl/envs/brax.py:71
Function
get_trancated_norm_dist
Get a truncated normal distribution.
evorl/distribution.py:46
Method
global_step_env
( self, key: chex.PRNGKey, state: envs.State, global_action: chex.Array, )
evorl/envs/jaxmarl_envs/mabrax.py:100
Function
h
(*args, **kwargs)
evorl/distributed/gradients.py:18
Function
has_nan
Check if the array has NaN values.
evorl/utils/jax_utils.py:269
Method
index_set
( self, idx: jax.Array | Sequence[jax.Array], o: chex.ArrayTree )
evorl/types.py:73
Method
index_sum
( self, idx: jax.Array | Sequence[jax.Array], o: chex.ArrayTree )
evorl/types.py:78
Method
init
Initialize the workflow's state. Args: key: JAX PRNGKey Returns: state: the state of the workflow
evorl/workflows/workflow.py:19
Method
init
(self)
evorl/recorders/recorder.py:39
Method
init
(self)
evorl/recorders/wandb_recorder.py:26
Method
init
(self)
evorl/recorders/log_recorder.py:33
Method
init
Initialize the state of the replay buffer. Args: sample_spec: A single sample or sample spec that contains the pytree structure a
evorl/replay_buffers/replay_buffer.py:30
Method
init
(self, spec: chex.ArrayTree)
evorl/replay_buffers/replay_buffer.py:103
Method
init
(self, spec: chex.ArrayTree)
evorl/replay_buffers/prioritized_replay_buffer.py:44
Method
init
(self, mean: Params, key: chex.PRNGKey)
evorl/ec/optimizers/vanilla_es.py:40
Method
init
(self, key: chex.PRNGKey)
evorl/ec/optimizers/evox_wrapper.py:30
Method
init
(self, mean: Params, key: chex.PRNGKey)
evorl/ec/optimizers/cem.py:50
Method
init
(self, pop: chex.ArrayTree, key: chex.PRNGKey)
evorl/ec/optimizers/vanilla_ga.py:59
← previous
next →
801–900 of 1,203, ranked by callers