MCPcopy Create free account

hub / github.com/EMI-Group/evorl / functions

Functions1,203 in github.com/EMI-Group/evorl

Methodcompute_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/sac.py:270
Methodcompute_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/ppo.py:101
Methodcompute_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/dqn.py:96
Methodcompute_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/contrib/td3_v3.py:104
Methodcompute_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/ec/ec_agent.py:71
Functioncompute_centered_ranks
Get centered ranks in [-0.5, 0.5].
evorl/ec/optimizers/openes.py:27
Functioncompute_std
(summed_variance: chex.Array, std: chex.Array)
evorl/utils/running_statistics.py:168
Methodcontains
Determine whether the input is in the space. Returns: A boolean value about whether x is in the space.
evorl/envs/space.py:26
Methodcontains
(self, x: chex.Array)
evorl/envs/space.py:79
Functioncreate_wrapped_mabrax_env
( env_name: str, episode_length: int = 1000, parallel: int = 1, autoreset_mode: AutoresetMode
evorl/envs/jaxmarl.py:176
Methodcritic_loss
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/sac.py:337
Functioncritic_loss_fn
(agent_state, sample_batch, key)
evorl/algorithms/contrib/td3_onpolicy.py:287
Functioncritic_loss_fn
(agent_state, sample_batch, key)
evorl/algorithms/contrib/pop_episodic_td3.py:299
Functioncritic_loss_fn
(agent_state, sample_batch, key)
evorl/algorithms/erl/cemrl_td3/cemrl_td3_workflow.py:191
Functioncritic_loss_fn
(agent_state, sample_batch, key)
evorl/algorithms/erl/erl_td3/erl_td3_workflow.py:300
Functioncritic_loss_fn
(agent_state, sample_batch, key)
evorl/algorithms/erl/erl_td3/erl_eda.py:445
Methodcritic_loss_fn
(agent_state, sample_batch, key)
evorl/algorithms/ddpg.py:332
Methodcritic_loss_fn
(params, agent_state, sample_batch, key)
evorl/algorithms/td7.py:623
Methodcritic_loss_fn
(agent_state, sample_batch, key)
evorl/algorithms/td3.py:396
Methodcritic_loss_fn
(agent_state, sample_batch, key)
evorl/algorithms/sac.py:564
Methodcritic_loss_fn
(agent_state, sample_batch, key)
evorl/algorithms/contrib/pop_td3.py:253
Methodcritic_loss_fn
(agent_state, sample_batch, key)
evorl/algorithms/contrib/td3_v2.py:73
Methodcritic_loss_fn
(agent_state, sample_batch, key)
evorl/algorithms/meta/pbt_sac/param_sac.py:266
Methodcustom_setattr
(self, name: str, value: Any)
evorl/types.py:266
Functiondecentralized_rollout
Collect given rollout_length trajectory. Tips: when use jax.jit, use: jax.jit(partial(rollout, env, agent)) Args: env: vmapped env w
evorl/rollout_ma.py:69
Functiondecentralized_rollout_with_shared_model
Centrialized Execution: Collect given rollout_length trajectory. Args: env: vmapped env w/ autoreset Returns: env_state: las
evorl/rollout_ma.py:154
Methoddelete
(self, step: int)
evorl/utils/orbax_utils.py:103
Functiondenormalize
Denormalizes values in a nested structure using the given mean/std. Only values of inexact types are denormalized. See https://numpy.org/doc/
evorl/utils/running_statistics.py:206
Functiondenormalize_leaf
( data: chex.Array, mean: chex.Array, std: chex.Array )
evorl/utils/running_statistics.py:221
Methoddirectory
(self)
evorl/utils/orbax_utils.py:82
Functiondisable_gpu_preallocation
Disable GPU memory preallocation for XLA. Call this method at the beginning of your script.
evorl/utils/jax_utils.py:13
Functionenable_deterministic_mode
Enable deterministic mode for JAX. Call this method at the beginning of your script.
evorl/utils/jax_utils.py:48
Methodenable_jit
(cls)
evorl/workflows/ec_workflow.py:350
Methodenable_jit
(cls)
evorl/algorithms/offpolicy_utils.py:246
Methodenable_jit
(cls)
evorl/algorithms/erl/cemrl_td3/cemrl_origin.py:264
Methodenable_jit
(cls)
evorl/algorithms/erl/erl_td3/erl_origin.py:234
Methodenable_jit
(cls)
evorl/algorithms/meta/pbt_workflow.py:736
Methodenable_jit
(cls)
evorl/algorithms/ec/so/es_workflow.py:99
Methodenable_multi_devices
Whether multi-devices training is enabled.
evorl/workflows/rl_workflow.py:38
Methodenable_multi_devices
Whether multi-devices training is enabled.
evorl/workflows/ec_workflow.py:56
Methodenable_shmap
(cls, axis_name)
evorl/workflows/ec_workflow.py:355
Methodenable_shmap
(cls, axis_name)
evorl/algorithms/ec/so/es_workflow.py:104
Methodencoder_loss_fn
(params, agent_state, sample_batch, key)
evorl/algorithms/td7.py:615
Methodepoch_step
(carry, _)
evorl/algorithms/impala.py:442
Methodepoch_step
(carry, _)
evorl/algorithms/ppo.py:435
Methodepoch_step
(carry, _)
evorl/algorithms/contrib/td3_onpolicy.py:193
Methodepoch_step
(carry, _)
evorl/algorithms/meta/pbt_ppo/param_ppo.py:317
Functionerl_mutate
Mutation used in the original ERL for MLP. Args: key: PRNGKey x: single individual, vec_relative_prob: probability of mut
evorl/ec/operators/mutation/erl_mutation.py:12
Functioneval_env_step
Collect one-step data in evaluation mode.
evorl/rollout.py:69
Functioneval_env_step
( env_fn: EnvStepFn, action_fn: AgentActionFn, env_state: EnvState, agent_state: AgentState,
evorl/evaluators/mo_brax_evaluator.py:117
Functioneval_rollout_episode
Evaulate a batch of episodic trajectories. It avoids unnecessary calls of `env_step()` when all environments are done. However, the agent's actio
evorl/rollout.py:144
Methodevaluate
(self, state: State)
evorl/workflows/rl_workflow.py:231
Methodevaluate
(self, state: State)
evorl/workflows/rl_workflow.py:380
Methodevaluate
( self, agent_state: chex.ArrayTree, key: chex.PRNGKey, num_episodes: int )
evorl/evaluators/mo_brax_evaluator.py:42
Methodevaluate
(self, state: State)
evorl/algorithms/erl/erl_workflow.py:238
Methodevaluate
(self, state: State)
evorl/algorithms/erl/cemrl_workflow.py:230
Methodevaluate_actions
Get the best action from the action distribution. This method is exclusively used for evaluation. Args: agent_state: the
evorl/agent.py:107
Methodevaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/agent.py:161
Methodevaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/ddpg.py:119
Methodevaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/impala.py:122
Methodevaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/a2c.py:115
Methodevaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/td7.py:255
Methodevaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/td3.py:124
Methodevaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/sac.py:117
Methodevaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/sac.py:282
Methodevaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/ppo.py:124
Methodevaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/dqn.py:113
Methodevaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/contrib/td3_v3.py:119
Methodevaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/ec/ec_agent.py:94
Methodevaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
evorl/algorithms/ec/ec_agent.py:156
Methodevaluate_actions
( self, agent_state: AgentState, sample_batch: SampleBatch, key: chex.PRNGKey )
tests/utils.py:127
Functionexp_uniform_init
Sample from exp(-x).
evorl/algorithms/meta/pbt_utils.py:72
Methodexploit_and_explore
( self, pbt_opt_state: PBTOptState, pop: chex.ArrayTree, pop_workflow_state: S
evorl/algorithms/meta/pbt_workflow.py:337
Methodexploit_and_explore
( self, pbt_opt_state: PBTOptState, pop: chex.ArrayTree, pop_workflow_state: S
evorl/algorithms/meta/pbt_workflow.py:362
Methodexploit_and_explore
( self, pbt_opt_state: PBTOptState, # shared pop: chex.ArrayTree, # sharding
evorl/algorithms/meta/pbt_ppo/pbt_cso_param_ppo.py:60
Functionexplore
Define the exploration operation for PBT. Normally explore the local of an individual. i.e., mutation op in the context of EC. Here we us
evorl/algorithms/meta/pbt_operations.py:7
Functionf
(x)
evorl/utils/orbax_utils.py:56
Functionf
(opt_state, params, *args, **kwargs)
evorl/distributed/gradients.py:48
Methodf
(state, _)
evorl/envs/wrappers/action_wrapper.py:51
Functionget_1d_array
Get statistics of a 1D array. Similar to `get_1d_array_statistics`, but instead of recording histogram, WandB will record the raw data.
evorl/recorders/wandb_recorder.py:85
Functionget_ec_pop_statistics
(pop)
evorl/algorithms/erl/erl_td3/erl_origin.py:250
Methodget_space
(obs_size)
evorl/envs/mujoco_playground.py:103
Methodget_space
(obs_size)
evorl/envs/brax.py:71
Functionget_trancated_norm_dist
Get a truncated normal distribution.
evorl/distribution.py:46
Methodglobal_step_env
( self, key: chex.PRNGKey, state: envs.State, global_action: chex.Array, )
evorl/envs/jaxmarl_envs/mabrax.py:100
Functionh
(*args, **kwargs)
evorl/distributed/gradients.py:18
Functionhas_nan
Check if the array has NaN values.
evorl/utils/jax_utils.py:269
Methodindex_set
( self, idx: jax.Array | Sequence[jax.Array], o: chex.ArrayTree )
evorl/types.py:73
Methodindex_sum
( self, idx: jax.Array | Sequence[jax.Array], o: chex.ArrayTree )
evorl/types.py:78
Methodinit
Initialize the workflow's state. Args: key: JAX PRNGKey Returns: state: the state of the workflow
evorl/workflows/workflow.py:19
Methodinit
(self)
evorl/recorders/recorder.py:39
Methodinit
(self)
evorl/recorders/wandb_recorder.py:26
Methodinit
(self)
evorl/recorders/log_recorder.py:33
Methodinit
Initialize the state of the replay buffer. Args: sample_spec: A single sample or sample spec that contains the pytree structure a
evorl/replay_buffers/replay_buffer.py:30
Methodinit
(self, spec: chex.ArrayTree)
evorl/replay_buffers/replay_buffer.py:103
Methodinit
(self, spec: chex.ArrayTree)
evorl/replay_buffers/prioritized_replay_buffer.py:44
Methodinit
(self, mean: Params, key: chex.PRNGKey)
evorl/ec/optimizers/vanilla_es.py:40
Methodinit
(self, key: chex.PRNGKey)
evorl/ec/optimizers/evox_wrapper.py:30
Methodinit
(self, mean: Params, key: chex.PRNGKey)
evorl/ec/optimizers/cem.py:50
Methodinit
(self, pop: chex.ArrayTree, key: chex.PRNGKey)
evorl/ec/optimizers/vanilla_ga.py:59
← previousnext →801–900 of 1,203, ranked by callers