MCPcopy Index your code
hub / github.com/openai/spinningup

github.com/openai/spinningup @0.2

Chat with this repo
repository ↗ · DeepWiki ↗ · release 0.2 ↗ · + Follow
413 symbols 1,442 edges 68 files 104 documented · 25% updated 1y ago0.2 · 2020-01-30★ 11,849180 open issues
What it actually does AI analysis from the code graph — generated when you open this
loading…
README

Status: Maintenance (expect bug fixes and minor updates)

Welcome to Spinning Up in Deep RL!

This is an educational resource produced by OpenAI that makes it easier to learn about deep reinforcement learning (deep RL).

For the unfamiliar: reinforcement learning (RL) is a machine learning approach for teaching agents how to solve tasks by trial and error. Deep RL refers to the combination of RL with deep learning.

This module contains a variety of helpful resources, including:

  • a short introduction to RL terminology, kinds of algorithms, and basic theory,
  • an essay about how to grow into an RL research role,
  • a curated list of important papers organized by topic,
  • a well-documented code repo of short, standalone implementations of key algorithms,
  • and a few exercises to serve as warm-ups.

Get started at spinningup.openai.com!

Citing Spinning Up

If you reference or use Spinning Up in your research, please cite:

@article{SpinningUp2018,
    author = {Achiam, Joshua},
    title = {{Spinning Up in Deep Reinforcement Learning}},
    year = {2018}
}

Core symbols most depended-on inside this repo

log_tabular
called by 160
spinup/utils/logx.py
run
called by 61
spinup/utils/run_utils.py
add
called by 32
spinup/utils/run_utils.py
step
called by 28
spinup/algos/pytorch/vpg/core.py
store
called by 27
spinup/utils/logx.py
log
called by 26
spinup/utils/logx.py
dump_tabular
called by 15
spinup/utils/logx.py
setup_logger_kwargs
called by 14
spinup/utils/run_utils.py

Shape

Function 221
Method 145
Class 47

Languages

Python100%

Modules by API surface

spinup/algos/pytorch/vpg/core.py23 symbols
spinup/algos/pytorch/ppo/core.py23 symbols
spinup/algos/tf1/trpo/core.py21 symbols
spinup/utils/run_utils.py19 symbols
spinup/utils/logx.py18 symbols
spinup/algos/tf1/vpg/core.py13 symbols
spinup/algos/tf1/ppo/core.py13 symbols
spinup/algos/pytorch/td3/core.py12 symbols
spinup/algos/pytorch/sac/core.py12 symbols
spinup/algos/pytorch/ddpg/core.py12 symbols
spinup/utils/mpi_tools.py10 symbols
spinup/utils/mpi_tf.py10 symbols

For agents

$ claude mcp add spinningup \
  -- python -m otcore.mcp_server <graph>

⬇ download graph artifact