MCPcopy Create free account
hub / github.com/NVIDIA/DreamDojo

github.com/NVIDIA/DreamDojo @main

Chat with this repo
repository ↗ · DeepWiki ↗ · + Follow
4,570 symbols 16,154 edges 580 files ⚖ Apache-2.0 1,640 documented · 36% updated 5mo ago★ 1,06317 open issues

Browse by type

Functions 3,821 Types & classes 738 Endpoints 11
What it actually does AI analysis from the code graph — generated when you open this
loading…
README

<a href="https://dreamdojo-world.github.io/"><strong>Website</strong></a> | 
<a href="https://arxiv.org/abs/2602.06949"><strong>Paper</strong></a> |
<a href="https://huggingface.co/nvidia/DreamDojo"><strong>Models</strong></a> |
<a href="https://huggingface.co/datasets/nvidia/PhysicalAI-Robotics-GR00T-Teleop-GR1"><strong>Datasets</strong></a>

💭 DreamDojo

🔥 Highlights

DreamDojo is an interactive world model that learns from large-scale human videos. In short, we made the following key contributions:

  • A large-scale video dataset. 44k hours of diverse human egocentric videos, the largest dataset to date for world model pretraining.
  • A foundation world model. The first robot world model of its kind that demonstrates strong generalization to diverse objects and environments after post-training.
  • A distillation pipeline. After distillation, our model can achieve long-horizon autoregressive generation, with stable real-time interactions at 10 FPS for over 1 minute.

📢 News

  • [2026/02/18] We released both pretraining and post-training code.
  • [2026/02/18] We released all pretrained and post-trained checkpoints (2B and 14B).
  • [2026/02/18] We released the GR-1 post-training datasets and the evaluation sets.
  • [2026/02/09] We released our paper on arXiv.

🕹️ Quick Start

⭐ Citation

If you find our work useful, please consider citing us and giving a star to our repo.

@article{gao2026dreamdojo,
    title={DreamDojo: A Generalist Robot World Model from Large-Scale Human Videos},
    author={Shenyuan Gao and William Liang and Kaiyuan Zheng and Ayaan Malik and Seonghyeon Ye and Sihyun Yu and Wei-Cheng Tseng and Yuzhu Dong and Kaichun Mo and Chen-Hsuan Lin and Qianli Ma and Seungjun Nah and Loic Magne and Jiannan Xiang and Yuqi Xie and Ruijie Zheng and Dantong Niu and You Liang Tan and K.R. Zentner and George Kurian and Suneel Indupuru and Pooya Jannaty and Jinwei Gu and Jun Zhang and Jitendra Malik and Pieter Abbeel and Ming-Yu Liu and Yuke Zhu and Joel Jang and Linxi "Jim" Fan},
    journal={arXiv preprint arXiv:2602.06949},
    year={2026}
}

⚖️ License

DreamDojo source code is released under the Apache-2.0 license.

Star History Chart

Core symbols most depended-on inside this repo

browse all functions →

Shape

Method 2,648
Function 1,173
Class 738
Route 11

Languages

Python100%

Modules by API surface

cosmos_predict2/_src/predict2/camera/networks/dit_multiview_camera_ar.py99 symbols
cosmos_predict2/_src/predict2/camera/networks/dit_multiview_camera.py99 symbols
cosmos_predict2/_src/predict2/networks/minimal_v4_dit.py98 symbols
cosmos_predict2/_src/reason1/networks/qwen2_vl.py92 symbols
cosmos_predict2/_src/reason1/networks/qwen2_5_vl.py87 symbols
cosmos_predict2/_src/imaginaire/utils/validator.py73 symbols
cosmos_predict2/_src/imaginaire/utils/callback.py72 symbols
cosmos_predict2/_src/predict2/tokenizers/wan2pt2.py68 symbols
cosmos_predict2/_src/predict2/tokenizers/wan2pt1.py68 symbols
cosmos_predict2/_src/predict2/networks/wan2pt1.py60 symbols
cosmos_predict2/_src/predict2/conditioner.py55 symbols
groot_dreams/data/dataset.py54 symbols

For agents

$ claude mcp add DreamDojo \
  -- python -m otcore.mcp_server <graph>

⬇ download graph artifact

Ask about this repo answers extend the page