MCPcopy Index your code
hub / github.com/chenhaoxing/DiffusionInst

github.com/chenhaoxing/DiffusionInst @main

Chat with this repo
repository ↗ · DeepWiki ↗ · + Follow
235 symbols 664 edges 17 files 86 documented · 37%
What it actually does AI analysis from the code graph — generated when you open this
loading…
README

DiffusionInst: Diffusion Model for Instance Segmentation

PWC PWC

DiffusionInst is the first work of diffusion model for instance segmentation. We hope our work could serve as a simple yet effective baseline, which could inspire designing more efficient diffusion frameworks for challenging discriminative tasks.

DiffusionInst: Diffusion Model for Instance Segmentation
Zhangxuan Gu, Haoxing Chen, Zhuoer Xu, Jun Lan, Changhua Meng, Weiqiang Wang arXiv 2212.02773

Todo list:

  • [x] Release source code.
  • [x] Hyper-paramters tuning.
  • [x] Add Swin-Large backbone.
  • [x] Release trained models.
  • [ ] Adding directly filter denoising.

Getting Started

The installation instruction and usage are in Getting Started with DiffusionInst.

Trained Models

We now provide trained models for ResNet-50 and ResNet-101.

https://pan.baidu.com/s/1KEdjNY3CSXWp0VFwkhRKYg, pwd: jhbv.

Model Performance

Method Mask AP (1 step) Mask AP (4 step)
COCO-val-Res50 37.3 37.5
COCO-val-Res101 41.0 41.1
COCO-val-Swin-B 46.6 46.8
COCO-val-Swin-L 47.8 47.8
LVIS-Res50 22.3 -
LVIS-Res101 27.0 -
LVIS-Swin-B 36.0 -
COCO-testdev-Res50 37.1 -
COCO-testdev-Res101 41.5 -
COCO-testdev-Swin-B 47.6 -
COCO-testdev-Swin-L 48.3 -

Star History

Star History Chart

Citing DiffusionInst

If you use DiffusionInst in your research or wish to refer to the baseline results published here, please use the following BibTeX entry.

@article{DiffusionInst,
      title={DiffusionInst: Diffusion Model for Instance Segmentation},
      author={Gu, Zhangxuan and Chen, Haoxing and Xu, Zhuoer and Lan, Jun and Meng, Changhua and Wang, Weiqiang},
      journal={arXiv preprint arXiv:2212.02773},
      year={2022}
}

Acknowledgement

Many thanks to the nice work of DiffusionDet @ShoufaChen. Our codes and configs follow DiffusionDet.

Contacts

Please feel free to contact us if you have any problems.

Email: haoxingchen@smail.nju.edu.cn or guzhangxuan.gzx@antgroup.com

Core symbols most depended-on inside this repo

to
called by 29
diffusioninst/util/misc.py
get
called by 15
diffusioninst/predictor.py
max
called by 14
diffusioninst/util/misc.py
print
called by 10
diffusioninst/util/misc.py
update
called by 6
diffusioninst/util/misc.py
apply_to
called by 6
diffusioninst/util/model_ema.py
_remove_ddp
called by 6
diffusioninst/util/model_ema.py
box_cxcywh_to_xyxy
called by 5
diffusioninst/util/box_ops.py

Shape

Method 142
Function 61
Class 32

Languages

Python100%

Modules by API surface

diffusioninst/util/misc.py41 symbols
diffusioninst/util/model_ema.py34 symbols
diffusioninst/swintransformer.py33 symbols
diffusioninst/head.py24 symbols
diffusioninst/detector.py21 symbols
diffusioninst/loss.py20 symbols
diffusioninst/predictor.py18 symbols
train_net.py15 symbols
diffusioninst/test_time_augmentation.py12 symbols
diffusioninst/util/box_ops.py5 symbols
diffusioninst/dataset_mapper.py4 symbols
demo.py3 symbols

For agents

$ claude mcp add DiffusionInst \
  -- python -m otcore.mcp_server <graph>

⬇ download graph artifact