hub / github.com/X-PLUG/mPLUG-Owl

github.com/X-PLUG/mPLUG-Owl @main

Chat with this repo

repository ↗ · DeepWiki ↗ · + Follow

1,125 symbols 3,344 edges 85 files 178 documented · 16% ● updated 15mo ago★ 2,53799 open issues

What it actually does AI analysis from the code graph — generated when you open this

loading…

README

mPLUG-Owl: The Powerful MLLM Family

summary_tab

mPLUG-Owl (Arxiv 2023) - mPLUG-Owl: Modularization Empowers Large Language Models with Multimodality
mPLUG-Owl2 (Arxiv 2023) - mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaboration
mPLUG-Owl3 (Arxiv 2024) - mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Models

News and Updates

2024.08.12 🔥🔥🔥 We release mPLUG-Owl3. The source code and weights are avaliable at HuggingFace.
2024.04.05 mPLUG-Owl2 is accepted by CVPR 2024 as a Highlight.
2024.02.01 We relaese mPLUG-Owl2.1, a Chinese enhanced version of mPLUG-Owl2. The weight is available at HuggingFace.

License

The content of this project itself is licensed under LICENSE.

Misc

Core symbols most depended-on inside this repo

info

called by 51

mPLUG-Owl2/mplug_owl2/evaluate/vqa.py

get

called by 41

mPLUG-Owl/pipeline/data_utils/registry.py

update

called by 38

mPLUG-Owl/serve/gradio_patch.py

to_gradio_chatbot

called by 25

mPLUG-Owl/serve/conversation.py

from_pretrained

called by 24

mPLUG-Owl2/mplug_owl2/model/configuration_mplug_owl2.py

to_gradio_chatbot

called by 23

mPLUG-Owl2/mplug_owl2/conversation.py

open

called by 23

mPLUG-Owl/serve/io_utils.py

decode

called by 19

mPLUG-Owl/mplug_owl/processing_mplug_owl.py

Shape

Method 664

Function 282

Class 168

Route 11

Languages

Python100%

Modules by API surface

mPLUG-Owl/mplug_owl_video/modeling_mplug_owl.py97 symbols

mPLUG-Owl/mplug_owl/modeling_mplug_owl.py93 symbols

mPLUG-Owl/serve/io_utils.py67 symbols

mPLUG-Owl2/mplug_owl2/model/visual_encoder.py57 symbols

mPLUG-Owl2/mplug_owl2/model/modeling_qwen.py51 symbols

mPLUG-Owl3/evaluation/tasks/task_define/mmbench.py40 symbols

mPLUG-Owl3/evaluation/tasks/task_define/next_qa.py33 symbols

mPLUG-Owl2/mplug_owl2/train/train.py32 symbols

mPLUG-Owl2/mplug_owl2/serve/controller.py30 symbols

mPLUG-Owl/pipeline/data_utils/randaugment.py29 symbols

mPLUG-Owl3/evaluation/tasks/task_define/base.py25 symbols

mPLUG-Owl3/gradio_demo.py23 symbols

For agents

$ claude mcp add mPLUG-Owl \
  -- python -m otcore.mcp_server <graph>

⬇ download graph artifact