hub / github.com/JFanZhao/spider

github.com/JFanZhao/spider @main

Chat with this repo

repository ↗ · DeepWiki ↗ · + Follow

106 symbols 237 edges 26 files 37 documented · 35% ● updated 5y ago★ 2351 open issues

Browse by type

⨍ Functions 80 ◇ Types & classes 26

What it actually does AI analysis from the code graph — generated when you open this

loading…

Extension points exported contracts — how you extend this code

Repository (Interface)

(no doc) [8 implementers]

src/main/java/cn/ivan/spider/reposity/Repository.java

Storeable (Interface)

(no doc) [5 implementers]

src/main/java/cn/ivan/spider/store/Storeable.java

Processable (Interface)

(no doc) [4 implementers]

src/main/java/cn/ivan/spider/process/Processable.java

Downloadable (Interface)

(no doc) [3 implementers]

src/main/java/cn/ivan/spider/download/Downloadable.java

browse all types & interfaces →

Core symbols most depended-on inside this repo

↓ 9 filesRepository

src/main/java/cn/ivan/spider/reposity/Repository.java

↓ 6 filesPage

存储页面的原始数据 @author Hades

src/main/java/cn/ivan/spider/domain/Page.java

↓ 5 filesHBaseUtils

src/main/java/cn/ivan/spider/utils/HBaseUtils.java

↓ 3 filesStoreable

src/main/java/cn/ivan/spider/store/Storeable.java

↓ 3 filesProcessable

src/main/java/cn/ivan/spider/process/Processable.java

↓ 2 filesPageUtils

页面帮助类 @author Hades

src/main/java/cn/ivan/spider/utils/PageUtils.java

browse all functions →

Shape

Method 80

Class 22

Interface 4

Languages

Java100%

Modules by API surface

src/main/java/cn/ivan/spider/Spider.java18 symbols

src/main/java/cn/ivan/spider/domain/Page.java13 symbols

src/main/java/cn/ivan/spider/utils/HBaseUtils.java11 symbols

src/main/java/cn/ivan/spider/utils/RedisUtils.java5 symbols

src/main/java/cn/ivan/spider/SpiderWatcher.java5 symbols

src/main/java/cn/ivan/spider/utils/HtmlUtils.java4 symbols

src/main/java/cn/ivan/spider/reposity/Repository.java4 symbols

src/main/java/cn/ivan/spider/reposity/RedisRepository.java4 symbols

src/main/java/cn/ivan/spider/reposity/RandomRedisRepository.java4 symbols

src/main/java/cn/ivan/spider/reposity/RandomQueueRepository.java4 symbols

src/main/java/cn/ivan/spider/reposity/QueueRepository.java4 symbols

src/main/java/cn/ivan/spider/process/JDProcessable.java3 symbols

For agents

$ claude mcp add spider \
  -- python -m otcore.mcp_server <graph>

⬇ download graph artifact

github.com/JFanZhao/spider @main

Extension points exported contracts — how you extend this code

Core symbols most depended-on inside this repo

Shape

Languages

Modules by API surface

For agents

Ask about this repo answers extend the page