hub / github.com/CrawlScript/WebCollector

github.com/CrawlScript/WebCollector @main

607 symbols 1,594 edges 94 files 133 documented · 22%

What it actually does AI analysis from the code graph — generated when you open this

loading…

Extension points exported contracts — how you extend this code

Method 510

Class 87

Interface 10

Java100%

src/main/java/cn/edu/hfut/dmic/webcollector/model/Page.java44 symbols

src/main/java/cn/edu/hfut/dmic/webcollector/conf/Configuration.java39 symbols

src/main/java/cn/edu/hfut/dmic/contentextractor/ContentExtractor.java28 symbols

src/main/java/cn/edu/hfut/dmic/webcollector/model/CrawlDatum.java27 symbols

src/main/java/cn/edu/hfut/dmic/webcollector/fetcher/Fetcher.java26 symbols

src/main/java/cn/edu/hfut/dmic/webcollector/crawler/Crawler.java24 symbols

src/main/java/cn/edu/hfut/dmic/webcollector/plugin/rocks/RocksDBUtils.java17 symbols

src/main/java/cn/edu/hfut/dmic/webcollector/model/Links.java16 symbols

src/main/java/cn/edu/hfut/dmic/webcollector/plugin/rocks/RocksDBManager.java14 symbols

src/main/java/cn/edu/hfut/dmic/webcollector/plugin/berkeley/BerkeleyDBManager.java14 symbols

src/main/java/cn/edu/hfut/dmic/webcollector/model/CrawlDatums.java14 symbols

src/main/java/cn/edu/hfut/dmic/webcollector/plugin/ram/RamDBManager.java13 symbols

$ claude mcp add WebCollector \
  -- python -m otcore.mcp_server <graph>