MCPcopy Index your code
hub / github.com/Lichanglu/pholcus

github.com/Lichanglu/pholcus @main

Chat with this repo
repository ↗ · DeepWiki ↗ · + Follow
305 symbols 773 edges 51 files 127 documented · 42% ● updated 11y ago★ 103
What it actually does AI analysis from the code graph — generated when you open this
loading…

Extension points exported contracts — how you extend this code

SrcManager (Interface)
SrcManage is an interface that who want implement an management object can realize these functions. [1 implementers]
scheduler/src_manage.go
Downloader (Interface)
The Downloader interface. You can implement the interface by implement function Download. Function Download need to retu [1 …
downloader/downloader.go
Scheduler (Interface)
(no doc) [2 implementers]
scheduler/scheduler.go
Crawler (Interface)
(no doc) [2 implementers]
pholcus/crawler/crawler.go
Deduplicate (Interface)
(no doc) [2 implementers]
common/deduplicate/deduplicate.go
Reporter (Interface)
(no doc) [1 implementers]
reporter/reporter.go
Pipeline (Interface)
(no doc)
pipeline/pipeline.go

Core symbols most depended-on inside this repo

GetOutFeild
called by 61
spiders/spider/spider.go
Printf
called by 27
reporter/reporter.go
GetHtmlParser
called by 26
downloader/context/response.go
Println
called by 25
reporter/reporter.go
GetKeyword
called by 18
spiders/spider/spider.go
AddQueue
called by 18
spiders/spider/spider.go
GetTemp
called by 18
downloader/context/request.go
GetName
called by 14
spiders/spider/spider.go

Shape

Method 191
Function 75
Struct 30
Interface 7
TypeAlias 2

Languages

Go100%

Modules by API surface

common/config/config.go28 symbols
downloader/context/request.go25 symbols
downloader/context/response.go21 symbols
spiders/spider/spider.go18 symbols
scheduler/src_manage.go13 symbols
pipeline/pipeline.go13 symbols
pipeline/collector/collector.go13 symbols
pholcus/gui/guispider.go13 symbols
pholcus/gui/logview.go12 symbols
pholcus/crawler/crawl.go12 symbols
downloader/downloader_http.go10 symbols
common/util/util.go10 symbols

For agents

$ claude mcp add pholcus \
  -- python -m otcore.mcp_server <graph>

⬇ download graph artifact

Ask about this repo answers extend the page