MCPcopy Index your code
hub / github.com/aizk/go-crawler

github.com/aizk/go-crawler @main

Chat with this repo
repository ↗ · DeepWiki ↗ · + Follow
70 symbols 116 edges 13 files 15 documented · 21%
What it actually does AI analysis from the code graph — generated when you open this
loading…

Extension points exported contracts — how you extend this code

CrawlerInterface (Interface)
采集器 [1 implementers]
crawler/crawler.go
Pager (Interface)
(no doc) [1 implementers]
page/page.go
Pipeliner (Interface)
(no doc) [1 implementers]
pipeline/pipeline.go
Downloader (Interface)
(no doc) [1 implementers]
download/download.go

Core symbols most depended-on inside this repo

Start
called by 2
pipeline/pipeline.go
outputData
called by 2
pipeline/collector.go
Parse
called by 1
page/page.go
GetItems
called by 1
page/page.go
GetFiles
called by 1
page/page.go
getRule
called by 1
page/page.go
NewMatrix
called by 1
scheduler/matrix.go
Push
called by 1
scheduler/matrix.go

Shape

Method 46
Struct 10
Function 7
Interface 4
TypeAlias 3

Languages

Go100%

Modules by API surface

crawler/crawler.go19 symbols
page/page.go11 symbols
spider/spider.go10 symbols
pipeline/collector.go6 symbols
pipeline/pipeline.go5 symbols
scheduler/matrix.go4 symbols
download/download.go4 symbols
spider/rule.go2 symbols
scheduler/shceduler.go2 symbols
request/request.go2 symbols
pipeline/data.go2 symbols
main.go2 symbols

For agents

$ claude mcp add go-crawler \
  -- python -m otcore.mcp_server <graph>

⬇ download graph artifact