Types & classes — github.com/aizk/go-crawler

CodeHub MCPcopy Create free account

hub / github.com/aizk/go-crawler / types & classes

Types & classes17 in github.com/aizk/go-crawler

⨍ Functions 53 ◇ Types & classes 17

StructCollector

数据收集器，实现 Pipeline 接口

pipeline/collector.go:4

从抽象层面调度各模块

crawler/crawler.go:22

InterfaceCrawlerInterface

crawler/crawler.go:13

InterfaceDownloader

download/download.go:10

StructEasyDownload

download/download.go:14

存储的完整文件名为： file/"Dir"/"RuleName"/"time"/"Name"

pipeline/data.go:5

pipeline/data.go:3

scheduler/matrix.go:7

page/page.go:17

page/page.go:11

InterfacePipeliner

pipeline/pipeline.go:3

request/request.go:3

采集规则节点

spider/rule.go:6

spider/rule.go:10

StructScheduler

scheduler/shceduler.go:7

spider/spider.go:10

TypeAliasStatus

scheduler/status.go:3