MCPcopy
hub / github.com/andeya/pholcus / CrawlerPool

Interface CrawlerPool

app/crawler/crawlerpool.go:15–22  ·  view source on GitHub ↗

CrawlerPool manages a pool of crawler engines.

Source from the content-addressed store, hash-verified

13// CrawlerPool manages a pool of crawler engines.
14type (
15 CrawlerPool interface {
16 Reset(spiderNum int) int
17 SetPipelineConfig(outType string, batchCap int)
18 Use() Crawler
19 UseOpt() option.Option[Crawler]
20 Free(Crawler)
21 Stop()
22 }
23 cq struct {
24 capacity int
25 count int

Implementers 1

cqapp/crawler/crawlerpool.go

Calls

no outgoing calls

Tested by

no test coverage detected