MCPcopy Create free account

hub / github.com/AceDarkknight/GoProxyCollector / functions

Functions63 in github.com/AceDarkknight/GoProxyCollector

⨍ Functions 63◇ Types & classes 12
↓ 14 callersMethodAddOrUpdate
(string, interface{})
storage/storage.go:7
↓ 10 callersFunctioncreateBucket
()
storage/boltDbStorage_test.go:23
↓ 10 callersFunctiondeleteBucket
()
storage/boltDbStorage_test.go:30
↓ 8 callersMethodGet
(string)
storage/storage.go:5
↓ 5 callersMethodClose
()
storage/storage.go:9
↓ 5 callersMethodDelete
(string)
storage/storage.go:6
↓ 4 callersMethodGetAll
()
storage/storage.go:8
↓ 4 callersMethodNext
()
collector/collector.go:8
↓ 2 callersMethodGet
Get will get the json byte value of key.
storage/boltDbStorage.go:66
↓ 2 callersMethodGetRandomOne
()
storage/storage.go:10
↓ 2 callersFunctionIsInputMatchRegex
IsInputMatchRegex will verify the input string is match the regex or not. This function will recover the panic if regex can't be parsed.
util/util.go:71
↓ 2 callersFunctionIsIp
IsIp will match the given parameter is ip address or not.
util/util.go:64
↓ 2 callersMethodName
()
collector/collector.go:9
↓ 2 callersFunctionNewBoltDbStorage
NewBoltDbStorage will return a boltdb object and error.
storage/boltDbStorage.go:22
↓ 2 callersMethodVerify
Verify will check the item parse from xml.
collector/collectorConfig.go:50
↓ 1 callersMethodCollect
(chan<- *result.Result)
collector/collector.go:10
↓ 1 callersMethodCollector
Collector will generate a collector by the CollectType value in config xml.
collector/collectorConfig.go:65
↓ 1 callersMethodExist
(string)
storage/storage.go:4
↓ 1 callersFunctionMakeUrls
MakeUrls will make slice of url using urlFormat and parameters. If urlFormat has incorrect format, return urlFormat itself. If parameters contains emp
util/util.go:90
↓ 1 callersFunctionNewRegexCollector
NewRegexCollector will create a collector who using regular expression to get item.
collector/regexCollector.go:27
↓ 1 callersFunctionNewSelectorCollector
NewRegexCollector will create a collector who using goquery to get item.
collector/selectorCollector.go:30
↓ 1 callersFunctionRandomUA
RandomUA will return a random user agent.
util/util.go:15
↓ 1 callersFunctionVerifyProxyIp
VerifyProxyIp will use given ip and port as proxy, if the proxy is available, return true, otherwise return false.
util/util.go:36
↓ 1 callersFunctionrunCollector
runCollector will start to run a collector and save records to storage.
scheduler/scheduler.go:18
↓ 1 callersMethodsync
Sync will sync the DB's data to memory.
storage/boltDbStorage.go:144
MethodAddOrUpdate
AddOrUpdate will add the value into DB if key is not existed, otherwise update the existing value. Null value will be ignored and the value will be ma
storage/boltDbStorage.go:98
FunctionBenchmarkBoltDbStorage_AddOrUpdate
(b *testing.B)
storage/boltDbStorage_bench_test.go:9
FunctionBenchmarkBoltDbStorage_AddOrUpdateParallel
(b *testing.B)
storage/boltDbStorage_bench_test.go:20
FunctionBenchmarkBoltDbStorage_Get
(b *testing.B)
storage/boltDbStorage_bench_test.go:34
FunctionBenchmarkBoltDbStorage_GetParallel
(b *testing.B)
storage/boltDbStorage_bench_test.go:45
FunctionBenchmarkBoltDbStorage_GetRandomOneParallel
(b *testing.B)
storage/boltDbStorage_bench_test.go:58
MethodClose
Close will close the DB.
storage/boltDbStorage.go:139
MethodCollect
TODO: Support to more websites.
collector/regexCollector.go:74
MethodCollect
(ch chan<- *result.Result)
collector/selectorCollector.go:89
MethodDelete
Delete the value by the given key.
storage/boltDbStorage.go:79
MethodExist
Exist will check the given key is existed in DB or not.
storage/boltDbStorage.go:61
MethodGetAll
GetAll will return all key-value in DB.
storage/boltDbStorage.go:122
MethodGetRandomOne
Get one random record.
storage/boltDbStorage.go:162
MethodName
()
collector/regexCollector.go:69
MethodName
()
collector/selectorCollector.go:85
FunctionNewCollectorConfig
NewCollectorConfig will read collector configuration xml file and parse the xml.
collector/collectorConfig.go:29
FunctionNewServer
NewServer will start a new server.
server/server.go:14
FunctionNewStorage
()
storage/storage.go:13
MethodNext
()
collector/regexCollector.go:57
MethodNext
()
collector/selectorCollector.go:73
FunctionRun
Run will start to run the collectors.
scheduler/scheduler.go:45
FunctionSetLogger
NewLogger will load the seelog's configuration file. If file name is not supplied, it will use default configuration.
scheduler/scheduler.go:93
FunctionTestBoltDbStorage_AddOrUpdateParallel
(t *testing.T)
storage/boltDbStorage_test.go:130
FunctionTestBoltDbStorage_DeleteParallel
(t *testing.T)
storage/boltDbStorage_test.go:165
FunctionTestBoltDbStorage_Exist
(t *testing.T)
storage/boltDbStorage_test.go:70
FunctionTestBoltDbStorage_Get
(t *testing.T)
storage/boltDbStorage_test.go:36
FunctionTestBoltDbStorage_GetAll
(t *testing.T)
storage/boltDbStorage_test.go:101
FunctionTestIsInputMatchRegex
(t *testing.T)
util/util_test.go:65
FunctionTestIsIp
(t *testing.T)
util/util_test.go:41
FunctionTestMakeUrls
(t *testing.T)
util/util_test.go:87
FunctionTestRandomUA
(t *testing.T)
util/util_test.go:8
FunctionTestVerifyHTTP
(t *testing.T)
util/util_test.go:16
FunctionVerifyAndDelete
VerifyAndSave existing Ips to check it's available or not. Delete the unavailable Ips.
verifier/verifier.go:15
FunctionVerifyAndSave
Verify ips in channel. Save the available ips.
verifier/verifier.go:41
FunctiondeleteIp
deleteIp will delete the given ip. Return 200 if succeed. Sample usage: http://localhost:8090/delete?ip=0.0.0.0
server/server.go:55
FunctiongetIp
getIp will get a random Ip. Sample usage: http://localhost:8090/get
server/server.go:35
Functioninit
()
storage/boltDbStorage_test.go:19
Functionmain
()
main.go:15