MCPcopy Create free account
hub / github.com/apache/nutch / fetch

Method fetch

src/java/org/apache/nutch/fetcher/FetcherJob.java:255–258  ·  view source on GitHub ↗

Run fetcher. @param batchId batchId (obtained from Generator) or null to fetch all generated fetchlists @param threads number of threads per map task @param shouldResume @param numTasks number of fetching tasks (reducers). If set to < 1 then use the d

(String batchId, int threads, boolean shouldResume,
      int numTasks)

Source from the content-addressed store, hash-verified

253 * @throws Exception
254 */
255 public int fetch(String batchId, int threads, boolean shouldResume,
256 int numTasks) throws Exception {
257 return fetch(batchId, threads, shouldResume, numTasks, false, false);
258 }
259
260 /**
261 * Run fetcher.

Callers 6

testFetchMethod · 0.95
testReFetchMethod · 0.95
testSitemapFetchMethod · 0.95
testSitemapDetectMethod · 0.95
benchmarkMethod · 0.95
runMethod · 0.95

Calls 4

runMethod · 0.95
toArgMapMethod · 0.95
elapsedTimeMethod · 0.95
equalsMethod · 0.45

Tested by 4

testFetchMethod · 0.76
testReFetchMethod · 0.76
testSitemapFetchMethod · 0.76
testSitemapDetectMethod · 0.76