MCPcopy Create free account
hub / github.com/apache/nutch / shouldFetch

Method shouldFetch

src/java/org/apache/nutch/crawl/FetchSchedule.java:138–138  ·  view source on GitHub ↗

This method provides information whether the page is suitable for selection in the current fetchlist. NOTE: a true return value does not guarantee that the page will be fetched, it just allows it to be included in the further selection process based on scores. The default implementation checks <code

(String url, WebPage page, long curTime)

Source from the content-addressed store, hash-verified

136 * fetchlist, otherwise false.
137 */
138 public boolean shouldFetch(String url, WebPage page, long curTime);
139
140 /**
141 * This method resets fetchTime, fetchInterval, modifiedTime and page

Callers 1

mapMethod · 0.65

Implementers 1

AbstractFetchSchedulesrc/java/org/apache/nutch/crawl/Abstra

Calls

no outgoing calls

Tested by

no test coverage detected