Makes a GET request to an URL and returns the http response or an error.

Returns a report_manager.PageIssueReporter with a callback function that returns true if the media type is text/html, the status code is between 200 a

Returns a report_manager.PageIssueReporter with a callback function that returns true if the media type is text/html, the status code is between 200 a

Returns a report_manager.PageIssueReporter with a callback function that returns true if the status code media type is text/html and the page's html l

Returns a report_manager.PageIssueReporter with a callback function that returns true if the status code media type is text/html and the page's html l

Returns a new subsciber to the topic.

Returns a report_manager.PageIssueReporter with a callback function that returns true if the media type is text/html, the status code is between 200 a

Returns the first element in the queue.

RewriteCSSURLs parses css content and rewrites the urls in URLTokens so they are handled by the proxy route.

StartCrawler creates a new crawler and crawls the project's URL. It adds a new crawler for the project, it returns an error if there's one already run

Add an page issue reporter to the ReportManager. It will be used to create issues on each crawled page.

CreatePageIssues loops the page reporters calling the callback function and creating the issues found in the PageReport.

Returns true if the robots.txt file exists and is valid

ExtractURLsFromCSS accepts a css string and returns a slice with all the urls it finds in it.

Return channel of PageReports by error type.

Returns a list of sitemaps found in the robots.txt file