MCPcopy Create free account

hub / github.com/N0taN3rd/Squidwarc / types & classes

Types & classes38 in github.com/N0taN3rd/Squidwarc

Class
lib/utils/colorPrinters.js:32
Class
lib/utils/warcNaming.js:25
Class
lib/launcher/chrome.js:81
Class
lib/launcher/chromeFinder.js:109
Class
lib/frontier/seedTracker.js:23
Class
lib/frontier/index.js:23
Class
lib/frontier/helper.js:24
Class
lib/injectManager/index.js:29
Class
lib/injectManager/pageInjects/collectLinks.js:46
Class
lib/injectManager/pageInjects/collectLinks.js:159
Class
lib/config/index.js:63
Class
lib/config/loader.js:62
Class
lib/config/config.js:1
Class
lib/crawler/chrome.js:26
Class
lib/crawler/chrome.js:66
Class
lib/crawler/netIdleWatcher.js:26
Class
lib/crawler/puppeteer.js:33
Class
lib/crawler/helper.js:20
Class
lib/crawler/navigationMan.js:26
ClassChromeCrawler
* @desc Crawler based on cyrus-and/chrome-remote-interface * @extends {EventEmitter}
lib/crawler/chrome.js:66
ClassChromeFinder
* @desc Utility class that provides functionality for finding an suitable chrome executable
lib/launcher/chromeFinder.js:109
ClassChromeLauncher
* @desc Utility class for launching or connecting to a Chrome/Chromium instance
lib/launcher/chrome.js:81
ClassCollector
* @desc Performs the outlink collection for a frame
lib/injectManager/pageInjects/collectLinks.js:46
ClassColorPrinters
* @desc Utility class for displaying colored text in console
lib/utils/colorPrinters.js:32
ClassConfig
* @desc Crawl config loader
lib/config/index.js:63
ClassConfig
lib/config/config.js:1
ClassFrontier
* @desc In memory implementation of a frontier
lib/frontier/index.js:23
ClassFrontierHelper
* @desc Helper class providing utility functions for in memory frontier implementation {@link Frontier}
lib/frontier/helper.js:24
ClassHelper
* @desc A helper class providing utility methods
lib/crawler/helper.js:20
ClassInjectManager
* @desc Manages the JavaScript that is injected into the page
lib/injectManager/index.js:29
ClassLoader
lib/config/loader.js:62
ClassNavigationMan
* @desc Monitor navigation and request events for crawling a page. * @emits {network-idle} when network idle has been detected or global-wait timer h
lib/crawler/navigationMan.js:26
ClassNetIdleWatcher
* @desc Monitors the HTTP requests made by a page and emits the 'network-idle' event when it has been determined the network is idle * Used by {@link
lib/crawler/netIdleWatcher.js:26
ClassNetworkMonitor
lib/crawler/chrome.js:26
ClassPuppeteerCrawler
* @desc Crawler based on puppeteer * @extends {EventEmitter}
lib/crawler/puppeteer.js:33
ClassSeedTracker
* @desc Tracks the progress of crawl per starting seed URL. Because multiple seeds can be used, * each potentially generating additional URLs to craw
lib/frontier/seedTracker.js:23
ClassTopHandler
lib/injectManager/pageInjects/collectLinks.js:159
ClassWARCNaming
* @desc Class that initializes the warc naming function used when generating the warcs
lib/utils/warcNaming.js:25