Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/N0taN3rd/Squidwarc
/ types & classes
Types & classes
38 in github.com/N0taN3rd/Squidwarc
⨍
Functions
175
◇
Types & classes
38
Class
lib/utils/colorPrinters.js:32
Class
lib/utils/warcNaming.js:25
Class
lib/launcher/chrome.js:81
Class
lib/launcher/chromeFinder.js:109
Class
lib/frontier/seedTracker.js:23
Class
lib/frontier/index.js:23
Class
lib/frontier/helper.js:24
Class
lib/injectManager/index.js:29
Class
lib/injectManager/pageInjects/collectLinks.js:46
Class
lib/injectManager/pageInjects/collectLinks.js:159
Class
lib/config/index.js:63
Class
lib/config/loader.js:62
Class
lib/config/config.js:1
Class
lib/crawler/chrome.js:26
Class
lib/crawler/chrome.js:66
Class
lib/crawler/netIdleWatcher.js:26
Class
lib/crawler/puppeteer.js:33
Class
lib/crawler/helper.js:20
Class
lib/crawler/navigationMan.js:26
Class
ChromeCrawler
* @desc Crawler based on cyrus-and/chrome-remote-interface * @extends {EventEmitter}
lib/crawler/chrome.js:66
Class
ChromeFinder
* @desc Utility class that provides functionality for finding an suitable chrome executable
lib/launcher/chromeFinder.js:109
Class
ChromeLauncher
* @desc Utility class for launching or connecting to a Chrome/Chromium instance
lib/launcher/chrome.js:81
Class
Collector
* @desc Performs the outlink collection for a frame
lib/injectManager/pageInjects/collectLinks.js:46
Class
ColorPrinters
* @desc Utility class for displaying colored text in console
lib/utils/colorPrinters.js:32
Class
Config
* @desc Crawl config loader
lib/config/index.js:63
Class
Config
lib/config/config.js:1
Class
Frontier
* @desc In memory implementation of a frontier
lib/frontier/index.js:23
Class
FrontierHelper
* @desc Helper class providing utility functions for in memory frontier implementation {@link Frontier}
lib/frontier/helper.js:24
Class
Helper
* @desc A helper class providing utility methods
lib/crawler/helper.js:20
Class
InjectManager
* @desc Manages the JavaScript that is injected into the page
lib/injectManager/index.js:29
Class
Loader
lib/config/loader.js:62
Class
NavigationMan
* @desc Monitor navigation and request events for crawling a page. * @emits {network-idle} when network idle has been detected or global-wait timer h
lib/crawler/navigationMan.js:26
Class
NetIdleWatcher
* @desc Monitors the HTTP requests made by a page and emits the 'network-idle' event when it has been determined the network is idle * Used by {@link
lib/crawler/netIdleWatcher.js:26
Class
NetworkMonitor
lib/crawler/chrome.js:26
Class
PuppeteerCrawler
* @desc Crawler based on puppeteer * @extends {EventEmitter}
lib/crawler/puppeteer.js:33
Class
SeedTracker
* @desc Tracks the progress of crawl per starting seed URL. Because multiple seeds can be used, * each potentially generating additional URLs to craw
lib/frontier/seedTracker.js:23
Class
TopHandler
lib/injectManager/pageInjects/collectLinks.js:159
Class
WARCNaming
* @desc Class that initializes the warc naming function used when generating the warcs
lib/utils/warcNaming.js:25