Return the {@link DomainSuffix} object for the extension, if extension is a top level domain returned object will be an instance of {@link TopLevelDom

Returns the lowercased hostname for the url or null if the url is not well formed. @param url The url to check. @return String The hostname

Gets number of extensions currently active @return number of extensions currently active

Search Duck Duck Go :param model: :param query: :return:

Instantiates and tests the @param clazz the class @param <T> type @return instance of the extension @throws SparklerException when an error occurs

Gets Sparkler Job Id @return Id

Gets Configuration @return an instance of {@link }

Get a connection and list of models. :return:

@param resources iterator of resources to be fetched @return iterator of fetched data off input resources @throws Exception when an error occurs

Initialize the extension @param context job context @param pluginId osgi bundle symbolic name @throws SparklerException when an error occurs

Predict using ML model :return:

Returns the domain name of the url. The domain name of a url is the substring of the url's hostname, w/o subdomain names. As an example <br> <code> g

makes best effort to detect content type. Upon failure, the argument string is replied back @param s string whose content needs to be casted to sophis

Singleton instance, lazy instantination @return returns the domain suffix instance

Gets a resource @param resourceName resource name @return stream of resource or null @throws IOException when an io error occurs

Return if this rule is used for filtering-in or out. @return host or domain this regex rule belongs to

Takes a screenshot with a SeleniumScripter interpreter. The plugin config `chrome.selenium.outputdirectory` must have a value for the screenshot opera

Filter Urls @param url the url on which decision to be made @param parent the parent or the linking url @return {@code true} if the {@code url} to be

Gets a user agent from a list of configured values, rotates the list for each call @return get a user agent string from the list of configured values

Get the metrics :param model: :return:

read optional field boost

read optional field status

Computes SHA-256 hash of a string @param str @return hash

Start the Selenium web driver @throws UnknownHostException Occurs when the host was not resolved @throws MalformedURLException Occurs when the URI g

Too lazy to do it properly, but we need to replace numpy types in dicts. :param dictionary: :return:

Clean up a single string :param text: :return:

Evaluate string to a type object @param s string whose value needs to be evaluated @return Type object

Gets a user agent from a list of configured values, rotates the list for each call @return get a user agent string from the list of configured values

Get the current sparkler options. :param model: :return:

Checks if a url matches this rule. @param url is the url to check. @return <code>true</code> if the specified url matches this rule, otherwi

Read the specified file of rules. @param reader is a reader of regular expressions rules. @return the corresponding {@RegexRule rules}.

Return if this rule's regex. @return this regex

Feed a script into an interpreter and execute it. @param script The script to run @param interpreter The interpreter to use @param resource T

Create a new set of sparkler options for the model. :param model: :param content: :return:

Return if this rule is used for filtering-in or out. @return <code>true</code> if any url matching this rule must be accepted, otherwise <cod

checks if this can eval object (could be string or array of strings) @param object object which needs to be evaluated @return true eval possible

Clean up the text from the extract :param soup: :return:

Gets the content type of the given URI @param uri The URI to get the content type of @return String the raw mime type of the given URI

Creates a new {@link RegexRule}. @param sign of the regular expression. A <code>true</code> value means that any URL matching this