Code
Hub
Workspaces
Following
Trending
Connect
MCP
copy
Create free account
hub
/
github.com/USCDataScience/sparkler
/ functions
Functions
403 in github.com/USCDataScience/sparkler
⨍
Functions
403
◇
Types & classes
115
↳
Endpoints
18
Method
SparklerException
(String message)
sparkler-api/src/main/java/edu/usc/irds/sparkler/SparklerException.java:26
Method
StreamTransformer
Creates a transformer @param source iterator of source objects @param transformer transformation function
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/StreamTransformer.java:38
Method
TopLevelDomain
(String domain, Type type, Status status, float boost)
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/TopLevelDomain.java:42
Method
UrlFilterSameHostActivator
(PluginWrapper wrapper)
sparkler-plugins/urlfilter-samehost/src/main/java/edu/usc/irds/sparkler/plugin/UrlFilterSameHostActivator.java:11
Method
UrlInjectorActivator
(PluginWrapper wrapper)
sparkler-plugins/url-injector/src/main/java/edu/usc/irds/sparkler/plugin/UrlInjectorActivator.java:8
Method
UrlInjectorObj
(String url, String metadata, String httpMethod)
sparkler-api/src/main/java/edu/usc/irds/sparkler/UrlInjectorObj.java:8
Method
WebServer
()
sparkler-tests-base/src/main/java/edu/usc/irds/sparkler/test/WebServer.java:43
Function
build_model
Build the model :param model: :return:
retired/sparkler-sce/webui/app/controller.py:59
Function
check_crawl_exists
Check The Crawl Exists :param model: :return:
retired/sparkler-sce/webui/app/controller.py:117
Function
check_model
CHeck model :param model: :return:
retired/sparkler-sce/webui/app/controller.py:97
Function
check_model
Check a model :param model_name: :return:
retired/sparkler-sce/webui/app/classifier/__init__.py:216
Function
check_status
()
retired/sparkler-ui/src/components/sidebar/StartCrawl_old.js:19
Function
check_status2
()
retired/sparkler-ui/src/components/sidebar/StartCrawl_old.js:34
Method
chooseRepr
<p> Given two urls, a src and a destination of a redirect, it returns the representative url. <p> <p> This method implements an extended version of t
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/URLUtil.java:347
Method
close
()
sparkler-plugins/scorer-dd-svn/src/main/java/edu/usc/irds/sparkler/plugin/ddsvn/ApacheHttpRestClient.java:120
Method
closeResources
()
sparkler-plugins/fetcher-jbrowser/src/main/java/edu/usc/irds/sparkler/plugin/FetcherJBrowser.java:103
Function
componentDidMount
()
retired/sparkler-ui/src/components/dialogs/SeedURLDialog.js:27
Function
componentDidUpdate
(prevProps, prevState, snapshot)
retired/sparkler-ui/src/components/dialogs/CrawlConfigDialog.js:18
Function
componentDidUpdate
(prevProps, prevState, snapshot)
retired/sparkler-ui/src/components/dialogs/SeedURLDialog.js:20
Function
componentDidUpdate
(oldProps)
retired/sparkler-ui/src/components/dialogs/ModelDialog.js:18
Function
componentDidUpdate
(prevProps, prevState, snapshot)
retired/sparkler-ui/src/components/dialogs/StartCrawlDialog.js:23
Method
componentDidUpdate
(prevProps)
retired/sparkler-ui/src/components/sidebar/GenerateModel.js:20
Function
componentWillMount
()
retired/sparkler-ui/src/components/panels/ListModels.js:8
Function
componentWillUpdate
(nextProps, nextState, nextContext)
retired/sparkler-ui/src/components/sidebar/StartCrawl_old.js:40
Function
configure_sparkler
(j, s)
sparkler-deployment/juju/sparkler/reactive/sparkler.py:53
Function
constructor
(props)
retired/sparkler-ui/src/components/IFrameFrame.js:12
Function
constructor
(props)
retired/sparkler-ui/src/components/Navbar.js:13
Function
constructor
(props)
retired/sparkler-ui/src/components/sidebar/StartCrawl.js:12
Function
constructor
(props)
retired/sparkler-ui/src/components/sidebar/ExportModel.js:8
Function
constructor
(props)
retired/sparkler-ui/src/components/sidebar/StartCrawl_old.js:11
Function
constructor
(props)
retired/sparkler-ui/src/components/dialogs/CrawlConfigDialog.js:9
Function
constructor
(props)
retired/sparkler-ui/src/components/dialogs/SeedURLDialog.js:9
Function
constructor
(props)
retired/sparkler-ui/src/components/dialogs/ModelDialog.js:9
Function
constructor
(props)
retired/sparkler-ui/src/components/dialogs/StartCrawlDialog.js:9
Method
constructor
(props)
retired/sparkler-ui/src/components/sidebar/ExportData.js:8
Method
constructor
(props, context)
retired/sparkler-ui/src/components/sidebar/GenerateModel.js:10
Method
constructor
(props)
retired/sparkler-ui/src/components/sidebar/CreateSeed.js:10
Method
constructor
(props)
retired/sparkler-ui/src/components/sidebar/CrawlConfig.js:11
Method
constructor
(props)
retired/sparkler-ui/src/components/panels/NewModel.js:11
Function
crawl_status
Get the crawl status :param model: :return:
retired/sparkler-sce/webui/app/controller.py:243
Method
createRule
(boolean sign, String regex)
sparkler-plugins/urlfilter-regex/src/main/java/edu/usc/irds/sparkler/plugin/RegexURLFilter.java:57
Function
create_new_model
Create a new model :param model: :return:
retired/sparkler-sce/webui/app/controller.py:37
Method
doGet
(HttpServletRequest req, HttpServletResponse resp)
sparkler-tests-base/src/main/java/edu/usc/irds/sparkler/test/TestSlaveServlet.java:98
Method
doReceiveResponse
(HttpRequest request, HttpClientConnection conn, HttpContext context)
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/CustomHttpRequestExecutor.java:37
Method
doSendRequest
(HttpRequest request, HttpClientConnection conn, HttpContext context)
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/CustomHttpRequestExecutor.java:26
Function
download_model
Download Model :param model: :return:
retired/sparkler-sce/webui/app/controller.py:87
Method
dumpLogs
Dumps the driver logs into the current stack trace
sparkler-plugins/fetcher-chrome/src/main/java/edu/usc/irds/sparkler/plugin/FetcherChrome.java:103
Method
eval
evaluates object (string or array of string) @see #canEval(Object) @param object the object which needs to be evaluated @return object created by eval
sparkler-api/src/main/java/edu/usc/irds/sparkler/storage/StringEvaluator.java:105
Method
executeProcess
(Event e, Object spark, Object fetchedRdds)
sparkler-api/src/main/java/edu/usc/irds/sparkler/GenericProcess.java:11
Method
executeProcess
(GenericProcess.Event event, Object spark, Object fetchedRDDs)
sparkler-plugins/databricks-api-plugin/src/main/java/com/kytheralabs/databricks/DatabricksAPI.java:23
Function
export_model
Export a model :param model_name: :return:
retired/sparkler-sce/webui/app/classifier/__init__.py:206
Function
feeds
Fetch Seeds :param model: :return:
retired/sparkler-sce/webui/app/controller.py:373
Method
fetch
()
sparkler-api/src/test/java/edu/usc/irds/sparkler/util/FetcherDefaultTest.java:70
Method
fetch
Run a crawl of the given resource @param resource The resource which directs what URI to start crawling from, and a few other crawl-b
sparkler-plugins/fetcher-chrome/src/main/java/edu/usc/irds/sparkler/plugin/FetcherChrome.java:258
Method
fetch1
()
sparkler-api/src/test/java/edu/usc/irds/sparkler/util/FetcherDefaultTest.java:88
Method
filter
(String url, String parent)
sparkler-plugins/urlfilter-regex/src/main/java/edu/usc/irds/sparkler/plugin/regex/RegexURLFilterBase.java:148
Method
filter
()
sparkler-plugins/urlfilter-samehost/src/test/java/edu/usc/irds/sparkler/plugin/UrlFilterSameHostTest.java:14
Function
force_kill_crawl
Force kill the crawl :param model: :return:
retired/sparkler-sce/webui/app/controller.py:295
Method
generateUpdateModel
()
retired/sparkler-ui/src/components/sidebar/GenerateModel.js:30
Method
get
Search Duck Duck Go :param model: :param query: :param page: :return:
retired/sparkler-sce/webui/app/apis/ns_search.py:50
Method
get
Predict using ML model :param content: :param model: :return:
retired/sparkler-sce/webui/app/apis/ns_classify.py:22
Method
getBoost
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/DomainSuffix.java:71
Function
getCompleted
(model)
retired/sparkler-ui/src/actions/index.js:243
Method
getConfiguration
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/TestUtils.java:45
Method
getContentHash
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/Resource.java:321
Method
getContenthash
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/FetchedData.java:37
Method
getCountryName
Returns the country name if TLD is Country Code TLD @return country name or null
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/TopLevelDomain.java:63
Method
getDataAsMap
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/Resource.java:375
Method
getDatabasePassword
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/SparklerConfiguration.java:120
Method
getDatabaseURI
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/SparklerConfiguration.java:110
Method
getDatabaseUsername
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/SparklerConfiguration.java:115
Method
getExtensions
Getter for extensions @return List of extensions
sparkler-api/src/main/java/edu/usc/irds/sparkler/ExtensionChain.java:40
Method
getHostSegments
Partitions of the hostname of the url by "."
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/URLUtil.java:236
Method
getHttpMethod
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/UrlInjectorObj.java:23
Method
getId
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/TestUtils.java:50
Method
getMaximumAllowed
Gets maximum number of extensions allowed in this chain. For example. if at most one should be configured then return 1. @return maximum number of ex
sparkler-api/src/main/java/edu/usc/irds/sparkler/ExtensionChain.java:63
Method
getMetadata
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/UrlInjectorObj.java:19
Method
getMetadata
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/FetchedData.java:91
Method
getMinimumRequired
Gets minimum number of points in the chain to be a valid chain. For example, if atleast one extension is required return 1. If this chain is optional,
sparkler-api/src/main/java/edu/usc/irds/sparkler/ExtensionChain.java:55
Method
getResponseTime
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/FetchedData.java:133
Method
getRulesReader
Rules specified as a config property will override rules specified as a config file.
sparkler-plugins/urlfilter-regex/src/main/java/edu/usc/irds/sparkler/plugin/RegexURLFilter.java:46
Method
getScoreAsMap
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/Resource.java:325
Method
getScoreKey
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/Scorer.java:16
Method
getScoreKey
()
sparkler-plugins/scorer-dd-svn/src/main/java/edu/usc/irds/sparkler/plugin/DdSvnScorer.java:70
Method
getSegment
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/FetchedData.java:104
Method
getStatus
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/DomainSuffix.java:67
Method
getTopLevelDomainName
Returns the top level domain name of the url. The top level domain name of a url is the substring of the url's hostname, w/o subdomain names. As an ex
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/URLUtil.java:148
Method
getType
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/TopLevelDomain.java:54
Method
getUrl
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/UrlInjectorObj.java:15
Function
get_models
Get a list of models :return:
retired/sparkler-sce/webui/app/models/model.py:151
Function
get_sparkler_config
Get Sparkler Configuration :param model: :return:
retired/sparkler-sce/webui/app/controller.py:140
Function
handleChange
(event)
retired/sparkler-ui/src/components/dialogs/CrawlConfigDialog.js:52
Function
handleChange
(event)
retired/sparkler-ui/src/components/dialogs/SeedURLDialog.js:33
Function
handleChange
(event)
retired/sparkler-ui/src/components/dialogs/ModelDialog.js:29
Function
handleChange
(event)
retired/sparkler-ui/src/components/dialogs/StartCrawlDialog.js:42
Method
handleChange
(event)
retired/sparkler-ui/src/components/sidebar/GenerateModel.js:34
Function
handleGroupChange
(event)
retired/sparkler-ui/src/components/dialogs/StartCrawlDialog.js:65
Function
handleItChange
(event)
retired/sparkler-ui/src/components/dialogs/StartCrawlDialog.js:61
Function
handleOkay
()
retired/sparkler-ui/src/components/dialogs/CrawlConfigDialog.js:56
Function
handleOkay
()
retired/sparkler-ui/src/components/dialogs/SeedURLDialog.js:37
← previous
next →
201–300 of 403, ranked by callers