MCPcopy Create free account

hub / github.com/USCDataScience/sparkler / functions

Functions403 in github.com/USCDataScience/sparkler

↓ 1 callersFunctionfetchModel
(model)
retired/sparkler-ui/src/actions/index.js:6
↓ 1 callersFunctionfetchSeeds
(model)
retired/sparkler-ui/src/actions/index.js:16
↓ 1 callersMethodfetch_multiple
Fetch a bunch of urls :param urls: :param top_n: :return:
retired/sparkler-sce/webui/app/search/fetcher.py:109
↓ 1 callersFunctionfetch_seeds
Get the seed urls for a model. :param model: :return:
retired/sparkler-sce/webui/app/models/model.py:137
↓ 1 callersMethodfixPureQueryTargets
Handle the case in RFC3986 section 5.4.1 example 7, and similar.
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/URLUtil.java:69
↓ 1 callersMethodgetCrawlId
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/Resource.java:285
↓ 1 callersMethodgetCrawler
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/Resource.java:363
↓ 1 callersMethodgetDedupeId
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/Resource.java:289
↓ 1 callersMethodgetDefaultPath
()
sparkler-tests-base/src/main/java/edu/usc/irds/sparkler/test/WebServer.java:39
↓ 1 callersMethodgetDiscoverDepth
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/Resource.java:271
↓ 1 callersMethodgetDomain
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/DomainSuffix.java:63
↓ 1 callersMethodgetDomainSuffix
Returns the {@link DomainSuffix} corresponding to the last public part of the hostname
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/URLUtil.java:206
↓ 1 callersMethodgetFetchDepth
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/Resource.java:365
↓ 1 callersMethodgetFetchStatusCode
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/Resource.java:371
↓ 1 callersMethodgetFetchTimestamp
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/Resource.java:281
↓ 1 callersMethodgetGenerateScore
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/Resource.java:309
↓ 1 callersMethodgetGroup
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/Resource.java:267
↓ 1 callersMethodgetHeaders
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/FetchedData.java:79
↓ 1 callersMethodgetHostname
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/Resource.java:351
↓ 1 callersMethodgetId
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/Resource.java:251
↓ 1 callersMethodgetIndexedAt
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/Resource.java:347
↓ 1 callersMethodgetLastUpdatedAt
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/Resource.java:343
↓ 1 callersMethodgetModifiedTime
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/Resource.java:361
↓ 1 callersMethodgetPage
Returns the page for the url. The page consists of the protocol, host, and path, but does not include the query string. The host is lowercased but the
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/URLUtil.java:466
↓ 1 callersMethodgetPageScore
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/Resource.java:367
↓ 1 callersMethodgetParent
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/Resource.java:355
↓ 1 callersMethodgetProxy
()
sparkler-plugins/fetcher-chrome/src/main/java/edu/usc/irds/sparkler/plugin/ProxySelector.java:13
↓ 1 callersMethodgetProxyEndpoint
(List<String> endpoints)
sparkler-plugins/fetcher-chrome/src/main/java/edu/usc/irds/sparkler/plugin/FetcherChrome.java:138
↓ 1 callersMethodgetResponseTime
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/Resource.java:373
↓ 1 callersMethodgetRetriesSinceFetch
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/Resource.java:369
↓ 1 callersMethodgetRulesReader
Returns the name of the file of rules to use for a particular implementation. is the current configuration. @return the name of the resource
sparkler-plugins/urlfilter-regex/src/main/java/edu/usc/irds/sparkler/plugin/regex/RegexURLFilterBase.java:145
↓ 1 callersMethodgetScore
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/Resource.java:293
↓ 1 callersMethodgetStatus
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/Resource.java:275
↓ 1 callersMethodgetVersion
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/Resource.java:359
↓ 1 callersFunctionget_database
Get the database object :return: The database
retired/sparkler-sce/webui/app/models/model.py:14
↓ 1 callersFunctionget_url_window
Get the contents of a duck duck go query. :param query: :param top_n: :param page: :return:
retired/sparkler-sce/webui/app/search/__init__.py:30
↓ 1 callersMethodhasDriverQuit
()
sparkler-plugins/fetcher-jbrowser/src/main/java/edu/usc/irds/sparkler/plugin/FetcherJBrowser.java:132
↓ 1 callersMethodhttpPostJSONRequest
(String uriString, String extractedText)
sparkler-plugins/scorer-dd-svn/src/main/java/edu/usc/irds/sparkler/plugin/ddsvn/ApacheHttpRestClient.java:76
↓ 1 callersMethodisDomainSuffix
return whether the extension is a registered domain entry
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/DomainSuffixes.java:69
↓ 1 callersMethodisPortInUse
(int port)
sparkler-tests-base/src/main/java/edu/usc/irds/sparkler/test/WebServerRunListener.java:42
↓ 1 callersMethodisWebPage
(String webUrl)
sparkler-plugins/fetcher-jbrowser/src/main/java/edu/usc/irds/sparkler/plugin/FetcherJBrowser.java:107
↓ 1 callersMethodjsonCrawl
(Resource resource)
sparkler-plugins/fetcher-chrome/src/main/java/edu/usc/irds/sparkler/plugin/FetcherChrome.java:311
↓ 1 callersFunctionkillCrawl
(model)
retired/sparkler-ui/src/actions/index.js:227
↓ 1 callersFunctionlogin
()
sparkler-deployment/docker/elasticsearch/dockler.py:82
↓ 1 callersFunctionmain
()
sparkler-deployment/docker/elasticsearch/dockler.py:38
↓ 1 callersMethodmapField
Maps field name to a dynamic field name based on value content type The map function takes (input field name, value type, configs, overrides) into co
sparkler-api/src/main/java/edu/usc/irds/sparkler/storage/FieldMapper.java:113
↓ 1 callersFunctionmodelStats
(model)
retired/sparkler-ui/src/actions/index.js:184
↓ 1 callersMethodnewDefaultConfig
Create configuration instance for Sparkler
sparkler-api/src/main/java/edu/usc/irds/sparkler/Constants.java:99
↓ 1 callersMethodoverwriteMap
(Map original, Map newMap)
sparkler-api/src/main/java/edu/usc/irds/sparkler/SparklerConfiguration.java:81
↓ 1 callersMethodparseNumber
(String number)
sparkler-plugins/databricks-api-plugin/src/main/java/com/kytheralabs/databricks/DatabricksAPI.java:113
↓ 1 callersFunctionparse_details
Parse query details :param model: :param fetched_data: :return:
retired/sparkler-sce/webui/app/search/__init__.py:69
↓ 1 callersMethodpersistData
(Map<String, Object> map)
sparkler-plugins/databricks-api-plugin/src/main/java/com/kytheralabs/databricks/DatabricksAPI.java:86
↓ 1 callersFunctionpredict
Run a prediction :param model_name: :param txt: :return:
retired/sparkler-sce/webui/app/classifier/__init__.py:133
↓ 1 callersMethodprocessForm
(JSONObject object)
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/FetcherDefault.java:294
↓ 1 callersMethodprocessJson
(JSONObject object)
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/FetcherDefault.java:288
↓ 1 callersMethodprocessMetadata
(String metadata)
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/FetcherDefault.java:305
↓ 1 callersMethodquitBrowserInstance
(JBrowserDriver driver)
sparkler-plugins/fetcher-jbrowser/src/main/java/edu/usc/irds/sparkler/plugin/FetcherJBrowser.java:142
↓ 1 callersMethodreadCCTLD
(Element el)
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/DomainSuffixesReader.java:115
↓ 1 callersMethodreadCCTLDs
(DomainSuffixes tldEntries, Element el)
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/DomainSuffixesReader.java:101
↓ 1 callersMethodreadCountryName
read field countryname
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/DomainSuffixesReader.java:142
↓ 1 callersMethodreadGTLDs
(DomainSuffixes tldEntries, Element el)
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/DomainSuffixesReader.java:93
↓ 1 callersMethodreadITLDs
(DomainSuffixes tldEntries, Element el)
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/DomainSuffixesReader.java:85
↓ 1 callersMethodreadSuffix
(Element el)
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/DomainSuffixesReader.java:156
↓ 1 callersMethodreadSuffixes
(DomainSuffixes tldEntries, Element el)
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/DomainSuffixesReader.java:149
↓ 1 callersMethodread_url2
Read teh supplied url :param url: :return:
retired/sparkler-sce/webui/app/search/fetcher.py:63
↓ 1 callersMethodrender
()
retired/sparkler-ui/src/App.js:8
↓ 1 callersMethodreplaceURLToken
(Collection<String> urls, List<String> tokens)
sparkler-plugins/url-injector/src/main/java/edu/usc/irds/sparkler/plugin/UrlInjector.java:95
↓ 1 callersFunctionsearchWebsites
(model, search_term)
retired/sparkler-ui/src/actions/index.js:144
↓ 1 callersMethodsetContentHash
(String md5hash)
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/Resource.java:317
↓ 1 callersMethodsetContentLength
(Integer contentLength)
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/FetchedData.java:100
↓ 1 callersMethodsetContenthash
(String contenthash)
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/FetchedData.java:41
↓ 1 callersFunctionsetRelevancy
(frame, val)
retired/sparkler-ui/src/actions/index.js:199
↓ 1 callersFunctionset_sparkler_defaults
Create a model with the defaul options. :param model: :return:
retired/sparkler-sce/webui/app/models/model.py:43
↓ 1 callersMethodtoHexString
(byte[] bytes)
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/FetcherDefault.java:255
↓ 1 callersMethodtriggerJob
(Map<String, Object> map)
sparkler-plugins/databricks-api-plugin/src/main/java/com/kytheralabs/databricks/DatabricksAPI.java:54
↓ 1 callersFunctionup
(compose_file=COMPOSE_FILE)
sparkler-deployment/docker/elasticsearch/dockler.py:92
↓ 1 callersFunctionupdateCrawlConfig
(model, config)
retired/sparkler-ui/src/actions/index.js:43
↓ 1 callersMethodupdateEventLog
(Map<String, Object> map, SparkSession spark, String jobid)
sparkler-plugins/databricks-api-plugin/src/main/java/com/kytheralabs/databricks/DatabricksAPI.java:91
↓ 1 callersFunctionupdateModel
(name, annotations)
retired/sparkler-ui/src/actions/index.js:92
↓ 1 callersFunctionupdate_model
Update the search model :param model: :param url_text: :param url_details: :return:
retired/sparkler-sce/webui/app/search/__init__.py:114
↓ 1 callersFunctionupdate_seed_urls
(model, urls)
retired/sparkler-sce/webui/app/models/model.py:112
MethodApacheHttpRestClient
()
sparkler-plugins/scorer-dd-svn/src/main/java/edu/usc/irds/sparkler/plugin/ddsvn/ApacheHttpRestClient.java:40
MethodDatabricksAPIActivator
(PluginWrapper wrapper)
sparkler-plugins/databricks-api-plugin/src/main/java/com/kytheralabs/databricks/DatabricksAPIActivator.java:7
MethodDdSvnScorerActivator
(PluginWrapper wrapper)
sparkler-plugins/scorer-dd-svn/src/main/java/edu/usc/irds/sparkler/plugin/DdSvnScorerActivator.java:24
MethodDomainSuffix
(String domain, Status status, float boost)
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/DomainSuffix.java:53
MethodDomainSuffixes
private ctor
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/DomainSuffixes.java:40
MethodFetchedData
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/FetchedData.java:49
MethodFetcherChromeActivator
(PluginWrapper wrapper)
sparkler-plugins/fetcher-chrome/src/main/java/edu/usc/irds/sparkler/plugin/FetcherChromeActivator.java:11
MethodFetcherDefault
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/util/FetcherDefault.java:62
MethodFetcherJBrowserActivator
(PluginWrapper wrapper)
sparkler-plugins/fetcher-jbrowser/src/main/java/edu/usc/irds/sparkler/plugin/FetcherJBrowserActivator.java:11
MethodFieldMapper
Creates a field name mapper by reading config from the argument conf stream @param jConfStream JSON config stream @throws IOException @throws ParseExc
sparkler-api/src/main/java/edu/usc/irds/sparkler/storage/FieldMapper.java:81
MethodHtmlUnitFetcherActivator
(PluginWrapper wrapper)
sparkler-plugins/fetcher-htmlunit/src/main/java/edu/usc/irds/sparkler/plugin/HtmlUnitFetcherActivator.java:11
MethodMyPluginActivator
(PluginWrapper wrapper)
sparkler-plugins/template-plugin/src/main/java/edu/usc/irds/sparkler/plugin/MyPluginActivator.java:11
MethodProxySelector
(String endpoint)
sparkler-plugins/fetcher-chrome/src/main/java/edu/usc/irds/sparkler/plugin/ProxySelector.java:8
MethodRegexRule
Constructs a new regular expression rule. @param sign specifies if this rule must filter-in or filter-out. A <code>true</code> valu
sparkler-plugins/urlfilter-regex/src/main/java/edu/usc/irds/sparkler/plugin/regex/RegexRule.java:44
MethodRegexURLFilterActivator
(PluginWrapper wrapper)
sparkler-plugins/urlfilter-regex/src/main/java/edu/usc/irds/sparkler/plugin/RegexURLFilterActivator.java:11
MethodRegexURLFilterBase
Constructs a new empty RegexURLFilterBase
sparkler-plugins/urlfilter-regex/src/main/java/edu/usc/irds/sparkler/plugin/regex/RegexURLFilterBase.java:73
MethodResource
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/model/Resource.java:53
MethodRule
(boolean sign, String regex)
sparkler-plugins/urlfilter-regex/src/main/java/edu/usc/irds/sparkler/plugin/RegexURLFilter.java:69
MethodSparklerConfiguration
()
sparkler-api/src/main/java/edu/usc/irds/sparkler/SparklerConfiguration.java:30
← previousnext →101–200 of 403, ranked by callers