MCPcopy Create free account

hub / github.com/commoncrawl/cc-webgraph / functions

Functions144 in github.com/commoncrawl/cc-webgraph

↓ 20 callersMethodtestSorted
Test whether node names are properly sorted and IDs are correctly assigned (sequentially, strictly monotonically increasing, no gaps)
src/test/java/org/commoncrawl/webgraph/TestHostToDomainGraph.java:238
↓ 20 callersMethodvertexLabelToId
(String label)
src/main/java/org/commoncrawl/webgraph/explore/Graph.java:114
↓ 15 callersMethodnextInt
{@inheritDoc}
src/main/java/org/commoncrawl/webgraph/CountingMergedIntIterator.java:85
↓ 12 callersMethodadd
(long hostId)
src/main/java/org/commoncrawl/webgraph/HostToDomainGraph.java:160
↓ 12 callersMethodconvert
(HostToDomainGraph converter, String[] hostGraph)
src/test/java/org/commoncrawl/webgraph/TestHostToDomainGraph.java:214
↓ 12 callersMethoddoCount
@param countHosts if true count the number of hosts per domain
src/main/java/org/commoncrawl/webgraph/HostToDomainGraph.java:266
↓ 12 callersMethodhasNext
{@inheritDoc}
src/main/java/org/commoncrawl/webgraph/CountingMergedIntIterator.java:66
↓ 11 callersMethodtoString
()
src/main/java/org/commoncrawl/webgraph/explore/GraphExplorer.java:50
↓ 8 callersMethodprint
(String s)
src/main/java/org/commoncrawl/webgraph/explore/GraphExplorer.java:267
↓ 7 callersMethodvertexIdToLabel
(long id)
src/main/java/org/commoncrawl/webgraph/explore/Graph.java:102
↓ 6 callersMethodcompareTo
(Domain o)
src/main/java/org/commoncrawl/webgraph/HostToDomainGraph.java:170
↓ 6 callersMethodgetCount
@return the count how often the last integer (returned by {@link nextInt()}) was seen in the input iterators
src/main/java/org/commoncrawl/webgraph/CountingMergedIntIterator.java:118
↓ 5 callersMethodcompareRevDomainsSafe
(String d1, String d2)
src/main/java/org/commoncrawl/webgraph/HostToDomainGraph.java:192
↓ 5 callersMethodgetValue
(long id)
src/main/java/org/commoncrawl/webgraph/HostToDomainGraph.java:334
↓ 5 callersMethodreverseHost
Reverse host name, eg. <code>www.example.com</code> is reversed to <code>com.example.www</code>. Can also be used to "unreverse" a reversed host name.
src/main/java/org/commoncrawl/webgraph/HostToDomainGraph.java:320
↓ 5 callersMethodshowHelp
()
src/main/java/org/commoncrawl/webgraph/HostToDomainGraph.java:537
↓ 4 callersMethodmultiPartSuffixesAsDomains
@param include if true map host names equal to any multi-part public suffix (the suffix contains a dot) (eg. <code>gov.uk</code> or
src/main/java/org/commoncrawl/webgraph/HostToDomainGraph.java:299
↓ 4 callersMethodsuccessorIntStream
(String vertexLabel)
src/main/java/org/commoncrawl/webgraph/explore/Graph.java:172
↓ 4 callersMethodsuccessors
(long vertexId)
src/main/java/org/commoncrawl/webgraph/explore/Graph.java:160
↓ 3 callersMethodnext
{@inheritDoc} @deprecated Please use {@link nextInt()} instead.
src/main/java/org/commoncrawl/webgraph/CountingMergedIntIterator.java:76
↓ 3 callersMethodnextPreferenceElement
()
src/main/java/org/commoncrawl/webgraph/CreatePreferenceVector.java:42
↓ 3 callersMethodoutdegree
(long vertexId)
src/main/java/org/commoncrawl/webgraph/explore/Graph.java:144
↓ 3 callersMethodsetStripWww
@param stripWww if true the www. prefix is stripped
src/main/java/org/commoncrawl/webgraph/HostToDomainGraph.java:306
↓ 3 callersMethodtoString
()
src/main/java/org/commoncrawl/webgraph/HostToDomainGraph.java:165
↓ 2 callersMethodassignRank
(int[] ranks, IntComparator comp)
src/main/java/org/commoncrawl/webgraph/JoinSortRanks.java:93
↓ 2 callersMethodassignRank
(long[][] ranks, LongComparator comp)
src/main/java/org/commoncrawl/webgraph/JoinSortRanks.java:224
↓ 2 callersMethodconvert
(Function<String, String> func, Stream<String> in, PrintStream out)
src/main/java/org/commoncrawl/webgraph/HostToDomainGraph.java:489
↓ 2 callersMethoddoPrivateDomains
@param privateDomains if true map host to domain names using also the suffixes from the <a href= "https://
src/main/java/org/commoncrawl/webgraph/HostToDomainGraph.java:277
↓ 2 callersMethodfinishNodes
(PrintStream out)
src/main/java/org/commoncrawl/webgraph/HostToDomainGraph.java:501
↓ 2 callersMethodfrequencies
Count strings in a stream. Sort the resulting string-count pairs by decreasing count (frequency) and secondarily by string in lexicographic order. @p
src/main/java/org/commoncrawl/webgraph/explore/GraphExplorer.java:305
↓ 2 callersMethodgetNodeLine
(Domain domain)
src/main/java/org/commoncrawl/webgraph/HostToDomainGraph.java:436
↓ 2 callersMethodgetTopLevelDomain
(String reversedDomainName)
src/main/java/org/commoncrawl/webgraph/explore/Graph.java:379
↓ 2 callersMethodgetVertex
(String vertexLabel)
src/main/java/org/commoncrawl/webgraph/explore/GraphExplorer.java:83
↓ 2 callersMethodintersect
Intersection of two sorted lists
src/main/java/org/commoncrawl/webgraph/explore/Graph.java:388
↓ 2 callersMethodlogProgress
()
src/main/java/org/commoncrawl/webgraph/CreatePreferenceVector.java:57
↓ 2 callersMethodprintVertices
(LazyIntIterator it)
src/main/java/org/commoncrawl/webgraph/explore/GraphExplorer.java:271
↓ 2 callersMethodpwn
Print the current working node / vertex.
src/main/java/org/commoncrawl/webgraph/explore/GraphExplorer.java:124
↓ 2 callersMethodreverseDomainName
Reverse or "unreverse" a host/domain name: <code>com.example.www</code> is reversed to <code>www.example.com</code> and vice versa. @param domainName
src/main/java/org/commoncrawl/webgraph/explore/Graph.java:498
↓ 2 callersMethodsetValue
(long id, long value)
src/main/java/org/commoncrawl/webgraph/HostToDomainGraph.java:330
↓ 2 callersMethodsetVertex
(String vertexLabel)
src/main/java/org/commoncrawl/webgraph/explore/GraphExplorer.java:91
↓ 2 callersMethodsharedSuccessors
(long[] vertices)
src/main/java/org/commoncrawl/webgraph/explore/Graph.java:330
↓ 2 callersMethodshowHelp
()
src/main/java/org/commoncrawl/webgraph/JoinSortRanks.java:263
↓ 2 callersMethodshowHelp
()
src/main/java/org/commoncrawl/webgraph/CreatePreferenceVector.java:158
↓ 2 callersMethodsuccessorStream
(String vertexLabel)
src/main/java/org/commoncrawl/webgraph/explore/Graph.java:168
↓ 2 callersMethodsuccessors
()
src/main/java/org/commoncrawl/webgraph/explore/GraphExplorer.java:63
↓ 1 callersMethodassignHarmonicCentralityRank
()
src/main/java/org/commoncrawl/webgraph/JoinSortRanks.java:106
↓ 1 callersMethodassignPageRankRank
()
src/main/java/org/commoncrawl/webgraph/JoinSortRanks.java:110
↓ 1 callersMethodconvert
(Function<String, String> func, Stream<String> in, PrintStream out)
src/main/java/org/commoncrawl/webgraph/JoinSortRanks.java:130
↓ 1 callersMethodconvert
(Stream<String> in, DataOutputStream out)
src/main/java/org/commoncrawl/webgraph/CreatePreferenceVector.java:134
↓ 1 callersMethodgetHarmonicCentralityRank
(long id)
src/main/java/org/commoncrawl/webgraph/JoinSortRanks.java:118
↓ 1 callersMethodgetHarmonicCentralityValue
(long id)
src/main/java/org/commoncrawl/webgraph/JoinSortRanks.java:114
↓ 1 callersMethodgetNodeIDs
(String[] graph)
src/test/java/org/commoncrawl/webgraph/TestHostToDomainGraph.java:230
↓ 1 callersMethodgetNodeNames
(String[] graph)
src/test/java/org/commoncrawl/webgraph/TestHostToDomainGraph.java:226
↓ 1 callersMethodgetPageRankRank
(long id)
src/main/java/org/commoncrawl/webgraph/JoinSortRanks.java:126
↓ 1 callersMethodgetPageRankValue
(long id)
src/main/java/org/commoncrawl/webgraph/JoinSortRanks.java:122
↓ 1 callersMethodgetRegisteredDomain
Get the registered domain for a host name based on the ICANN section of the <a href="https://www.publicsuffix.org/">public suffix list</a>. @see Effe
src/main/java/org/commoncrawl/webgraph/explore/Graph.java:459
↓ 1 callersMethodindegree
(long vertexId)
src/main/java/org/commoncrawl/webgraph/explore/Graph.java:152
↓ 1 callersMethodisSafeToOutput
Whether the domain is safe to output given the reversed domain name seen next. @param nextDomainRevName next name in lexicographically sorted list of
src/main/java/org/commoncrawl/webgraph/HostToDomainGraph.java:184
↓ 1 callersMethodloadHarmonicCentrality
(String ranksHC)
src/main/java/org/commoncrawl/webgraph/JoinSortRanks.java:47
↓ 1 callersMethodloadPageRank
(String ranksPR)
src/main/java/org/commoncrawl/webgraph/JoinSortRanks.java:52
↓ 1 callersMethodpredecessorIntersect
(long vertexId, long[] vertexIds)
src/main/java/org/commoncrawl/webgraph/explore/Graph.java:314
↓ 1 callersMethodpredecessors
(long vertexId)
src/main/java/org/commoncrawl/webgraph/explore/Graph.java:290
↓ 1 callersMethodqueueDomain
Add the domain name to the queue if it is not already queued. Flush the queue, assuming properly sorted input. @param sb domains which are sa
src/main/java/org/commoncrawl/webgraph/HostToDomainGraph.java:406
↓ 1 callersMethodread
(Stream<String> in)
src/main/java/org/commoncrawl/webgraph/CreatePreferenceVector.java:99
↓ 1 callersMethodreadJoinNode
(String line)
src/main/java/org/commoncrawl/webgraph/CreatePreferenceVector.java:61
↓ 1 callersMethodreportConfig
()
src/main/java/org/commoncrawl/webgraph/HostToDomainGraph.java:116
↓ 1 callersMethodsetPrefSet
(Stream<String> pref)
src/main/java/org/commoncrawl/webgraph/CreatePreferenceVector.java:52
↓ 1 callersMethodsharedPredecessors
(long[] vertices)
src/main/java/org/commoncrawl/webgraph/explore/Graph.java:322
↓ 1 callersMethodskip
{@inheritDoc}
src/main/java/org/commoncrawl/webgraph/CountingMergedIntIterator.java:125
↓ 1 callersMethodstripCounts
(String[] domainGraph)
src/test/java/org/commoncrawl/webgraph/TestHostToDomainGraph.java:222
↓ 1 callersMethodsuccessorIntersect
(long vertexId, long[] vertexIds)
src/main/java/org/commoncrawl/webgraph/explore/Graph.java:204
↓ 1 callersMethodsuccessorTopLevelDomainCounts
(String vertexLabel)
src/main/java/org/commoncrawl/webgraph/explore/Graph.java:184
↓ 1 callersMethodsuccessorTopLevelDomainStream
(ImmutableGraph graph, long vertexId)
src/main/java/org/commoncrawl/webgraph/explore/Graph.java:208
↓ 1 callersMethodvalidatePreferenceVector
Check preference vector whether values sum up to 1.0, see <a href= "https://law.di.unimi.it/software/law-docs/it/unimi/dsi/law/rank/SpectralRanking.ht
src/main/java/org/commoncrawl/webgraph/CreatePreferenceVector.java:149
↓ 1 callersMethodwrite
(DataOutputStream out)
src/main/java/org/commoncrawl/webgraph/CreatePreferenceVector.java:107
MethodCountingMergedIntIterator
@param iterators input iterators
src/main/java/org/commoncrawl/webgraph/CountingMergedIntIterator.java:54
MethodCreatePreferenceVector
(double defVal)
src/main/java/org/commoncrawl/webgraph/CreatePreferenceVector.java:38
MethodDomain
(String name, String revName, long id, long numberOfHosts)
src/main/java/org/commoncrawl/webgraph/HostToDomainGraph.java:136
MethodGraph
(String name)
src/main/java/org/commoncrawl/webgraph/explore/Graph.java:64
MethodGraphExplorer
(String name)
src/main/java/org/commoncrawl/webgraph/explore/GraphExplorer.java:75
MethodHostToDomainGraph
()
src/main/java/org/commoncrawl/webgraph/HostToDomainGraph.java:255
MethodHostToDomainGraphBig
(long maxSize)
src/main/java/org/commoncrawl/webgraph/HostToDomainGraph.java:521
MethodQueuedIterator
(LazyIntIterator iterator)
src/main/java/org/commoncrawl/webgraph/CountingMergedIntIterator.java:29
MethodVertex
(String label)
src/main/java/org/commoncrawl/webgraph/explore/GraphExplorer.java:40
MethodaddRanks
(String line)
src/main/java/org/commoncrawl/webgraph/JoinSortRanks.java:134
MethodassignHarmonicCentralityRank
()
src/main/java/org/commoncrawl/webgraph/JoinSortRanks.java:237
MethodassignPageRankRank
()
src/main/java/org/commoncrawl/webgraph/JoinSortRanks.java:241
Methodcn
Change the current working node / vertex. @param vertexLabel vertex label (node name)
src/main/java/org/commoncrawl/webgraph/explore/GraphExplorer.java:106
MethodcompareHarmonicCentralityIndirect
(int k1, int k2)
src/main/java/org/commoncrawl/webgraph/JoinSortRanks.java:57
MethodcompareHarmonicCentralityIndirect
(long k1, long k2)
src/main/java/org/commoncrawl/webgraph/JoinSortRanks.java:188
MethodcomparePageRankIndirect
(int k1, int k2)
src/main/java/org/commoncrawl/webgraph/JoinSortRanks.java:73
MethodcomparePageRankIndirect
(long k1, long k2)
src/main/java/org/commoncrawl/webgraph/JoinSortRanks.java:204
MethodcompareTo
(QueuedIterator o)
src/main/java/org/commoncrawl/webgraph/CountingMergedIntIterator.java:34
MethodconvertEdge
(String line)
src/main/java/org/commoncrawl/webgraph/HostToDomainGraph.java:471
MethodconvertNode
(String line)
src/main/java/org/commoncrawl/webgraph/HostToDomainGraph.java:338
MethodconvertNode
(String line)
src/main/java/org/commoncrawl/webgraph/CreatePreferenceVector.java:92
Methoddifference
Difference of two sorted lists: a \ b
src/main/java/org/commoncrawl/webgraph/explore/Graph.java:428
MethodgetGraph
()
src/main/java/org/commoncrawl/webgraph/explore/GraphExplorer.java:79
MethodgetHarmonicCentralityRank
(long id)
src/main/java/org/commoncrawl/webgraph/JoinSortRanks.java:249
MethodgetHarmonicCentralityValue
(long id)
src/main/java/org/commoncrawl/webgraph/JoinSortRanks.java:245
next →1–100 of 144, ranked by callers