Functions — github.com/arpitbbhayani/WikiSe

hub / github.com/arpitbbhayani/WikiSe / functions

Functions116 in github.com/arpitbbhayani/WikiSe

⨍ Functions 116◇ Types & classes 20

↓ 158 callersMethodadd

Adds a string to the trie @param s String to add to the trie

src/com/wikise/util/Trie.java:44

↓ 56 callersMethodends

(String s)

src/com/wikise/process/Stemmer.java:190

↓ 31 callersMethodclose

Closes the buffered writer stream for the metadata.

src/com/wikise/util/FileIO.java:85

↓ 28 callersMethodr

(String s)

src/com/wikise/process/Stemmer.java:211

↓ 10 callersMethodprocessWord

(String word , int toSet)

src/com/wikise/process/WikiTextParser.java:385

↓ 8 callersMethodcons

(int i)

src/com/wikise/process/Stemmer.java:114

↓ 6 callersMethodcontains

Returns true iff the String is in the trie @param s query @return true if the query is in the trie

src/com/wikise/util/Trie.java:84

↓ 6 callersMethodm

()

src/com/wikise/process/Stemmer.java:133

↓ 6 callersMethodsetto

(String s)

src/com/wikise/process/Stemmer.java:202

↓ 4 callersMethodisStopword

(String word)

src/com/wikise/util/Classifiers.java:118

↓ 3 callersMethodadd

Add a character to the word being stemmed. When you are finished adding characters, you can call stem(void) to stem the word.

src/com/wikise/process/Stemmer.java:69

↓ 3 callersMethodgetPageId

()

src/com/wikise/parse/WikiPageConcise.java:12

↓ 3 callersMethodgetPageTitle

()

src/com/wikise/parse/WikiPageConcise.java:20

↓ 3 callersMethodgetPostingsForSingleTerm

(String singleTerm)

src/com/wikise/search/FileReadIO.java:181

↓ 2 callersMethodadd

Adds a string to the trie @param s String to add to the trie

src/com/wikise/util/HashedTrie.java:49

↓ 2 callersMethodaddAll

Adds a String[] of words to the trie @param sa String[] to add to the trie

src/com/wikise/util/Trie.java:63

↓ 2 callersMethodcvc

(int i)

src/com/wikise/process/Stemmer.java:182

↓ 2 callersMethoddoublec

(int j)

src/com/wikise/process/Stemmer.java:167

↓ 2 callersMethoddumpTemporaryFileToDisk

Dumps the data of temporary file to disk and closes the Buffered writer.

src/com/wikise/util/FileIO.java:119

↓ 2 callersMethodgetStemmedWord

( String word )

src/com/wikise/util/Classifiers.java:94

↓ 2 callersMethodinitialize

()

src/com/wikise/util/Classifiers.java:30

↓ 2 callersMethodstem

Stem the word placed into the Stemmer buffer through calls to add(). Returns true if the stemming process resulted in a word different from the input.

src/com/wikise/process/Stemmer.java:361

↓ 2 callersMethodtoString

After a word has been stemmed, it can be retrieved by toString(), or a reference to the internal buffer can be retrieved by getResultBuffer and getRes

src/com/wikise/process/Stemmer.java:98

↓ 2 callersMethodvowelinstem

()

src/com/wikise/process/Stemmer.java:160

↓ 2 callersMethodwriteDataToTemporaryFile

Writes the word wordToWrite into temporaryfile number countTemporaryFile using buffered writer. @param wordToWrite String that is to be written onto t

src/com/wikise/util/FileIO.java:100

↓ 1 callersMethodclose

()

src/com/wikise/util/HashedFileIO.java:61

↓ 1 callersMethodcompress

( String line )

src/com/wikise/util/CompressionDecompression.java:11

↓ 1 callersMethoddecompress

( MappedByteBuffer compressedBytes )

src/com/wikise/util/CompressionDecompression.java:55

↓ 1 callersMethoddoStemming

()

src/com/wikise/util/Classifiers.java:108

↓ 1 callersMethoddumpInfoInformation

Dumps the infobox information about the wiki pages into file "infobox.dat" @param stringToWrite

src/com/wikise/util/FileIO.java:58

↓ 1 callersMethoddumpMetaInformation

Dumps the meta information about the wiki pages into file "metadata.dat" @param wikiPage @param infoboxSeekLocation

src/com/wikise/util/FileIO.java:74

↓ 1 callersMethodfillInfoboxKeywords

()

src/com/wikise/util/Classifiers.java:71

↓ 1 callersMethodfillStopWords

()

src/com/wikise/util/Classifiers.java:131

↓ 1 callersMethodfillUnrelatedDocuments

(String indexFolderPath)

src/com/wikise/util/Classifiers.java:42

↓ 1 callersMethodgetB

()

src/com/wikise/process/TermObject.java:16

↓ 1 callersMethodgetInfoboxSeekLocation

()

src/com/wikise/process/WikiTextParser.java:582

↓ 1 callersMethodgetLineToWrite

(PriorityQueue<String> listOfWords, BufferedReader[] reader)

src/com/wikise/util/FileIO.java:344

↓ 1 callersMethodgetOffsetInDictionary

Reads secondary index for the word and gets the offset in the Dictionary index. This function is called to get the offset in dictonary. This offset is

src/com/wikise/search/FileReadIO.java:339

↓ 1 callersMethodgetOffsetInInvertedIndex

This method searches the word in the dictionary file and if found returns the corresponding offset in the index file. @param s Search term @return Off

src/com/wikise/search/FileReadIO.java:374

↓ 1 callersMethodgetOffsetInInvertedIndexFile

Returns the offset in the inverted index given the offset in dictionary. @param offsetInDictionary @param s @return <offset&gt_<next_offset>

src/com/wikise/search/FileReadIO.java:275

↓ 1 callersMethodgetPageTermInfo

()

src/com/wikise/process/WikiTextParser.java:47

↓ 1 callersMethodgetPageText

()

src/com/wikise/parse/WikiPageConcise.java:28

↓ 1 callersMethodgetPostingList

Main search function. This function is exposed to the rest of the world. Gets a posting list for a search query (can have multiple words). @param s se

src/com/wikise/search/FileReadIO.java:64

↓ 1 callersMethodgetPostingsListForTerm

returns the posting list given the offset in the dictionary and processed term.. @param processedTerm @param offsetInDictionary @return @throws IOExce

src/com/wikise/search/FileReadIO.java:217

↓ 1 callersMethodgetTermFrequency

()

src/com/wikise/process/TermObject.java:24

↓ 1 callersMethodgetWikiPageTitle

returns Page Title given docID. @param docId Wiki Document ID.

src/com/wikise/search/Search.java:55

↓ 1 callersMethodinitialize

Initializes the fileIO streams.

src/com/wikise/util/FileIO.java:43

↓ 1 callersMethodisUnrelated

(String docId)

src/com/wikise/util/Classifiers.java:38

↓ 1 callersMethodloadPageMetadata

Reads the metadata and create an online index.

src/com/wikise/search/Search.java:141

↓ 1 callersMethodmergeTemporaryFiles

Merges temporary files into a file named "index.idx" using external k-way merging. @param countTemporaryFile Number of temporary files that were creat

src/com/wikise/util/FileIO.java:135

↓ 1 callersMethodparse

Initiation of parsing process. Parsing is done Page By Page. Dumping the data into a file is made thread safe. @param indexFolderPath

src/com/wikise/parse/WikiParse.java:44

↓ 1 callersMethodparseText

()

src/com/wikise/process/WikiTextParser.java:55

↓ 1 callersMethodprocessCategories

(StringBuilder categoryString)

src/com/wikise/process/WikiTextParser.java:427

↓ 1 callersMethodprocessGeobox

(StringBuilder geoboxString)

src/com/wikise/process/WikiTextParser.java:406

↓ 1 callersMethodprocessInfobox

(StringBuilder infoboxString)

src/com/wikise/process/WikiTextParser.java:449

↓ 1 callersMethodprocessTitle

(String titleString)

src/com/wikise/process/WikiTextParser.java:559

↓ 1 callersMethodremoveUnrelatedPages

(String metaFilePath, String sMetaFilePath , String outputFilePath , String outputFilePathDoc)

src/com/wikise/util/UtilCodes.java:271

↓ 1 callersMethodsearch

(int numberOfSearchTerms, ArrayList<HashSet<String>> searchTermMap, HashMap<String, Integer> searchFieldsForTe

src/com/wikise/search/Search.java:22

↓ 1 callersMethodsetB

(Byte b)

src/com/wikise/process/TermObject.java:20

↓ 1 callersMethodsetPageId

(String pageId)

src/com/wikise/parse/WikiPageConcise.java:16

↓ 1 callersMethodsetPageText

(String pageText)

src/com/wikise/parse/WikiPageConcise.java:32

↓ 1 callersMethodsetPageTitle

(String pageTitle)

src/com/wikise/parse/WikiPageConcise.java:24

↓ 1 callersMethodsetTermFrequency

(int termFrequency)

src/com/wikise/process/TermObject.java:28

↓ 1 callersMethodsplitIntoMultiple

Very rare situation when number of temporary files created is 1. @param countTemporaryFile @throws IOException

src/com/wikise/util/FileIO.java:276

↓ 1 callersMethodstep1

()

src/com/wikise/process/Stemmer.java:235

↓ 1 callersMethodstep2

()

src/com/wikise/process/Stemmer.java:259

↓ 1 callersMethodstep3

()

src/com/wikise/process/Stemmer.java:265

↓ 1 callersMethodstep4

()

src/com/wikise/process/Stemmer.java:299

↓ 1 callersMethodstep5

()

src/com/wikise/process/Stemmer.java:316

↓ 1 callersMethodstep6

()

src/com/wikise/process/Stemmer.java:347

↓ 1 callersMethodtfidf

(int tf, int df, int bitRepresentation)

src/com/wikise/search/FileReadIO.java:175

↓ 1 callersMethodtfidf

(int tf, int df)

src/com/wikise/search/SearchThread.java:84

MethodFileIO

Public constructor. @param indexFolderPath is the path of the folder where in indexes are to be saved.

src/com/wikise/util/FileIO.java:31

MethodFileReadIO

(String folderPath)

src/com/wikise/search/FileReadIO.java:44

MethodHashedFileIO

(String folderPath)

src/com/wikise/util/HashedFileIO.java:38

MethodHashedFileReadIO

(String folderPath)

src/com/wikise/search/HashedFileReadIO.java:25

MethodHashedFileSecondaryReadIO

(String folderPath)

src/com/wikise/search/HashedFileSecondaryReadIO.java:24

MethodHashedTrie

Default contructor

src/com/wikise/util/HashedTrie.java:20

MethodSearch

(FileReadIO fileReadIO , String indexFolderPath)

src/com/wikise/search/Search.java:17

MethodSearchThread

(FileReadIO fileReadIO , int index , ConcurrentHashMap<String , Double> map , ArrayList<HashSet<String>> s, Ha

src/com/wikise/search/SearchThread.java:20

MethodStemmer

()

src/com/wikise/process/Stemmer.java:58

MethodTermObject

(Byte b, int termFrequency)

src/com/wikise/process/TermObject.java:11

MethodTrie

Default contructor

src/com/wikise/util/Trie.java:15

MethodWikiParse

This is the constructor for WikiParse @param filePath This is the path of the XML file to be parsed The document needs to be a prope

src/com/wikise/parse/WikiParse.java:31

MethodWikiSAXParseHandler

(String indexFolderPath)

src/com/wikise/parse/WikiSAXParseHandler.java:70

MethodWikiTextParser

(WikiPageConcise wikiPage, TreeMap<String, TreeSet<String>> invertedIndex, FileIO fileIO)

src/com/wikise/process/WikiTextParser.java:36

MethodaddAll

Adds a String[] of words to the trie @param sa String[] to add to the trie

src/com/wikise/util/HashedTrie.java:68

Methodcharacters

(char[] ch, int start, int length)

src/com/wikise/parse/WikiSAXParseHandler.java:184

Methodcontains

Returns TreeSet<Integer> iff the String is in the trie null otherwise @param s query @return TreeSet if the query is in the trie

src/com/wikise/util/HashedTrie.java:90

MethodcreateCompressedIndex

( String indexFolderPath )

src/com/wikise/util/UtilCodes.java:116

MethodcreateSMetadata

From metedataFilePath ( old meta data file) this function creates 1. New meta data file -> pageMetadataFilePath ( Infobox offset and title ) 2. s meta

src/com/wikise/util/UtilCodes.java:29

MethoddumpMetaInformation

(WikiPageConcise wikiPage)

src/com/wikise/util/HashedFileIO.java:156

MethoddumpSecondary

(TreeSet<String> allStrings, HashedTrie trie)

src/com/wikise/util/HashedFileIO.java:118

MethodeditDistance

(String str1,String str2)

src/com/wikise/search/Search.java:33

MethodendDocument

()

src/com/wikise/parse/WikiSAXParseHandler.java:189

MethodendElement

(String uri, String localName, String qName)

src/com/wikise/parse/WikiSAXParseHandler.java:93

MethodgetPostingListForTerm

@deprecated Gets the posting list for a term s. @param s search term (stemmed) @return Posting list for a single term. @throws IOException

src/com/wikise/search/FileReadIO.java:443

MethodgetResultBuffer

Returns a reference to a character buffer containing the results of the stemming process. You also need to consult getResultLength() to determine the

src/com/wikise/process/Stemmer.java:110

MethodgetResultLength

Returns the length of the word resulting from the stemming process.

src/com/wikise/process/Stemmer.java:103

MethodgetSeekLocations

(String searchWord )

src/com/wikise/search/HashedFileSecondaryReadIO.java:34

next →1–100 of 116, ranked by callers