Types & classes — github.com/CreekLou/simhash

CodeHub MCPcopy Create free account

hub / github.com/CreekLou/simhash / types & classes

Types & classes6 in github.com/CreekLou/simhash

⨍ Functions 22 ◇ Types & classes 6

文档读入工具 @author louxuezheng@hotmail.com

src/main/java/com/lou/simhasher/util/DicReader.java:18

FNVhash @author louxuezheng@hotmail.com

src/main/java/com/lou/simhasher/util/FNVHash.java:10

ClassKeywordExtractor

关键词抽取类。消除停用词，并对词语进行tfidf权重计算 @author louxuezheng@hotmail.com

src/main/java/com/lou/simhasher/KeywordExtractor.java:33

文本去重算法的simhash类步骤如下： 1，对文本分词，得到N维特征向量（默认为64维） 2，为分词设置权重（tf-idf） 3，为特征向量计算哈希 4，对所有特征向量加权，累加（目前仅进行非加权累加） 5，对累加结果，大于零置一，小于零置零 6，得到文本指纹（fingerprint） @au

src/main/java/com/lou/simhasher/SimHasher.java:21

ClassSimhashTest

@author louxuezheng@hotmail.com

src/test/java/com/lou/simhasher/SimhashTest.java:12

ClassWordsSegment

文档分词 @author louxuezheng@hotmail.com

src/main/java/com/lou/simhasher/seg/WordsSegment.java:30